May 21 10:27:37.102794 ip-10-0-142-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 10:27:37.102807 ip-10-0-142-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 10:27:37.102814 ip-10-0-142-243 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 10:27:37.103069 ip-10-0-142-243 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 10:27:47.216763 ip-10-0-142-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 10:27:47.216781 ip-10-0-142-243 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e6762022606d42adbeb8028b0ae1b38e --
May 21 10:30:09.133536 ip-10-0-142-243 systemd[1]: Starting Kubernetes Kubelet...
May 21 10:30:09.576525 ip-10-0-142-243 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 10:30:09.576525 ip-10-0-142-243 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 10:30:09.576525 ip-10-0-142-243 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 10:30:09.576525 ip-10-0-142-243 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 10:30:09.576525 ip-10-0-142-243 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 10:30:09.577704 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.577602    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 10:30:09.584025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584002    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 10:30:09.584025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584023    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 10:30:09.584025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584027    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584031    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584034    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584037    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584040    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584049    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584052    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584055    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584058    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584061    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584064    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584066    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584069    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584072    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584074    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584077    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584080    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584083    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584085    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584087    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 10:30:09.584130 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584090    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584092    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584096    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584098    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584102    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584104    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584107    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584109    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584112    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584114    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584117    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584120    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584122    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584124    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584129    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584132    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584135    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584138    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584141    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 10:30:09.584760 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584144    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584146    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584149    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584152    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584155    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584158    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584160    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584163    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584165    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584168    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584170    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584173    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584175    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584177    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584180    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584184    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584188    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584192    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584206    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584210    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 10:30:09.585541 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584213    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584216    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584218    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584221    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584224    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584226    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584229    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584232    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584234    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584238    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584243    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584246    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584303    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584355    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584361    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584365    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584368    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584372    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584374    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584377    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 10:30:09.586228 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584381    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584384    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584387    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.584393    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586179    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586194    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586213    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586217    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586220    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586223    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586226    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586229    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586232    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586235    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586240    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586242    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586247    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586250    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586253    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 10:30:09.586773 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586257    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586260    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586265    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586268    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586271    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586274    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586276    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586280    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586284    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586287    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586290    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586293    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586295    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586298    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586301    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586304    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586307    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586315    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586318    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 10:30:09.587273 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586321    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586324    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586326    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586330    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586333    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586335    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586338    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586341    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586343    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586346    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586348    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586351    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586353    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586356    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586359    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586361    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586368    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586371    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586373    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 10:30:09.587767 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586376    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586379    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586382    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586384    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586388    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586391    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586395    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586398    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586400    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586403    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586406    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586409    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586412    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586415    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586417    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586420    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586423    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586425    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586428    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586430    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 10:30:09.588334 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586433    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586435    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586439    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586444    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586447    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586450    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586453    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586456    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586458    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586461    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586464    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586466    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.586469    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587272    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587283    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587292    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587297    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587302    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587306    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587310    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587316    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 10:30:09.588827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587319    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587323    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587326    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587330    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587333    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587336    2563 flags.go:64] FLAG: --cgroup-root=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587340    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587343    2563 flags.go:64] FLAG: --client-ca-file=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587346    2563 flags.go:64] FLAG: --cloud-config=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587349    2563 flags.go:64] FLAG: --cloud-provider="external"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587352    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587357    2563 flags.go:64] FLAG: --cluster-domain=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587360    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587364    2563 flags.go:64] FLAG: --config-dir=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587366    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587370    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587374    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587377    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587380    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587384    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587388    2563 flags.go:64] FLAG: --contention-profiling="false"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587391    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587394    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587397    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587400    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 10:30:09.589371 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587410    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587413    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587416    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587419    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587422    2563 flags.go:64] FLAG: --enable-server="true"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587425    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587431    2563 flags.go:64] FLAG: --event-burst="100"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587434    2563 flags.go:64] FLAG: --event-qps="50"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587437    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587440    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587444    2563 flags.go:64] FLAG: --eviction-hard=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587449    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587452    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587455    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587458    2563 flags.go:64] FLAG: --eviction-soft=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587461    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587464    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587467    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587470    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587481    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587485    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587488    2563 flags.go:64] FLAG: --feature-gates=""
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587492    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587495    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587499    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 10:30:09.589978 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587502    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587505    2563 flags.go:64] FLAG: --healthz-port="10248"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587508    2563 flags.go:64] FLAG: --help="false"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587511    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587514    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587517    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587520    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587523    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587527    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587530    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587533    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587536    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587539    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587542    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587545    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587548    2563 flags.go:64] FLAG: --kube-reserved=""
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587551    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587554    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587557    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587561    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587564    2563 flags.go:64] FLAG: --lock-file=""
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587567    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587570    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587573    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 10:30:09.590616 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587579    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587582    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587584    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587588    2563 flags.go:64] FLAG: --logging-format="text"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587591    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587594    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587597    2563 flags.go:64] FLAG: --manifest-url=""
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587600    2563 flags.go:64] FLAG: --manifest-url-header=""
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587604    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587608    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587612    2563 flags.go:64] FLAG: --max-pods="110"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587615    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587618    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587621    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587624    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587627    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587631    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587634    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587643    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587646    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587649    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587652    2563 flags.go:64] FLAG: --pod-cidr=""
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587655    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 10:30:09.591257 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587660    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587663    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587666    2563 flags.go:64] FLAG: --pods-per-core="0"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587669    2563 flags.go:64] FLAG: --port="10250"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587672    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587675    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014abbf44007eda69"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587678    2563 flags.go:64] FLAG: --qos-reserved=""
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587681    2563 flags.go:64] FLAG: --read-only-port="10255"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587684    2563 flags.go:64] FLAG: --register-node="true"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587687    2563 flags.go:64] FLAG: --register-schedulable="true"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587690    2563 flags.go:64] FLAG: --register-with-taints=""
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587694    2563 flags.go:64] FLAG: --registry-burst="10"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587697    2563 flags.go:64] FLAG: --registry-qps="5"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587699    2563 flags.go:64] FLAG: --reserved-cpus=""
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587702    2563 flags.go:64] FLAG: --reserved-memory=""
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587706    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587708    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587711    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587715    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587718    2563 flags.go:64] FLAG: --runonce="false"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587721    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587724    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587727    2563 flags.go:64] FLAG: --seccomp-default="false"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587730    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587733    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587736    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 10:30:09.591818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587740    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587743    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587746    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587749    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587751    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587754    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587757    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587760    2563 flags.go:64] FLAG: --system-cgroups=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587763    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587769    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587773    2563 flags.go:64] FLAG: --tls-cert-file=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587776    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587781    2563 flags.go:64] FLAG: --tls-min-version=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587783    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587786    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587789    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587792    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587795    2563 flags.go:64] FLAG: --v="2"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587800    2563 flags.go:64] FLAG: --version="false"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587804    2563 flags.go:64] FLAG: --vmodule=""
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587808    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.587812    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587940    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587943    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 10:30:09.592471 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587947    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587950    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587953    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587956    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587959    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587961    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587964    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587967    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587973    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587976    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587978    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587980    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587983    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587986    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587988    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587992    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587995    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.587997    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588000    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 10:30:09.593089 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588002    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588005    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588008    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588011    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588014    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588016    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588019    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588021    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588024    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588026    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588029    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588031    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588034    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588037    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588039    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588042    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588045    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588047    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588050    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 10:30:09.593602 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588053    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588055    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588059    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588062    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588065    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588067    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588070    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588073    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588076    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588080    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588084    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588087    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588090    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588092    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588094    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588097    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588100    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588103    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588106    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588108    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 10:30:09.594073 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588113    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588115    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588118    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588121    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588123    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588126    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588129    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588131    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588134    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588136    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588139    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588142    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588145    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588147    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588152    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588154    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588157    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588159    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588162    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 10:30:09.594635 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588166    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588170    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588173    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588175    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588178    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588180    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.588183    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 10:30:09.595135 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.589082    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 10:30:09.596335 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.596309    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 10:30:09.596376 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.596336    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 10:30:09.596407 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596392    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 10:30:09.596407 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596399    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 10:30:09.596407 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596402    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 10:30:09.596407 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596405    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 10:30:09.596407 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596408    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596412    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596414    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596417    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596420    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596423    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596425    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596428    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596431    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596434    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596436    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596439    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596441    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596444    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596447    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596449    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596452    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596454    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596457    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596459    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 10:30:09.596535 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596462    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596464    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596467    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596470    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596473    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596478    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596481    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596485    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596487    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596490    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596493    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596495    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596497    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596500    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596503    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596506    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596508    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596511    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596514    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 10:30:09.597025 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596516    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596519    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596522    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596524    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596527    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596529    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596532    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596535    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596539    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596543    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596547    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596550    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596554    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596557    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596560    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596563    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596566    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596569    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596572    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 10:30:09.597528 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596574    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596577    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596580    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596584    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596586    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596589    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596592    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596595    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596598    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596601    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596603    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596606    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596609    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596612    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596615    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596618    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596621    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596624    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596627    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596629    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 10:30:09.597989 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596632    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596635    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596637    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596640    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.596645    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596768    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596773    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596776    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596779    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596782    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596785    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596788    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596790    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596793    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596796    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 10:30:09.598664 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596800    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596802    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596805    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596808    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596811    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596814    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596816    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596819    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596822    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596824    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596827    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596829    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596832    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596835    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596837    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596840    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596843    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596845    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596848    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596851    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 10:30:09.599038 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596853    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596856    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596858    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596861    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596863    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596866    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596869    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596871    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596874    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596876    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596879    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596881    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596884    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596887    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596890    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596893    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596896    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596898    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596901    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596903    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 10:30:09.599610 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596906    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596909    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596911    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596914    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596916    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596919    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596922    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596924    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596927    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596929    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596932    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596935    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596938    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596941    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596944    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596947    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596949    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596952    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596954    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 10:30:09.600110 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596957    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596960    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596962    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596965    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596968    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596972    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596975    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596979    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596982    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596985    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596988    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596991    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596994    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596996    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.596999    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.597002    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 10:30:09.600613 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:09.597004    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.597009    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.597173    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.599513    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.600570    2563 server.go:1019] "Starting client certificate rotation"
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.600670    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 10:30:09.600996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.600704    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 10:30:09.631349 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.631323    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 10:30:09.633188 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.633167    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 10:30:09.652519 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.652490    2563 log.go:25] "Validated CRI v1 runtime API"
May 21 10:30:09.658848 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.658825    2563 log.go:25] "Validated CRI v1 image API"
May 21 10:30:09.660499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.660473    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 10:30:09.665493 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.665466    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 972416cc-ab48-4576-b7bd-2c2504d48a2f:/dev/nvme0n1p3 c0baf2fe-920b-465a-b3dc-58bae550a877:/dev/nvme0n1p4]
May 21 10:30:09.665493 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.665491    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 10:30:09.668964 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.668938    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 10:30:09.670067 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.669949    2563 manager.go:217] Machine: {Timestamp:2026-05-21 10:30:09.669380652 +0000 UTC m=+0.419484430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088822 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bd51bf6380791f342b5bdea59e7f5 SystemUUID:ec2bd51b-f638-0791-f342-b5bdea59e7f5 BootID:e6762022-606d-42ad-beb8-028b0ae1b38e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:24:04:02:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:24:04:02:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:fe:9d:7b:a3:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 10:30:09.671020 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.671006    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 10:30:09.671130 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.671116    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 10:30:09.673461 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.673423    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 10:30:09.673641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.673466    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 10:30:09.673703 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.673652    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 21 10:30:09.673703 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.673663    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 21 10:30:09.673703 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.673671    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 10:30:09.675309 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.675293    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 10:30:09.677180 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.677161    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 10:30:09.677368 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.677357    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 10:30:09.679882 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.679863    2563 kubelet.go:491] "Attempting to sync node with API server"
May 21 10:30:09.679960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.679886    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 10:30:09.679960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.679910    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 10:30:09.679960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.679924    2563 kubelet.go:397] "Adding apiserver pod source"
May 21 10:30:09.679960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.679937    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 10:30:09.681374 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.681356    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 10:30:09.681429 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.681382    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 10:30:09.684696 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.684676    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 10:30:09.687265 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.687250    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 10:30:09.688353 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688332    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 10:30:09.688353 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688352    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688359    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688369    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688382    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688389    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688395    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688400    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688416    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 10:30:09.688421 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688423    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 10:30:09.688647 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688438    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 10:30:09.688910 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.688901    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 10:30:09.690100 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.690084    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 10:30:09.690137 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.690104    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 10:30:09.691334 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.691312    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8r7rc"
May 21 10:30:09.692191 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.692170    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 10:30:09.692668 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.692647    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 10:30:09.693849 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.693836    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 10:30:09.693899 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.693881    2563 server.go:1295] "Started kubelet"
May 21 10:30:09.693971 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.693929    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 10:30:09.694036 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.693986    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 10:30:09.694081 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.694068    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 10:30:09.694885 ip-10-0-142-243 systemd[1]: Started Kubernetes Kubelet.
May 21 10:30:09.695372 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.695014    2563 server.go:317] "Adding debug handlers to kubelet server"
May 21 10:30:09.695667 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.695573    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 10:30:09.700235 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.700134    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8r7rc"
May 21 10:30:09.702241 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.702221    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 10:30:09.703299 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.702157    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-243.ec2.internal.18b18df4a68cfa25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-243.ec2.internal,UID:ip-10-0-142-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-243.ec2.internal,},FirstTimestamp:2026-05-21 10:30:09.693850149 +0000 UTC m=+0.443953929,LastTimestamp:2026-05-21 10:30:09.693850149 +0000 UTC m=+0.443953929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-243.ec2.internal,}"
May 21 10:30:09.705559 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.705541    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 10:30:09.707181 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.707162    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 10:30:09.707834 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.707790    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 10:30:09.708047 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708030    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 10:30:09.708106 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708048    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 10:30:09.708250 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708233    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 10:30:09.708358 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708342    2563 reconstruct.go:97] "Volume reconstruction finished"
May 21 10:30:09.708420 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708361    2563 reconciler.go:26] "Reconciler: start to sync state"
May 21 10:30:09.708632 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708616    2563 factory.go:55] Registering systemd factory
May 21 10:30:09.708690 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708636    2563 factory.go:223] Registration of the systemd container factory successfully
May 21 10:30:09.709140 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.708937    2563 factory.go:153] Registering CRI-O factory
May 21 10:30:09.709210 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.709150    2563 factory.go:223] Registration of the crio container factory successfully
May 21 10:30:09.709299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.709288    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 10:30:09.709350 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.709312    2563 factory.go:103] Registering Raw factory
May 21 10:30:09.709350 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.709327    2563 manager.go:1196] Started watching for new ooms in manager
May 21 10:30:09.709423 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.709359    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:09.709753 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.709740    2563 manager.go:319] Starting recovery of all containers
May 21 10:30:09.718133 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.718111    2563 manager.go:324] Recovery completed
May 21 10:30:09.719058 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.719041    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:09.719299 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.719263    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 21 10:30:09.721976 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.721946    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-243.ec2.internal\" not found" node="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.722552 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.722540    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.724779 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.724761    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.724862 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.724791    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.724862 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.724802    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.725340 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.725328    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 10:30:09.725340 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.725340    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 10:30:09.725422 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.725357    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 10:30:09.729554 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.729541    2563 policy_none.go:49] "None policy: Start"
May 21 10:30:09.729599 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.729559    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 10:30:09.729599 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.729569    2563 state_mem.go:35] "Initializing new in-memory state store"
May 21 10:30:09.770512 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.770482    2563 manager.go:341] "Starting Device Plugin manager"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.770539    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.770552    2563 server.go:85] "Starting device plugin registration server"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.770824    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.770836    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.771483    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.771578    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.771587    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.771601    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 10:30:09.798228 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.771641    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:09.815049 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.815009    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 10:30:09.816335 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.816315    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 10:30:09.816428 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.816349    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 10:30:09.816428 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.816374    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 10:30:09.816428 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.816385    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 10:30:09.816553 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.816432    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 10:30:09.822840 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.822815    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:09.871959 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.871878    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.872897 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.872877    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.872998 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.872918    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.872998 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.872932    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.872998 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.872965    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.878601 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.878582    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.878692 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.878609    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-243.ec2.internal\": node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:09.895493 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.895459    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:09.917005 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.916974    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"]
May 21 10:30:09.917106 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.917060    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.918724 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.918710    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.918818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.918739    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.918818 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.918749    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.920973 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.920959    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.921154 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921139    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:09.921190 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921175    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.921761 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921743    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.921864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921768    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.921864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921780    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.921864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921748    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.921864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921849    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.921864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.921865    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.924348 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.924331    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:09.924441 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.924359    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 10:30:09.927727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.927709    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientMemory"
May 21 10:30:09.927825 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.927738    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasNoDiskPressure"
May 21 10:30:09.927825 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:09.927747    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeHasSufficientPID"
May 21 10:30:09.945893 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.945867    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-243.ec2.internal\" not found" node="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.952054 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.952035    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-243.ec2.internal\" not found" node="ip-10-0-142-243.ec2.internal"
May 21 10:30:09.996068 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:09.996020    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.010127 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.010101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.010230 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.010137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.010230 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.010163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6c67bdaff929766e0715c164801ff23-config\") pod \"kube-apiserver-proxy-ip-10-0-142-243.ec2.internal\" (UID: \"c6c67bdaff929766e0715c164801ff23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.096919 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.096884    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.111300 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111273    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.111375 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111310    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.111375 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111333    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6c67bdaff929766e0715c164801ff23-config\") pod \"kube-apiserver-proxy-ip-10-0-142-243.ec2.internal\" (UID: \"c6c67bdaff929766e0715c164801ff23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.111440 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6c67bdaff929766e0715c164801ff23-config\") pod \"kube-apiserver-proxy-ip-10-0-142-243.ec2.internal\" (UID: \"c6c67bdaff929766e0715c164801ff23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.111440 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111385    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.111440 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.111389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c6ef7376fdc0a6dfb611218842d371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal\" (UID: \"a6c6ef7376fdc0a6dfb611218842d371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.197727 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.197651    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.249156 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.249120    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.254900 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.254878    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:10.298053 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.298017    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.398508 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.398476    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.499077 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.498985    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.599449 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.599422    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.600524 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.600506    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 10:30:10.600679 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.600660    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 10:30:10.600726 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.600693    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 10:30:10.626938 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.626907    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:10.700117 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.700082    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.704277 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.704247    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 10:25:09 +0000 UTC" deadline="2027-12-11 02:23:25.178297347 +0000 UTC"
May 21 10:30:10.704277 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.704277    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13647h53m14.474024902s"
May 21 10:30:10.707986 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.707963    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 10:30:10.727647 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.727616    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 10:30:10.744720 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:10.744683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c67bdaff929766e0715c164801ff23.slice/crio-053d0d45292bcd7ed9972280434c8fa36f4dcddec1b11719d09c43d2688d470f WatchSource:0}: Error finding container 053d0d45292bcd7ed9972280434c8fa36f4dcddec1b11719d09c43d2688d470f: Status 404 returned error can't find the container with id 053d0d45292bcd7ed9972280434c8fa36f4dcddec1b11719d09c43d2688d470f
May 21 10:30:10.744988 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:10.744966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c6ef7376fdc0a6dfb611218842d371.slice/crio-24f3210e87e96ff2044e4c9da1b3db4a77ba81b508188a50b9884ab096ef26fa WatchSource:0}: Error finding container 24f3210e87e96ff2044e4c9da1b3db4a77ba81b508188a50b9884ab096ef26fa: Status 404 returned error can't find the container with id 24f3210e87e96ff2044e4c9da1b3db4a77ba81b508188a50b9884ab096ef26fa
May 21 10:30:10.747073 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.747013    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjh82"
May 21 10:30:10.748886 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.748863    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 10:30:10.753165 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.753144    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjh82"
May 21 10:30:10.800947 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.800911    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:10.819314 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.819268    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal" event={"ID":"a6c6ef7376fdc0a6dfb611218842d371","Type":"ContainerStarted","Data":"24f3210e87e96ff2044e4c9da1b3db4a77ba81b508188a50b9884ab096ef26fa"}
May 21 10:30:10.820270 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:10.820248    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal" event={"ID":"c6c67bdaff929766e0715c164801ff23","Type":"ContainerStarted","Data":"053d0d45292bcd7ed9972280434c8fa36f4dcddec1b11719d09c43d2688d470f"}
May 21 10:30:10.901503 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:10.901461    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:11.002026 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.001948    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:11.102490 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.102444    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-243.ec2.internal\" not found"
May 21 10:30:11.111511 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.111475    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:11.209351 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.209313    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal"
May 21 10:30:11.221930 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.221900    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 10:30:11.222760 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.222738    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal"
May 21 10:30:11.233478 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.233458    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 10:30:11.509879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.509854    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:11.681863 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.681833    2563 apiserver.go:52] "Watching apiserver"
May 21 10:30:11.694343 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.694314    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 10:30:11.695544 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.695505    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vlfr6","kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-hnqt2","openshift-multus/multus-xldp4","openshift-multus/network-metrics-daemon-fdfdp","openshift-network-diagnostics/network-check-target-hxvv2","openshift-ovn-kubernetes/ovnkube-node-s9mm2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6","openshift-cluster-node-tuning-operator/tuned-6vmxn","openshift-dns/node-resolver-x5pwz","openshift-image-registry/node-ca-h7fgn","openshift-network-operator/iptables-alerter-gwt5t"]
May 21 10:30:11.697999 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.697979    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:11.698114 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.698056    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:11.700261 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.700242    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.702526 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.702506    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xldp4"
May 21 10:30:11.703032 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703010    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 10:30:11.703139 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703080    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lp89k\""
May 21 10:30:11.703220 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703143    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 10:30:11.703220 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703086    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 10:30:11.703220 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703164    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 10:30:11.703220 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.703086    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 10:30:11.705374 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.705352    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 10:30:11.705473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.705417    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dmdzv\""
May 21 10:30:11.705813 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.705795    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.705903 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.705869    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:11.708095 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.708053    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.710447 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.710427    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 10:30:11.710555 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.710509    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvhtd\""
May 21 10:30:11.710682 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.710668    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 10:30:11.712844 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.712795    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.712936 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.712913    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.715144 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715125    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.715240 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715188    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 10:30:11.715619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715597    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 10:30:11.715619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715612    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 10:30:11.715731 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715676    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 10:30:11.715731 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715676    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5dh5\""
May 21 10:30:11.715731 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715713    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 10:30:11.715844 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715830    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-db48l\""
May 21 10:30:11.715958 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715933    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 10:30:11.716007 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715939    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 10:30:11.716007 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.715987    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 10:30:11.717012 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.716996    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 10:30:11.717739 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.717652    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.718057 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718040    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 10:30:11.718301 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718280    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 10:30:11.718635 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718609    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7t5h\""
May 21 10:30:11.718727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-slash\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-ovn\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-netd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-os-release\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-system-cni-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-kubelet\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.718931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-system-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-netns\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.718984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-etc-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-hostroot\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-multus-certs\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-etc-kubernetes\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-config\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-env-overrides\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-socket-dir-parent\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.719337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-bin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrz7\" (UniqueName: \"kubernetes.io/projected/5ec0be34-4423-4431-b0ea-b3ad001937b7-kube-api-access-nzrz7\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-systemd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-bin\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lb29\" (UniqueName: \"kubernetes.io/projected/b1abebf1-764f-40df-adcb-9f38e9d9cb24-kube-api-access-8lb29\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-os-release\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-cni-binary-copy\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-k8s-cni-cncf-io\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-conf-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-cnibin\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1282ea1a-d2dd-48dc-b866-036fcf17ad38-agent-certs\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-script-lib\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-netns\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-multus\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-node-log\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720017 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-log-socket\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjnc4\" (UniqueName: \"kubernetes.io/projected/812c2141-6d2f-4334-a705-50d6b726f927-kube-api-access-sjnc4\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-cnibin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-kubelet\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4d9p\" (UniqueName: \"kubernetes.io/projected/a59cd83e-3ead-4201-aad4-1da906578979-kube-api-access-x4d9p\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.719981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1282ea1a-d2dd-48dc-b866-036fcf17ad38-konnectivity-ca\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.720636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.720005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-systemd-units\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.720806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-var-lib-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.720918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.720862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-daemon-config\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.720918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.720897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.721861 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.720007    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 10:30:11.721861 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.721781    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89cnq\""
May 21 10:30:11.722477 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.722457    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 10:30:11.724888 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.724866    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.725153 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.724867    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.727990 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.727972    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 10:30:11.728075 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728031    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pl6fr\""
May 21 10:30:11.728075 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728066    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 10:30:11.728183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728070    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkm5q\""
May 21 10:30:11.728420 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728387    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 10:30:11.728516 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728420    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 10:30:11.728578 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.728566    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 10:30:11.729056 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.729036    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 10:30:11.753874 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.753842    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:10 +0000 UTC" deadline="2028-01-04 18:51:04.214174574 +0000 UTC"
May 21 10:30:11.753874 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.753871    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14240h20m52.460306336s"
May 21 10:30:11.809174 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.809144    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 10:30:11.822025 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.821999    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-k8s-cni-cncf-io\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822053    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-script-lib\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822069    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-k8s-cni-cncf-io\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822125    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-netns\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822163    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-multus\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-conf\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822233    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-log-socket\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-multus\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822252    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-netns\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822276    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjnc4\" (UniqueName: \"kubernetes.io/projected/812c2141-6d2f-4334-a705-50d6b726f927-kube-api-access-sjnc4\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-log-socket\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822346    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-cnibin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822436    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-kubelet\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-cnibin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822505    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4d9p\" (UniqueName: \"kubernetes.io/projected/a59cd83e-3ead-4201-aad4-1da906578979-kube-api-access-x4d9p\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.822528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822526    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-kubelet\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-systemd\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-var-lib-kubelet\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822683    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-script-lib\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-host\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822740    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-var-lib-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-lib-modules\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-var-lib-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-hosts-file\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-kubernetes\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-sys\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.822918 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snjv4\" (UniqueName: \"kubernetes.io/projected/39d8bcad-f0bd-4bed-b712-8ed56d672f43-kube-api-access-snjv4\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822932    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-system-cni-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.822972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-system-cni-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-kubelet\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823046    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823096    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-kubelet\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823104    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-system-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823110    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6nt\" (UniqueName: \"kubernetes.io/projected/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-kube-api-access-8k6nt\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-system-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcgxq\" (UniqueName: \"kubernetes.io/projected/f29ca414-c08c-4f25-b9c4-934f032b34b0-kube-api-access-jcgxq\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823212    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-etc-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823235    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823259    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzrz7\" (UniqueName: \"kubernetes.io/projected/5ec0be34-4423-4431-b0ea-b3ad001937b7-kube-api-access-nzrz7\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.823446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823327    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-socket-dir-parent\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-etc-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823352    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-bin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4zh\" (UniqueName: \"kubernetes.io/projected/78b1cb6a-00cd-48fd-b303-2b066fec4be9-kube-api-access-df4zh\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-socket-dir-parent\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823422    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-systemd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-var-lib-cni-bin\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823454    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-os-release\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823482    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-conf-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823499    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-cnibin\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-systemd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823526    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1282ea1a-d2dd-48dc-b866-036fcf17ad38-agent-certs\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823549    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-conf-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823550    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-cnibin\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-run\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823550    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-os-release\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823590    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-node-log\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823617    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-node-log\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.824274 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f29ca414-c08c-4f25-b9c4-934f032b34b0-serviceca\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823653    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1282ea1a-d2dd-48dc-b866-036fcf17ad38-konnectivity-ca\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823678    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-systemd-units\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823694    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-daemon-config\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823713    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysconfig\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-tmp-dir\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823781    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f29ca414-c08c-4f25-b9c4-934f032b34b0-host\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823797    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/812c2141-6d2f-4334-a705-50d6b726f927-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823839    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-systemd-units\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823844    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-slash\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823897    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-slash\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823877    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.823911    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823940    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-ovn\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825029 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.823977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-ovn\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.824020    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:12.323998898 +0000 UTC m=+3.074102664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824040    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-netd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824060    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-os-release\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824069    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-netd\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78b1cb6a-00cd-48fd-b303-2b066fec4be9-host-slash\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gkh\" (UniqueName: \"kubernetes.io/projected/addaa29d-66d7-4174-b0a2-4e875c91175a-kube-api-access-78gkh\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824113    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-multus-certs\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824129    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-os-release\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824152    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824173    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-netns\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824186    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1282ea1a-d2dd-48dc-b866-036fcf17ad38-konnectivity-ca\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824211    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-host-run-multus-certs\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824221    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824251    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.825574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824254    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-run-openvswitch\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-run-netns\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824275    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-hostroot\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824298    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-daemon-config\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-hostroot\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824313    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-etc-kubernetes\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824329    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824343    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-etc-kubernetes\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-modprobe-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec0be34-4423-4431-b0ea-b3ad001937b7-multus-cni-dir\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-tuned\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-tmp\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824435    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-config\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824459    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-env-overrides\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824484    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824511    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78b1cb6a-00cd-48fd-b303-2b066fec4be9-iptables-alerter-script\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.826019 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-device-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824666    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-bin\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824689    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lb29\" (UniqueName: \"kubernetes.io/projected/b1abebf1-764f-40df-adcb-9f38e9d9cb24-kube-api-access-8lb29\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824716    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-cni-binary-copy\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovnkube-config\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.824932    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1abebf1-764f-40df-adcb-9f38e9d9cb24-host-cni-bin\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.825025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/812c2141-6d2f-4334-a705-50d6b726f927-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.825035    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1abebf1-764f-40df-adcb-9f38e9d9cb24-env-overrides\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.826492 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.825447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec0be34-4423-4431-b0ea-b3ad001937b7-cni-binary-copy\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.829610 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.827394    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1abebf1-764f-40df-adcb-9f38e9d9cb24-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.829610 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.827618    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1282ea1a-d2dd-48dc-b866-036fcf17ad38-agent-certs\") pod \"konnectivity-agent-vlfr6\" (UID: \"1282ea1a-d2dd-48dc-b866-036fcf17ad38\") " pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:11.833160 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.833133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzrz7\" (UniqueName: \"kubernetes.io/projected/5ec0be34-4423-4431-b0ea-b3ad001937b7-kube-api-access-nzrz7\") pod \"multus-xldp4\" (UID: \"5ec0be34-4423-4431-b0ea-b3ad001937b7\") " pod="openshift-multus/multus-xldp4"
May 21 10:30:11.833340 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.833326    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:11.833403 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.833346    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:11.833403 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.833358    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:11.833499 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:11.833438    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:12.33341657 +0000 UTC m=+3.083520355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:11.833499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.833438    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4d9p\" (UniqueName: \"kubernetes.io/projected/a59cd83e-3ead-4201-aad4-1da906578979-kube-api-access-x4d9p\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:11.833771 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.833749    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjnc4\" (UniqueName: \"kubernetes.io/projected/812c2141-6d2f-4334-a705-50d6b726f927-kube-api-access-sjnc4\") pod \"multus-additional-cni-plugins-hnqt2\" (UID: \"812c2141-6d2f-4334-a705-50d6b726f927\") " pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:11.834102 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.834087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lb29\" (UniqueName: \"kubernetes.io/projected/b1abebf1-764f-40df-adcb-9f38e9d9cb24-kube-api-access-8lb29\") pod \"ovnkube-node-s9mm2\" (UID: \"b1abebf1-764f-40df-adcb-9f38e9d9cb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:11.906526 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.906497    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 10:30:11.925113 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925074    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6nt\" (UniqueName: \"kubernetes.io/projected/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-kube-api-access-8k6nt\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.925299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925122    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcgxq\" (UniqueName: \"kubernetes.io/projected/f29ca414-c08c-4f25-b9c4-934f032b34b0-kube-api-access-jcgxq\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.925299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925151    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925175    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925290    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df4zh\" (UniqueName: \"kubernetes.io/projected/78b1cb6a-00cd-48fd-b303-2b066fec4be9-kube-api-access-df4zh\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925321    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-run\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925343    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f29ca414-c08c-4f25-b9c4-934f032b34b0-serviceca\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925369    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925380    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysconfig\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925440    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-tmp-dir\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-run\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925430    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysconfig\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925468    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f29ca414-c08c-4f25-b9c4-934f032b34b0-host\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.925499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925496    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925526    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78b1cb6a-00cd-48fd-b303-2b066fec4be9-host-slash\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925543    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f29ca414-c08c-4f25-b9c4-934f032b34b0-host\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925554    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78gkh\" (UniqueName: \"kubernetes.io/projected/addaa29d-66d7-4174-b0a2-4e875c91175a-kube-api-access-78gkh\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925594    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-modprobe-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925595    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925619    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-tuned\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78b1cb6a-00cd-48fd-b303-2b066fec4be9-host-slash\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925642    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-tmp\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925684    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78b1cb6a-00cd-48fd-b303-2b066fec4be9-iptables-alerter-script\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925714    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925740    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-device-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-tmp-dir\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925768    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925772    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f29ca414-c08c-4f25-b9c4-934f032b34b0-serviceca\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925795    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.925979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-modprobe-d\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-device-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925841    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925841    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-conf\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925890    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-systemd\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925916    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-var-lib-kubelet\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925950    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-host\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925962    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-sysctl-conf\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925983    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-lib-modules\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925992    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-systemd\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-var-lib-kubelet\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926009    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-hosts-file\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926014    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-host\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.925953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/addaa29d-66d7-4174-b0a2-4e875c91175a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926042    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-kubernetes\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926055    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-hosts-file\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926068    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-sys\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926093    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snjv4\" (UniqueName: \"kubernetes.io/projected/39d8bcad-f0bd-4bed-b712-8ed56d672f43-kube-api-access-snjv4\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.926612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-lib-modules\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.927327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-kubernetes\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.927327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39d8bcad-f0bd-4bed-b712-8ed56d672f43-sys\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.927327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.926188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78b1cb6a-00cd-48fd-b303-2b066fec4be9-iptables-alerter-script\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.927962 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.927941    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-tmp\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.928067 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.927985    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39d8bcad-f0bd-4bed-b712-8ed56d672f43-etc-tuned\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.936810 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.936784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snjv4\" (UniqueName: \"kubernetes.io/projected/39d8bcad-f0bd-4bed-b712-8ed56d672f43-kube-api-access-snjv4\") pod \"tuned-6vmxn\" (UID: \"39d8bcad-f0bd-4bed-b712-8ed56d672f43\") " pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:11.936925 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.936884    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6nt\" (UniqueName: \"kubernetes.io/projected/a6cd8e68-e8b0-4522-b9ae-98c890c40c17-kube-api-access-8k6nt\") pod \"node-resolver-x5pwz\" (UID: \"a6cd8e68-e8b0-4522-b9ae-98c890c40c17\") " pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:11.937320 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.937301    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gkh\" (UniqueName: \"kubernetes.io/projected/addaa29d-66d7-4174-b0a2-4e875c91175a-kube-api-access-78gkh\") pod \"aws-ebs-csi-driver-node-rnlh6\" (UID: \"addaa29d-66d7-4174-b0a2-4e875c91175a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:11.937417 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.937374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4zh\" (UniqueName: \"kubernetes.io/projected/78b1cb6a-00cd-48fd-b303-2b066fec4be9-kube-api-access-df4zh\") pod \"iptables-alerter-gwt5t\" (UID: \"78b1cb6a-00cd-48fd-b303-2b066fec4be9\") " pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:11.937417 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:11.937374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcgxq\" (UniqueName: \"kubernetes.io/projected/f29ca414-c08c-4f25-b9c4-934f032b34b0-kube-api-access-jcgxq\") pod \"node-ca-h7fgn\" (UID: \"f29ca414-c08c-4f25-b9c4-934f032b34b0\") " pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:12.011334 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.011300    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnqt2"
May 21 10:30:12.018437 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.018378    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xldp4"
May 21 10:30:12.028142 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.028114    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:12.033905 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.033879    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:12.040591 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.040567    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6"
May 21 10:30:12.047287 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.047263    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vmxn"
May 21 10:30:12.054880 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.054857    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5pwz"
May 21 10:30:12.061518 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.061494    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwt5t"
May 21 10:30:12.066107 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.066089    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7fgn"
May 21 10:30:12.329338 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.329268    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:12.329473 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.329376    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:12.329473 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.329427    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:13.329413266 +0000 UTC m=+4.079517032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:12.384931 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.384736    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29ca414_c08c_4f25_b9c4_934f032b34b0.slice/crio-507e14c4234f4493ff476338a801a25bf100772765aa5faa55ac8a65f120d61f WatchSource:0}: Error finding container 507e14c4234f4493ff476338a801a25bf100772765aa5faa55ac8a65f120d61f: Status 404 returned error can't find the container with id 507e14c4234f4493ff476338a801a25bf100772765aa5faa55ac8a65f120d61f
May 21 10:30:12.385732 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.385709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cd8e68_e8b0_4522_b9ae_98c890c40c17.slice/crio-6f7b0e8d4f37e0a29e0badcd5a83ff567963eab5f13e3e34655453971ccaa997 WatchSource:0}: Error finding container 6f7b0e8d4f37e0a29e0badcd5a83ff567963eab5f13e3e34655453971ccaa997: Status 404 returned error can't find the container with id 6f7b0e8d4f37e0a29e0badcd5a83ff567963eab5f13e3e34655453971ccaa997
May 21 10:30:12.386332 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.386310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1282ea1a_d2dd_48dc_b866_036fcf17ad38.slice/crio-f33be14c584783ceada9a7c9130bb37760046f9e1003136e5d679c123289a8da WatchSource:0}: Error finding container f33be14c584783ceada9a7c9130bb37760046f9e1003136e5d679c123289a8da: Status 404 returned error can't find the container with id f33be14c584783ceada9a7c9130bb37760046f9e1003136e5d679c123289a8da
May 21 10:30:12.388094 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.388027    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812c2141_6d2f_4334_a705_50d6b726f927.slice/crio-a6e65a55657f1909e35778cc7dde5c4e2e01437bb888c3ba31a66417d6b9b3cc WatchSource:0}: Error finding container a6e65a55657f1909e35778cc7dde5c4e2e01437bb888c3ba31a66417d6b9b3cc: Status 404 returned error can't find the container with id a6e65a55657f1909e35778cc7dde5c4e2e01437bb888c3ba31a66417d6b9b3cc
May 21 10:30:12.390806 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.390771    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddaa29d_66d7_4174_b0a2_4e875c91175a.slice/crio-e714f3b405b140521d843784a4bf70a5544ec44ad1ed6e1abe7b386a2a97561f WatchSource:0}: Error finding container e714f3b405b140521d843784a4bf70a5544ec44ad1ed6e1abe7b386a2a97561f: Status 404 returned error can't find the container with id e714f3b405b140521d843784a4bf70a5544ec44ad1ed6e1abe7b386a2a97561f
May 21 10:30:12.392717 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.392265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec0be34_4423_4431_b0ea_b3ad001937b7.slice/crio-5b4ddebe2a1ed33e90e1b22c94d0baeff1991d101d8f1d5571e7ad9a3a5b1db8 WatchSource:0}: Error finding container 5b4ddebe2a1ed33e90e1b22c94d0baeff1991d101d8f1d5571e7ad9a3a5b1db8: Status 404 returned error can't find the container with id 5b4ddebe2a1ed33e90e1b22c94d0baeff1991d101d8f1d5571e7ad9a3a5b1db8
May 21 10:30:12.393617 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.393592    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1abebf1_764f_40df_adcb_9f38e9d9cb24.slice/crio-a038d7a5cfdfc475a3160d8e549ea8dcd6a54b1676c813d55545e6aac9403810 WatchSource:0}: Error finding container a038d7a5cfdfc475a3160d8e549ea8dcd6a54b1676c813d55545e6aac9403810: Status 404 returned error can't find the container with id a038d7a5cfdfc475a3160d8e549ea8dcd6a54b1676c813d55545e6aac9403810
May 21 10:30:12.394040 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.394016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d8bcad_f0bd_4bed_b712_8ed56d672f43.slice/crio-0f4f227e8e6dfab5fed48113c27081a52e77722f56ce0f8c0d4cfe43a60b1da2 WatchSource:0}: Error finding container 0f4f227e8e6dfab5fed48113c27081a52e77722f56ce0f8c0d4cfe43a60b1da2: Status 404 returned error can't find the container with id 0f4f227e8e6dfab5fed48113c27081a52e77722f56ce0f8c0d4cfe43a60b1da2
May 21 10:30:12.397074 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:12.397048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b1cb6a_00cd_48fd_b303_2b066fec4be9.slice/crio-83c687ab75948f615ae9e2bdaa70b0b437c8afbc32783dd5aecadd766c4aa653 WatchSource:0}: Error finding container 83c687ab75948f615ae9e2bdaa70b0b437c8afbc32783dd5aecadd766c4aa653: Status 404 returned error can't find the container with id 83c687ab75948f615ae9e2bdaa70b0b437c8afbc32783dd5aecadd766c4aa653
May 21 10:30:12.430653 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.430621    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:12.430790 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.430782    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:12.430835 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.430798    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:12.430835 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.430808    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:12.430921 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:12.430857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:13.430842981 +0000 UTC m=+4.180946747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:12.755007 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.754956    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:10 +0000 UTC" deadline="2027-12-23 21:14:37.296902522 +0000 UTC"
May 21 10:30:12.755007 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.754999    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13954h44m24.541906965s"
May 21 10:30:12.826288 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.824921    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7fgn" event={"ID":"f29ca414-c08c-4f25-b9c4-934f032b34b0","Type":"ContainerStarted","Data":"507e14c4234f4493ff476338a801a25bf100772765aa5faa55ac8a65f120d61f"}
May 21 10:30:12.833422 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.833040    2563 generic.go:358] "Generic (PLEG): container finished" podID="a6c6ef7376fdc0a6dfb611218842d371" containerID="eef9e37522c5f805cb3f3eb2457ebffb6379b40153353dbdf0032374d2a06536" exitCode=0
May 21 10:30:12.833422 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.833124    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal" event={"ID":"a6c6ef7376fdc0a6dfb611218842d371","Type":"ContainerDied","Data":"eef9e37522c5f805cb3f3eb2457ebffb6379b40153353dbdf0032374d2a06536"}
May 21 10:30:12.838400 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.836995    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"a038d7a5cfdfc475a3160d8e549ea8dcd6a54b1676c813d55545e6aac9403810"}
May 21 10:30:12.850934 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.850900    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vmxn" event={"ID":"39d8bcad-f0bd-4bed-b712-8ed56d672f43","Type":"ContainerStarted","Data":"0f4f227e8e6dfab5fed48113c27081a52e77722f56ce0f8c0d4cfe43a60b1da2"}
May 21 10:30:12.856884 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.856834    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6" event={"ID":"addaa29d-66d7-4174-b0a2-4e875c91175a","Type":"ContainerStarted","Data":"e714f3b405b140521d843784a4bf70a5544ec44ad1ed6e1abe7b386a2a97561f"}
May 21 10:30:12.864175 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.864137    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlfr6" event={"ID":"1282ea1a-d2dd-48dc-b866-036fcf17ad38","Type":"ContainerStarted","Data":"f33be14c584783ceada9a7c9130bb37760046f9e1003136e5d679c123289a8da"}
May 21 10:30:12.888963 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.888837    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerStarted","Data":"a6e65a55657f1909e35778cc7dde5c4e2e01437bb888c3ba31a66417d6b9b3cc"}
May 21 10:30:12.894102 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.894053    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal" event={"ID":"c6c67bdaff929766e0715c164801ff23","Type":"ContainerStarted","Data":"29a7a7a42c25c443df7c8c4a696abbe71e93d4bed062bbade32b4fa99ff76827"}
May 21 10:30:12.909377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.909314    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-243.ec2.internal" podStartSLOduration=1.9092937380000001 podStartE2EDuration="1.909293738s" podCreationTimestamp="2026-05-21 10:30:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:12.909040053 +0000 UTC m=+3.659143843" watchObservedRunningTime="2026-05-21 10:30:12.909293738 +0000 UTC m=+3.659397525"
May 21 10:30:12.912412 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.912359    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xldp4" event={"ID":"5ec0be34-4423-4431-b0ea-b3ad001937b7","Type":"ContainerStarted","Data":"5b4ddebe2a1ed33e90e1b22c94d0baeff1991d101d8f1d5571e7ad9a3a5b1db8"}
May 21 10:30:12.934570 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.934509    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwt5t" event={"ID":"78b1cb6a-00cd-48fd-b303-2b066fec4be9","Type":"ContainerStarted","Data":"83c687ab75948f615ae9e2bdaa70b0b437c8afbc32783dd5aecadd766c4aa653"}
May 21 10:30:12.949286 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:12.949245    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5pwz" event={"ID":"a6cd8e68-e8b0-4522-b9ae-98c890c40c17","Type":"ContainerStarted","Data":"6f7b0e8d4f37e0a29e0badcd5a83ff567963eab5f13e3e34655453971ccaa997"}
May 21 10:30:13.340690 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:13.340600    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:13.340869 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.340818    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:13.340928 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.340886    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:15.340865602 +0000 UTC m=+6.090969370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:13.442112 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:13.441984    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:13.442322 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.442163    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:13.442322 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.442182    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:13.442322 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.442210    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:13.442322 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.442276    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:15.442255135 +0000 UTC m=+6.192359160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:13.819123 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:13.819043    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:13.819615 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.819169    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:13.819615 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:13.819333    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:13.819615 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:13.819429    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:13.966735 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:13.966700    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal" event={"ID":"a6c6ef7376fdc0a6dfb611218842d371","Type":"ContainerStarted","Data":"1cdbeb3547e2b5c31b33473b6e5298451e91bc54ed23a9867c82d1b750ec9aeb"}
May 21 10:30:15.357516 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:15.357469    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:15.358050 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.357687    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:15.358050 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.357755    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:19.357734259 +0000 UTC m=+10.107838028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:15.458794 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:15.458754    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:15.459076 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.459001    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:15.459076 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.459028    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:15.459076 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.459043    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:15.459459 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.459103    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:19.459084846 +0000 UTC m=+10.209188615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:15.817574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:15.817267    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:15.817574 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:15.817268    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:15.817574 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.817415    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:15.817574 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:15.817479    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:17.817258 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:17.817219    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:17.817723 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:17.817267    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:17.817723 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:17.817359    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:17.817723 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:17.817467    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:19.393296 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:19.393209    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:19.393725 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.393373    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:19.393725 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.393483    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:27.393430907 +0000 UTC m=+18.143534685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:19.494054 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:19.494020    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:19.494304 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.494221    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:19.494304 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.494247    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:19.494304 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.494262    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:19.494476 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.494327    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:27.494307204 +0000 UTC m=+18.244410987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:19.818515 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:19.818348    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:19.818515 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.818468    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:19.818515 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:19.818508    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:19.818775 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:19.818585    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:21.817106 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:21.817062    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:21.817106 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:21.817094    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:21.817653 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:21.817241    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:21.817653 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:21.817324    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:23.817148 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:23.817105    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:23.817750 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:23.817246    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:23.817750 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:23.817281    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:23.817750 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:23.817388    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:25.817573 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:25.817530    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:25.817573 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:25.817562    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:25.818055 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:25.817678    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:25.818055 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:25.817807    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:27.451065 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:27.451024    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:27.451537 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.451211    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:27.451537 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.451293    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.451271671 +0000 UTC m=+34.201375460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:27.551619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:27.551552    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:27.551787 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.551741    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:27.551787 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.551770    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:27.551787 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.551783    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:27.551970 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.551848    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.551829885 +0000 UTC m=+34.301933655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:27.816614 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:27.816538    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:27.816614 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:27.816591    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:27.816820 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.816661    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:27.816820 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:27.816739    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:29.817850 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:29.817808    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:29.818327 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:29.817928    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:29.818327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:29.817968    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:29.818327 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:29.818094    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:30.997562 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:30.997274    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlfr6" event={"ID":"1282ea1a-d2dd-48dc-b866-036fcf17ad38","Type":"ContainerStarted","Data":"c939d095ca14f61fbaa233a0187f565e9e9dbfdc621c526cff30e948c9a4f5d0"}
May 21 10:30:30.998567 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:30.998543    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="dc5ff44fa0bc322f8bb96df45d66aeb39c813a19ee9c3614963c716516a81b48" exitCode=0
May 21 10:30:30.998672 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:30.998624    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"dc5ff44fa0bc322f8bb96df45d66aeb39c813a19ee9c3614963c716516a81b48"}
May 21 10:30:31.000053 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.000027    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xldp4" event={"ID":"5ec0be34-4423-4431-b0ea-b3ad001937b7","Type":"ContainerStarted","Data":"ecfd6952b43101d49f11f5a5d70698100a1e8435f9b3eaaf4036c3b7f6eae2b7"}
May 21 10:30:31.002751 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.002409    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5pwz" event={"ID":"a6cd8e68-e8b0-4522-b9ae-98c890c40c17","Type":"ContainerStarted","Data":"3895d76c1e8515e80265ce5b424d56366b0d7f0baa9f08dce6a90471fd3c99ef"}
May 21 10:30:31.004683 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.004659    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7fgn" event={"ID":"f29ca414-c08c-4f25-b9c4-934f032b34b0","Type":"ContainerStarted","Data":"64cc03911c7c9df8745ec9334792ea5a114e814319031c11ba5b2f39c23c6362"}
May 21 10:30:31.006156 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.006132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:30:31.006436 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.006418    2563 generic.go:358] "Generic (PLEG): container finished" podID="b1abebf1-764f-40df-adcb-9f38e9d9cb24" containerID="d2905e8543effb91226a642cfba7c2fbde8cb902c1cd5a6868096984503498ad" exitCode=1
May 21 10:30:31.006513 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.006479    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"ac08bcd4dbe66f8f1ee75b1ea2db5628d14771a9f5d346adbecd4bc708079620"}
May 21 10:30:31.006513 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.006502    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerDied","Data":"d2905e8543effb91226a642cfba7c2fbde8cb902c1cd5a6868096984503498ad"}
May 21 10:30:31.006596 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.006518    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"6e9363fb28cbc6f95569f720557a99a5af865e974f2dcb7b577ebad71d42464f"}
May 21 10:30:31.007620 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.007602    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vmxn" event={"ID":"39d8bcad-f0bd-4bed-b712-8ed56d672f43","Type":"ContainerStarted","Data":"29c5118f6e4889ec2a45588b9583773123a37f4354e840d5de2e3d82b2ff4054"}
May 21 10:30:31.008803 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.008785    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6" event={"ID":"addaa29d-66d7-4174-b0a2-4e875c91175a","Type":"ContainerStarted","Data":"ad59ae0851da7767c60ebb33d33eb746dffe8d601ac4683346bbfe7b62357ad1"}
May 21 10:30:31.015227 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.015165    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vlfr6" podStartSLOduration=4.299450422 podStartE2EDuration="22.015155907s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.389058401 +0000 UTC m=+3.139162180" lastFinishedPulling="2026-05-21 10:30:30.104763885 +0000 UTC m=+20.854867665" observedRunningTime="2026-05-21 10:30:31.014751509 +0000 UTC m=+21.764855319" watchObservedRunningTime="2026-05-21 10:30:31.015155907 +0000 UTC m=+21.765259691"
May 21 10:30:31.015317 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.015274    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-243.ec2.internal" podStartSLOduration=20.015270011 podStartE2EDuration="20.015270011s" podCreationTimestamp="2026-05-21 10:30:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:13.98454832 +0000 UTC m=+4.734652110" watchObservedRunningTime="2026-05-21 10:30:31.015270011 +0000 UTC m=+21.765373800"
May 21 10:30:31.081003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.080938    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6vmxn" podStartSLOduration=4.302273498 podStartE2EDuration="22.080919834s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.397064263 +0000 UTC m=+3.147168043" lastFinishedPulling="2026-05-21 10:30:30.175710593 +0000 UTC m=+20.925814379" observedRunningTime="2026-05-21 10:30:31.064109081 +0000 UTC m=+21.814212868" watchObservedRunningTime="2026-05-21 10:30:31.080919834 +0000 UTC m=+21.831023625"
May 21 10:30:31.081120 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.081081    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-x5pwz" podStartSLOduration=4.294769286 podStartE2EDuration="22.081073459s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.387622033 +0000 UTC m=+3.137725802" lastFinishedPulling="2026-05-21 10:30:30.173926196 +0000 UTC m=+20.924029975" observedRunningTime="2026-05-21 10:30:31.080865911 +0000 UTC m=+21.830969701" watchObservedRunningTime="2026-05-21 10:30:31.081073459 +0000 UTC m=+21.831177248"
May 21 10:30:31.098366 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.098312    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7fgn" podStartSLOduration=4.331461234 podStartE2EDuration="22.098291346s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.386462813 +0000 UTC m=+3.136566584" lastFinishedPulling="2026-05-21 10:30:30.153292917 +0000 UTC m=+20.903396696" observedRunningTime="2026-05-21 10:30:31.09753711 +0000 UTC m=+21.847640901" watchObservedRunningTime="2026-05-21 10:30:31.098291346 +0000 UTC m=+21.848395138"
May 21 10:30:31.131442 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.131402    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xldp4" podStartSLOduration=4.334221429 podStartE2EDuration="22.131385823s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.395772767 +0000 UTC m=+3.145876533" lastFinishedPulling="2026-05-21 10:30:30.19293716 +0000 UTC m=+20.943040927" observedRunningTime="2026-05-21 10:30:31.130454006 +0000 UTC m=+21.880557795" watchObservedRunningTime="2026-05-21 10:30:31.131385823 +0000 UTC m=+21.881489610"
May 21 10:30:31.816724 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.816674    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:31.816979 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:31.816956    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:31.817077 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:31.816995    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:31.817135 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:31.817092    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:32.003782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.003597    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 10:30:32.012366 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.012333    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwt5t" event={"ID":"78b1cb6a-00cd-48fd-b303-2b066fec4be9","Type":"ContainerStarted","Data":"06bf0a1c6dc8b3baa8e800373dbb8607c647e1cf260f95cb801e952cf0ec5b8c"}
May 21 10:30:32.014603 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.014587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:30:32.014960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.014938    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"297ea25e89d339951df443ad007aacfe3cdb99bef0f3eca544724d6e15672c46"}
May 21 10:30:32.015035 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.014964    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"255ab001077cc67b7e2d30d21c130f854d2cf257ba5b077cb2850d0fa4af0f59"}
May 21 10:30:32.015035 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.014974    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"a3ab2cc5c8eac24d4f14fdae66589dc63fe94cdc73b38b677acf6da2050b06a9"}
May 21 10:30:32.016535 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.016503    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6" event={"ID":"addaa29d-66d7-4174-b0a2-4e875c91175a","Type":"ContainerStarted","Data":"9d5ca00921ece880ea4b6c7b087a73b9494ddffb51702d5bf3e4c5b26d712287"}
May 21 10:30:32.035628 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.033213    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwt5t" podStartSLOduration=5.249215064 podStartE2EDuration="23.033185916s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.398925215 +0000 UTC m=+3.149028981" lastFinishedPulling="2026-05-21 10:30:30.182896054 +0000 UTC m=+20.932999833" observedRunningTime="2026-05-21 10:30:32.032910956 +0000 UTC m=+22.783014744" watchObservedRunningTime="2026-05-21 10:30:32.033185916 +0000 UTC m=+22.783289704"
May 21 10:30:32.287588 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.287499    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:32.783844 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.783715    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T10:30:32.003777038Z","UUID":"95dea08d-d26c-499d-8db6-a8a12ba7284d","Handler":null,"Name":"","Endpoint":""}
May 21 10:30:32.785778 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.785754    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 10:30:32.785904 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:32.785792    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 10:30:33.817313 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:33.817282    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:33.817861 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:33.817282    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:33.817861 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:33.817419    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:33.817861 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:33.817490    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:34.023516 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.023481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:30:34.023899 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.023872    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"38efe9cd4c0f0760faed18d67b63c03a31ca6c06a936450ea6e12320dd3b1595"}
May 21 10:30:34.025732 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.025707    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6" event={"ID":"addaa29d-66d7-4174-b0a2-4e875c91175a","Type":"ContainerStarted","Data":"3845e7313d9797181ead198f32f4e7b9c62c2d0f70b85db080f94c68f2a3c840"}
May 21 10:30:34.045742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.045667    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnlh6" podStartSLOduration=4.252667619 podStartE2EDuration="25.045643496s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.395782715 +0000 UTC m=+3.145886482" lastFinishedPulling="2026-05-21 10:30:33.188758594 +0000 UTC m=+23.938862359" observedRunningTime="2026-05-21 10:30:34.045122708 +0000 UTC m=+24.795226497" watchObservedRunningTime="2026-05-21 10:30:34.045643496 +0000 UTC m=+24.795747301"
May 21 10:30:34.217486 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.217454    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:34.218052 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:34.218034    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:35.030508 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:35.030473    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vlfr6"
May 21 10:30:35.817524 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:35.817341    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:35.817615 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:35.817376    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:35.817667 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:35.817610    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:35.817703 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:35.817678    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:36.034627 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.034605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:30:36.035248 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.034956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"220055e4e52af121819af1faae4e664ceae136cbe702dc9280892ae7e4e61c8f"}
May 21 10:30:36.035248 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.035227    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:36.035436 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.035419    2563 scope.go:117] "RemoveContainer" containerID="d2905e8543effb91226a642cfba7c2fbde8cb902c1cd5a6868096984503498ad"
May 21 10:30:36.036707 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.036677    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerStarted","Data":"5723f227c9d1f8c9a59edd31aac9ace69b26f4f2628e7671abd821493a732856"}
May 21 10:30:36.050982 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:36.050964    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:37.041792 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.041766    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:30:37.042263 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.042099    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" event={"ID":"b1abebf1-764f-40df-adcb-9f38e9d9cb24","Type":"ContainerStarted","Data":"856c7edf223fda85f7799291009307c6bfc38c919756a036457597b56b6688f3"}
May 21 10:30:37.042494 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.042469    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:37.042630 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.042579    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:37.043805 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.043782    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="5723f227c9d1f8c9a59edd31aac9ace69b26f4f2628e7671abd821493a732856" exitCode=0
May 21 10:30:37.043935 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.043813    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"5723f227c9d1f8c9a59edd31aac9ace69b26f4f2628e7671abd821493a732856"}
May 21 10:30:37.057618 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.057600    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:30:37.081087 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.081037    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2" podStartSLOduration=9.939964495 podStartE2EDuration="28.081023693s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.39650739 +0000 UTC m=+3.146611170" lastFinishedPulling="2026-05-21 10:30:30.53756659 +0000 UTC m=+21.287670368" observedRunningTime="2026-05-21 10:30:37.080794642 +0000 UTC m=+27.830898433" watchObservedRunningTime="2026-05-21 10:30:37.081023693 +0000 UTC m=+27.831127477"
May 21 10:30:37.533821 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.533767    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxvv2"]
May 21 10:30:37.534004 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.533916    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:37.534072 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:37.534025    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:37.535916 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.535889    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdfdp"]
May 21 10:30:37.536037 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:37.536009    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:37.536133 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:37.536117    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:38.816725 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:38.816546    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:38.817128 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:38.816798    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:39.049398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:39.049363    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="e5d6e9535dfcea6035d8a78ddce42208c2c509cab1ec9295c1aea92d71a954a0" exitCode=0
May 21 10:30:39.049566 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:39.049453    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"e5d6e9535dfcea6035d8a78ddce42208c2c509cab1ec9295c1aea92d71a954a0"}
May 21 10:30:39.818695 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:39.818612    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:39.819112 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:39.818747    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:40.817452 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:40.817424    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:40.817599 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:40.817517    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:41.055829 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:41.055789    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="caf3efcc71d52b5373a4b3540070dc71d0655881046f8210ed41098f0509e3d7" exitCode=0
May 21 10:30:41.056532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:41.055844    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"caf3efcc71d52b5373a4b3540070dc71d0655881046f8210ed41098f0509e3d7"}
May 21 10:30:41.817140 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:41.817107    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:41.817422 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:41.817300    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:30:42.817846 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:42.817608    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:42.818342 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:42.817947    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvv2" podUID="9d8433c7-6393-44cf-ba75-5475979de33f"
May 21 10:30:43.049495 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.049462    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-243.ec2.internal" event="NodeReady"
May 21 10:30:43.049736 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.049632    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 10:30:43.094276 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.094183    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vvc9"]
May 21 10:30:43.114349 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.114319    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vtq29"]
May 21 10:30:43.114546 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.114519    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.118462 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.118430    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\""
May 21 10:30:43.118595 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.118491    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 10:30:43.118877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.118857    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 10:30:43.130445 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.130424    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vvc9"]
May 21 10:30:43.130570 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.130460    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtq29"]
May 21 10:30:43.130570 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.130511    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.133979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.133957    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 10:30:43.134338 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.134318    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 10:30:43.134427 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.134381    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\""
May 21 10:30:43.134427 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.134407    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 10:30:43.267674 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.267879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdk2\" (UniqueName: \"kubernetes.io/projected/060f8229-535f-4818-bde5-2b21e1cb5536-kube-api-access-vcdk2\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.267879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.267879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fws6f\" (UniqueName: \"kubernetes.io/projected/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-kube-api-access-fws6f\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.267879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/060f8229-535f-4818-bde5-2b21e1cb5536-config-volume\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.267879 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.267849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/060f8229-535f-4818-bde5-2b21e1cb5536-tmp-dir\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.369007 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.368975    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.369227 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369020    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdk2\" (UniqueName: \"kubernetes.io/projected/060f8229-535f-4818-bde5-2b21e1cb5536-kube-api-access-vcdk2\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.369227 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.369147    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:43.369325 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.369225    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:43.369325 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.369239    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.869215688 +0000 UTC m=+34.619319471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:43.369325 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.369272    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.869256935 +0000 UTC m=+34.619360722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:30:43.369325 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369146    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.369500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369330    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fws6f\" (UniqueName: \"kubernetes.io/projected/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-kube-api-access-fws6f\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.369500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369400    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/060f8229-535f-4818-bde5-2b21e1cb5536-config-volume\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.369500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369436    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/060f8229-535f-4818-bde5-2b21e1cb5536-tmp-dir\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.369836 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.369807    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/060f8229-535f-4818-bde5-2b21e1cb5536-tmp-dir\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.377894 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.377866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/060f8229-535f-4818-bde5-2b21e1cb5536-config-volume\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.389685 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.389657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdk2\" (UniqueName: \"kubernetes.io/projected/060f8229-535f-4818-bde5-2b21e1cb5536-kube-api-access-vcdk2\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.389996 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.389974    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fws6f\" (UniqueName: \"kubernetes.io/projected/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-kube-api-access-fws6f\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.470672 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.470628    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:43.470874 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.470800    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:43.470931 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.470885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:15.470859476 +0000 UTC m=+66.220963290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 10:30:43.571945 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.571903    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:43.572189 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.572091    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 10:30:43.572189 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.572118    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 10:30:43.572189 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.572131    2563 projected.go:194] Error preparing data for projected volume kube-api-access-8cb9z for pod openshift-network-diagnostics/network-check-target-hxvv2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:43.572390 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.572219    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z podName:9d8433c7-6393-44cf-ba75-5475979de33f nodeName:}" failed. No retries permitted until 2026-05-21 10:31:15.572181604 +0000 UTC m=+66.322285370 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cb9z" (UniqueName: "kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z") pod "network-check-target-hxvv2" (UID: "9d8433c7-6393-44cf-ba75-5475979de33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 10:30:43.817020 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.816908    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:30:43.819825 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.819800    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 10:30:43.820217 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.819825    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\""
May 21 10:30:43.874328 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.874298    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:43.874503 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:43.874345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:43.874503 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.874460    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:43.874602 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.874533    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.874516958 +0000 UTC m=+35.624620745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:30:43.874602 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.874459    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:43.874602 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:43.874593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.874579004 +0000 UTC m=+35.624682776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:44.817209 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.817155    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:30:44.820409 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.820381    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\""
May 21 10:30:44.820857 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.820381    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 10:30:44.821573 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.821549    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 10:30:44.881156 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.881118    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:44.881368 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:44.881172    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:44.881368 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:44.881274    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:44.881368 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:44.881334    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:44.881368 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:44.881348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:46.881326948 +0000 UTC m=+37.631430715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:44.881578 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:44.881386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:46.881367907 +0000 UTC m=+37.631471690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:30:46.893387 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:46.893352    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:46.893387 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:46.893394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:46.893884 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:46.893508    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:46.893884 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:46.893570    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:50.893553164 +0000 UTC m=+41.643656929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:46.893884 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:46.893587    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:46.893884 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:46.893632    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:50.893621023 +0000 UTC m=+41.643724789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:30:47.070239 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:47.070183    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="90f4374dd9b734495347bb1378ff31eb6bd4cb05f143e4c41e8a18d49ca3f7f4" exitCode=0
May 21 10:30:47.070380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:47.070255    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"90f4374dd9b734495347bb1378ff31eb6bd4cb05f143e4c41e8a18d49ca3f7f4"}
May 21 10:30:48.077711 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.077668    2563 generic.go:358] "Generic (PLEG): container finished" podID="812c2141-6d2f-4334-a705-50d6b726f927" containerID="e173740d3a0644e77536a42da4a97e14a063dfbfae974861fde776d4a8be5889" exitCode=0
May 21 10:30:48.078121 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.077720    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerDied","Data":"e173740d3a0644e77536a42da4a97e14a063dfbfae974861fde776d4a8be5889"}
May 21 10:30:48.337376 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.337284    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"]
May 21 10:30:48.341065 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.341047    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"]
May 21 10:30:48.341248 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.341228    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.344414 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.344389    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 10:30:48.344414 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.344392    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 10:30:48.344760 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.344745    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 10:30:48.344797 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.344770    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.345154 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.345138    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 10:30:48.349055 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.349036    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 10:30:48.349286 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.349270    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 10:30:48.349358 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.349299    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 10:30:48.349563 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.349548    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 10:30:48.358525 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.358505    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"]
May 21 10:30:48.359044 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.359027    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"]
May 21 10:30:48.504493 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.504691 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eabb2442-83f0-4abc-b810-a4bfb6b6f577-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.504691 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eabb2442-83f0-4abc-b810-a4bfb6b6f577-tmp\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.504691 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.504691 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nvq5\" (UniqueName: \"kubernetes.io/projected/eabb2442-83f0-4abc-b810-a4bfb6b6f577-kube-api-access-7nvq5\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.504691 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/033400de-4150-4e17-87b7-13c660a3fafc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.504876 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.504876 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.504876 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.504735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz7g9\" (UniqueName: \"kubernetes.io/projected/033400de-4150-4e17-87b7-13c660a3fafc-kube-api-access-fz7g9\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.605534 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605455    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.605534 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605495    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz7g9\" (UniqueName: \"kubernetes.io/projected/033400de-4150-4e17-87b7-13c660a3fafc-kube-api-access-fz7g9\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.605720 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605548    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.605720 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605687    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eabb2442-83f0-4abc-b810-a4bfb6b6f577-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.605820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605736    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eabb2442-83f0-4abc-b810-a4bfb6b6f577-tmp\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.605820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605765    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.605820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605802    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nvq5\" (UniqueName: \"kubernetes.io/projected/eabb2442-83f0-4abc-b810-a4bfb6b6f577-kube-api-access-7nvq5\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.605968 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.605842    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/033400de-4150-4e17-87b7-13c660a3fafc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.606183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.606058    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.606353 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.606243    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eabb2442-83f0-4abc-b810-a4bfb6b6f577-tmp\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.606702 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.606533    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/033400de-4150-4e17-87b7-13c660a3fafc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.609229 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.609187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-ca\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.609334 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.609245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.609334 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.609252    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-hub\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.609572 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.609557    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/033400de-4150-4e17-87b7-13c660a3fafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.609865 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.609843    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eabb2442-83f0-4abc-b810-a4bfb6b6f577-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.615555 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.615518    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz7g9\" (UniqueName: \"kubernetes.io/projected/033400de-4150-4e17-87b7-13c660a3fafc-kube-api-access-fz7g9\") pod \"cluster-proxy-proxy-agent-9b5cc5598-bf5v6\" (UID: \"033400de-4150-4e17-87b7-13c660a3fafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.616903 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.616877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nvq5\" (UniqueName: \"kubernetes.io/projected/eabb2442-83f0-4abc-b810-a4bfb6b6f577-kube-api-access-7nvq5\") pod \"klusterlet-addon-workmgr-6bd7955d69-2k47j\" (UID: \"eabb2442-83f0-4abc-b810-a4bfb6b6f577\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.652010 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.651966    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:48.666792 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.666763    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:30:48.836959 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.836934    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"]
May 21 10:30:48.837919 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:48.837897    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"]
May 21 10:30:48.838615 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:48.838585    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod033400de_4150_4e17_87b7_13c660a3fafc.slice/crio-0b2157e2501dd9c4f3e33720609e5539de69717d246f75e1a33439069966a40c WatchSource:0}: Error finding container 0b2157e2501dd9c4f3e33720609e5539de69717d246f75e1a33439069966a40c: Status 404 returned error can't find the container with id 0b2157e2501dd9c4f3e33720609e5539de69717d246f75e1a33439069966a40c
May 21 10:30:48.839057 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:30:48.839034    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabb2442_83f0_4abc_b810_a4bfb6b6f577.slice/crio-ee59cbe50f4f74838591e67b60951057e1c071d3c6cff99d6c91531634eae31c WatchSource:0}: Error finding container ee59cbe50f4f74838591e67b60951057e1c071d3c6cff99d6c91531634eae31c: Status 404 returned error can't find the container with id ee59cbe50f4f74838591e67b60951057e1c071d3c6cff99d6c91531634eae31c
May 21 10:30:49.082934 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:49.082898    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" event={"ID":"812c2141-6d2f-4334-a705-50d6b726f927","Type":"ContainerStarted","Data":"4e31ccfb9c2ff0ec64286d2ae2885458027ed42530475a4b37a902124698ceb5"}
May 21 10:30:49.084022 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:49.083998    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerStarted","Data":"0b2157e2501dd9c4f3e33720609e5539de69717d246f75e1a33439069966a40c"}
May 21 10:30:49.084997 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:49.084975    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" event={"ID":"eabb2442-83f0-4abc-b810-a4bfb6b6f577","Type":"ContainerStarted","Data":"ee59cbe50f4f74838591e67b60951057e1c071d3c6cff99d6c91531634eae31c"}
May 21 10:30:49.115459 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:49.115405    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hnqt2" podStartSLOduration=6.001151937 podStartE2EDuration="40.115389008s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:30:12.389947149 +0000 UTC m=+3.140050915" lastFinishedPulling="2026-05-21 10:30:46.504184216 +0000 UTC m=+37.254287986" observedRunningTime="2026-05-21 10:30:49.115058931 +0000 UTC m=+39.865162718" watchObservedRunningTime="2026-05-21 10:30:49.115389008 +0000 UTC m=+39.865492793"
May 21 10:30:50.941452 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:50.941410    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:50.941911 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:50.941580    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:50.941911 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:50.941617    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:50.941911 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:50.941659    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:58.941633627 +0000 UTC m=+49.691737400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:30:50.941911 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:50.941714    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:50.941911 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:50.941757    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:58.941743871 +0000 UTC m=+49.691847637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:54.098165 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:54.098075    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerStarted","Data":"f0975ccc16d7138e0bd2307c7e643564977f9209747ea72a36a2abeec93bb1f1"}
May 21 10:30:54.099407 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:54.099384    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" event={"ID":"eabb2442-83f0-4abc-b810-a4bfb6b6f577","Type":"ContainerStarted","Data":"01a8a6d14b2560fc32c3ea872bca940eff4ff622a48ed132b1ba9b3abc5b7bc4"}
May 21 10:30:54.099558 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:54.099539    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:54.103224 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:54.103178    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:30:54.127463 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:54.127407    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" podStartSLOduration=1.124720897 podStartE2EDuration="6.127393828s" podCreationTimestamp="2026-05-21 10:30:48 +0000 UTC" firstStartedPulling="2026-05-21 10:30:48.840838255 +0000 UTC m=+39.590942021" lastFinishedPulling="2026-05-21 10:30:53.843511183 +0000 UTC m=+44.593614952" observedRunningTime="2026-05-21 10:30:54.12694161 +0000 UTC m=+44.877045399" watchObservedRunningTime="2026-05-21 10:30:54.127393828 +0000 UTC m=+44.877497616"
May 21 10:30:58.109769 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:58.109733    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerStarted","Data":"a235dc117ba84f4d8cd9f348537d0c7a087270b0ed2b9953c5a0488abe1820a6"}
May 21 10:30:58.109769 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:58.109774    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerStarted","Data":"70ec7c7a004a78da8aacaa82b2d95443f9b124e4e513285f3091f4c2ea413ba6"}
May 21 10:30:58.132298 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:58.132254    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" podStartSLOduration=1.843479346 podStartE2EDuration="10.132239304s" podCreationTimestamp="2026-05-21 10:30:48 +0000 UTC" firstStartedPulling="2026-05-21 10:30:48.840526815 +0000 UTC m=+39.590630587" lastFinishedPulling="2026-05-21 10:30:57.129286776 +0000 UTC m=+47.879390545" observedRunningTime="2026-05-21 10:30:58.131074518 +0000 UTC m=+48.881178306" watchObservedRunningTime="2026-05-21 10:30:58.132239304 +0000 UTC m=+48.882343091"
May 21 10:30:59.001506 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:59.001465    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:30:59.001506 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:30:59.001507    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:30:59.001745 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:59.001612    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:30:59.001745 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:59.001687    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:15.001663634 +0000 UTC m=+65.751767400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:30:59.001745 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:59.001624    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:30:59.001745 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:30:59.001746    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:15.001734275 +0000 UTC m=+65.751838096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:31:09.068066 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:09.068039    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mm2"
May 21 10:31:15.015564 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.015499    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:31:15.015564 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.015578    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:31:15.016092 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.015655    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:31:15.016092 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.015722    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:47.015707202 +0000 UTC m=+97.765810968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:31:15.016092 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.015655    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:31:15.016092 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.015781    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:47.015768965 +0000 UTC m=+97.765872741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:31:15.520039 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.519995    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:31:15.523472 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.523450    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 10:31:15.531114 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.531091    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 10:31:15.531171 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:15.531161    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:19.531137977 +0000 UTC m=+130.281241743 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : secret "metrics-daemon-secret" not found
May 21 10:31:15.620477 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.620426    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:31:15.623783 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.623765    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 10:31:15.634209 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.634175    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 10:31:15.644472 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.644432    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cb9z\" (UniqueName: \"kubernetes.io/projected/9d8433c7-6393-44cf-ba75-5475979de33f-kube-api-access-8cb9z\") pod \"network-check-target-hxvv2\" (UID: \"9d8433c7-6393-44cf-ba75-5475979de33f\") " pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:31:15.731381 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.731350    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\""
May 21 10:31:15.738678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.738657    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:31:15.859698 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:15.859664    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxvv2"]
May 21 10:31:15.866022 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:31:15.865987    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8433c7_6393_44cf_ba75_5475979de33f.slice/crio-2905f81e3d72e76a6a2aa5a2ce024d2e03c920a7c8c4663b3110d846df8f6953 WatchSource:0}: Error finding container 2905f81e3d72e76a6a2aa5a2ce024d2e03c920a7c8c4663b3110d846df8f6953: Status 404 returned error can't find the container with id 2905f81e3d72e76a6a2aa5a2ce024d2e03c920a7c8c4663b3110d846df8f6953
May 21 10:31:16.146807 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:16.146774    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxvv2" event={"ID":"9d8433c7-6393-44cf-ba75-5475979de33f","Type":"ContainerStarted","Data":"2905f81e3d72e76a6a2aa5a2ce024d2e03c920a7c8c4663b3110d846df8f6953"}
May 21 10:31:19.154408 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:19.154365    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxvv2" event={"ID":"9d8433c7-6393-44cf-ba75-5475979de33f","Type":"ContainerStarted","Data":"f6547f22797c48e3fed7f4faa18bed2b8b7222410685be5d559bd5d51e18cef5"}
May 21 10:31:19.154801 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:19.154424    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:31:19.192788 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:19.192736    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxvv2" podStartSLOduration=67.668572505 podStartE2EDuration="1m10.192719134s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:31:15.867518047 +0000 UTC m=+66.617621819" lastFinishedPulling="2026-05-21 10:31:18.391664679 +0000 UTC m=+69.141768448" observedRunningTime="2026-05-21 10:31:19.191536637 +0000 UTC m=+69.941640424" watchObservedRunningTime="2026-05-21 10:31:19.192719134 +0000 UTC m=+69.942822916"
May 21 10:31:47.046247 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:47.046213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:31:47.046727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:47.046258    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:31:47.046727 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:47.046313    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 10:31:47.046727 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:47.046361    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 10:31:47.046727 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:47.046385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert podName:80c57ce5-4aa0-42a2-bd3e-9e299bda1f39 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:51.046368547 +0000 UTC m=+161.796472313 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert") pod "ingress-canary-vtq29" (UID: "80c57ce5-4aa0-42a2-bd3e-9e299bda1f39") : secret "canary-serving-cert" not found
May 21 10:31:47.046727 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:31:47.046414    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls podName:060f8229-535f-4818-bde5-2b21e1cb5536 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:51.046401713 +0000 UTC m=+161.796505479 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls") pod "dns-default-7vvc9" (UID: "060f8229-535f-4818-bde5-2b21e1cb5536") : secret "dns-default-metrics-tls" not found
May 21 10:31:50.159855 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:31:50.159821    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxvv2"
May 21 10:32:19.574892 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:19.574846    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:32:19.575437 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:32:19.574967    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 10:32:19.575437 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:32:19.575030    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs podName:a59cd83e-3ead-4201-aad4-1da906578979 nodeName:}" failed. No retries permitted until 2026-05-21 10:34:21.575011787 +0000 UTC m=+252.325115553 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs") pod "network-metrics-daemon-fdfdp" (UID: "a59cd83e-3ead-4201-aad4-1da906578979") : secret "metrics-daemon-secret" not found
May 21 10:32:38.289783 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:38.289751    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5pwz_a6cd8e68-e8b0-4522-b9ae-98c890c40c17/dns-node-resolver/0.log"
May 21 10:32:38.883534 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:38.883504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7fgn_f29ca414-c08c-4f25-b9c4-934f032b34b0/node-ca/0.log"
May 21 10:32:46.126734 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:32:46.126686    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7vvc9" podUID="060f8229-535f-4818-bde5-2b21e1cb5536"
May 21 10:32:46.141041 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:32:46.140999    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vtq29" podUID="80c57ce5-4aa0-42a2-bd3e-9e299bda1f39"
May 21 10:32:46.351391 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:46.351360    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:32:46.351566 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:46.351360    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvc9"
May 21 10:32:46.827429 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:32:46.827383    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fdfdp" podUID="a59cd83e-3ead-4201-aad4-1da906578979"
May 21 10:32:51.098915 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.098871    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:32:51.099439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.098924    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:32:51.101299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.101274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/060f8229-535f-4818-bde5-2b21e1cb5536-metrics-tls\") pod \"dns-default-7vvc9\" (UID: \"060f8229-535f-4818-bde5-2b21e1cb5536\") " pod="openshift-dns/dns-default-7vvc9"
May 21 10:32:51.101444 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.101422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80c57ce5-4aa0-42a2-bd3e-9e299bda1f39-cert\") pod \"ingress-canary-vtq29\" (UID: \"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39\") " pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:32:51.159146 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.159109    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\""
May 21 10:32:51.160241 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.160224    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\""
May 21 10:32:51.162541 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.162522    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtq29"
May 21 10:32:51.162587 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.162555    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvc9"
May 21 10:32:51.325528 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.325494    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vvc9"]
May 21 10:32:51.328617 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:32:51.328578    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060f8229_535f_4818_bde5_2b21e1cb5536.slice/crio-9836ab842e5e7031a9708fc8a6a6c4620c7ae32785bed7c060abcd373dffb86c WatchSource:0}: Error finding container 9836ab842e5e7031a9708fc8a6a6c4620c7ae32785bed7c060abcd373dffb86c: Status 404 returned error can't find the container with id 9836ab842e5e7031a9708fc8a6a6c4620c7ae32785bed7c060abcd373dffb86c
May 21 10:32:51.338500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.338473    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtq29"]
May 21 10:32:51.342306 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:32:51.342271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c57ce5_4aa0_42a2_bd3e_9e299bda1f39.slice/crio-ada1a4acc6b728e0d1e507c7a9e50ddc10c5948c34557d7b661a73be5134d34e WatchSource:0}: Error finding container ada1a4acc6b728e0d1e507c7a9e50ddc10c5948c34557d7b661a73be5134d34e: Status 404 returned error can't find the container with id ada1a4acc6b728e0d1e507c7a9e50ddc10c5948c34557d7b661a73be5134d34e
May 21 10:32:51.364414 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.364321    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvc9" event={"ID":"060f8229-535f-4818-bde5-2b21e1cb5536","Type":"ContainerStarted","Data":"9836ab842e5e7031a9708fc8a6a6c4620c7ae32785bed7c060abcd373dffb86c"}
May 21 10:32:51.365193 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:51.365168    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtq29" event={"ID":"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39","Type":"ContainerStarted","Data":"ada1a4acc6b728e0d1e507c7a9e50ddc10c5948c34557d7b661a73be5134d34e"}
May 21 10:32:53.370759 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.370718    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtq29" event={"ID":"80c57ce5-4aa0-42a2-bd3e-9e299bda1f39","Type":"ContainerStarted","Data":"6153df6d28b1088dd84166d5a04b85528d2eab6b5b26ca5f4c5694a31865147f"}
May 21 10:32:53.372183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.372152    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvc9" event={"ID":"060f8229-535f-4818-bde5-2b21e1cb5536","Type":"ContainerStarted","Data":"05bacc9e63f48b6e704ce27c9f82905760ec3e7d87012ea06e3684922d67fb1d"}
May 21 10:32:53.372183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.372182    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvc9" event={"ID":"060f8229-535f-4818-bde5-2b21e1cb5536","Type":"ContainerStarted","Data":"ef5b32bfb83696e8c750df1727d8335b57e8ebd156e36b4082eb0ecc0274f566"}
May 21 10:32:53.372327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.372317    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vvc9"
May 21 10:32:53.414171 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.414114    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vtq29" podStartSLOduration=128.662486455 podStartE2EDuration="2m10.414099006s" podCreationTimestamp="2026-05-21 10:30:43 +0000 UTC" firstStartedPulling="2026-05-21 10:32:51.344114911 +0000 UTC m=+162.094218677" lastFinishedPulling="2026-05-21 10:32:53.095727452 +0000 UTC m=+163.845831228" observedRunningTime="2026-05-21 10:32:53.413451344 +0000 UTC m=+164.163555133" watchObservedRunningTime="2026-05-21 10:32:53.414099006 +0000 UTC m=+164.164202794"
May 21 10:32:53.451113 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:53.451059    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7vvc9" podStartSLOduration=128.688811771 podStartE2EDuration="2m10.451044158s" podCreationTimestamp="2026-05-21 10:30:43 +0000 UTC" firstStartedPulling="2026-05-21 10:32:51.330362694 +0000 UTC m=+162.080466463" lastFinishedPulling="2026-05-21 10:32:53.092595069 +0000 UTC m=+163.842698850" observedRunningTime="2026-05-21 10:32:53.450813143 +0000 UTC m=+164.200916932" watchObservedRunningTime="2026-05-21 10:32:53.451044158 +0000 UTC m=+164.201147946"
May 21 10:32:54.100245 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:54.100167    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" podUID="eabb2442-83f0-4abc-b810-a4bfb6b6f577" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.7:8000/readyz\": dial tcp 10.134.0.7:8000: connect: connection refused"
May 21 10:32:54.376081 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:54.376050    2563 generic.go:358] "Generic (PLEG): container finished" podID="eabb2442-83f0-4abc-b810-a4bfb6b6f577" containerID="01a8a6d14b2560fc32c3ea872bca940eff4ff622a48ed132b1ba9b3abc5b7bc4" exitCode=1
May 21 10:32:54.376563 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:54.376124    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" event={"ID":"eabb2442-83f0-4abc-b810-a4bfb6b6f577","Type":"ContainerDied","Data":"01a8a6d14b2560fc32c3ea872bca940eff4ff622a48ed132b1ba9b3abc5b7bc4"}
May 21 10:32:54.376638 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:54.376608    2563 scope.go:117] "RemoveContainer" containerID="01a8a6d14b2560fc32c3ea872bca940eff4ff622a48ed132b1ba9b3abc5b7bc4"
May 21 10:32:55.380342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:55.380301    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j" event={"ID":"eabb2442-83f0-4abc-b810-a4bfb6b6f577","Type":"ContainerStarted","Data":"f63e956b03d54d31b8fbd99effaaf3094d710ddcada45bb85b45dc0a2e697f5c"}
May 21 10:32:55.380773 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:55.380586    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:32:55.381213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:55.381176    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bd7955d69-2k47j"
May 21 10:32:59.817538 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:32:59.817511    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:33:00.113060 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.112970    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qhvpb"]
May 21 10:33:00.116215 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.116175    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.121402 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.121379    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 10:33:00.122546 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.122520    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 10:33:00.132546 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.132524    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 10:33:00.132674 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.132566    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w9dw4\""
May 21 10:33:00.132674 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.132574    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 10:33:00.149594 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.149554    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhvpb"]
May 21 10:33:00.164813 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.164778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f38c0a0b-6947-4244-930f-1068ec96cb2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.164813 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.164818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f38c0a0b-6947-4244-930f-1068ec96cb2a-crio-socket\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.165031 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.164849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.165031 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.164870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92lm\" (UniqueName: \"kubernetes.io/projected/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-api-access-f92lm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.165031 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.164900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38c0a0b-6947-4244-930f-1068ec96cb2a-data-volume\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.216617 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.216582    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bc75b9cd-ggpnv"]
May 21 10:33:00.219413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.219388    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.223154 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.223107    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 10:33:00.223347 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.223334    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9spk4\""
May 21 10:33:00.223588 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.223570    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 10:33:00.223658 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.223575    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 10:33:00.227867 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.227845    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 10:33:00.249262 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.249231    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bc75b9cd-ggpnv"]
May 21 10:33:00.265538 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2400029-90ec-4332-b87b-2919d947d3f1-ca-trust-extracted\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265538 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-trusted-ca\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265571    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38c0a0b-6947-4244-930f-1068ec96cb2a-data-volume\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-registry-certificates\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kbc\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-kube-api-access-k6kbc\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265700    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f38c0a0b-6947-4244-930f-1068ec96cb2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f38c0a0b-6947-4244-930f-1068ec96cb2a-crio-socket\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-installation-pull-secrets\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-bound-sa-token\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f38c0a0b-6947-4244-930f-1068ec96cb2a-crio-socket\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265804    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265828    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f92lm\" (UniqueName: \"kubernetes.io/projected/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-api-access-f92lm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.265877 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-image-registry-private-configuration\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.266183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-registry-tls\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.266183 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.265963    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38c0a0b-6947-4244-930f-1068ec96cb2a-data-volume\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.266346 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.266328    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.268087 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.268068    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f38c0a0b-6947-4244-930f-1068ec96cb2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.298370 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.298331    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92lm\" (UniqueName: \"kubernetes.io/projected/f38c0a0b-6947-4244-930f-1068ec96cb2a-kube-api-access-f92lm\") pod \"insights-runtime-extractor-qhvpb\" (UID: \"f38c0a0b-6947-4244-930f-1068ec96cb2a\") " pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.366713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366616    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-installation-pull-secrets\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.366713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366656    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-bound-sa-token\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.366713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366682    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-image-registry-private-configuration\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.366713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366698    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-registry-tls\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.366713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366715    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2400029-90ec-4332-b87b-2919d947d3f1-ca-trust-extracted\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366732    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-trusted-ca\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366760    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-registry-certificates\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.366790    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kbc\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-kube-api-access-k6kbc\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367292 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.367263    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2400029-90ec-4332-b87b-2919d947d3f1-ca-trust-extracted\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367733 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.367714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-registry-certificates\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.367873 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.367856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2400029-90ec-4332-b87b-2919d947d3f1-trusted-ca\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.369263 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.369245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-registry-tls\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.369573 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.369558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-installation-pull-secrets\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.369770 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.369749    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2400029-90ec-4332-b87b-2919d947d3f1-image-registry-private-configuration\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.386565 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.386531    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-bound-sa-token\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.391041 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.391015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kbc\" (UniqueName: \"kubernetes.io/projected/f2400029-90ec-4332-b87b-2919d947d3f1-kube-api-access-k6kbc\") pod \"image-registry-bc75b9cd-ggpnv\" (UID: \"f2400029-90ec-4332-b87b-2919d947d3f1\") " pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.425725 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.425685    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhvpb"
May 21 10:33:00.529645 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.529613    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:00.589700 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.588623    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhvpb"]
May 21 10:33:00.593383 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:33:00.593352    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38c0a0b_6947_4244_930f_1068ec96cb2a.slice/crio-6ae4e781fa2a376d49cd94a5d946556d2101d52d39376c7e4d9b2b0b803a3e82 WatchSource:0}: Error finding container 6ae4e781fa2a376d49cd94a5d946556d2101d52d39376c7e4d9b2b0b803a3e82: Status 404 returned error can't find the container with id 6ae4e781fa2a376d49cd94a5d946556d2101d52d39376c7e4d9b2b0b803a3e82
May 21 10:33:00.682856 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:00.682792    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bc75b9cd-ggpnv"]
May 21 10:33:00.686533 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:33:00.686507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2400029_90ec_4332_b87b_2919d947d3f1.slice/crio-54640815128eac87962cfd096dd4dec9cf3d315a7507a6f4d3a63dae93cd3f1a WatchSource:0}: Error finding container 54640815128eac87962cfd096dd4dec9cf3d315a7507a6f4d3a63dae93cd3f1a: Status 404 returned error can't find the container with id 54640815128eac87962cfd096dd4dec9cf3d315a7507a6f4d3a63dae93cd3f1a
May 21 10:33:01.396820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:01.396782    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv" event={"ID":"f2400029-90ec-4332-b87b-2919d947d3f1","Type":"ContainerStarted","Data":"a277f6e0dcc0376083391cb4c258e10998bb1121a816e3c177192d5049826231"}
May 21 10:33:01.396820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:01.396825    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv" event={"ID":"f2400029-90ec-4332-b87b-2919d947d3f1","Type":"ContainerStarted","Data":"54640815128eac87962cfd096dd4dec9cf3d315a7507a6f4d3a63dae93cd3f1a"}
May 21 10:33:01.397333 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:01.396953    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:01.398031 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:01.398010    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhvpb" event={"ID":"f38c0a0b-6947-4244-930f-1068ec96cb2a","Type":"ContainerStarted","Data":"55da131c5c34156d01bf98350254d6a81774a82b9caae2b1dc781c7cb1304719"}
May 21 10:33:01.398092 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:01.398037    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhvpb" event={"ID":"f38c0a0b-6947-4244-930f-1068ec96cb2a","Type":"ContainerStarted","Data":"6ae4e781fa2a376d49cd94a5d946556d2101d52d39376c7e4d9b2b0b803a3e82"}
May 21 10:33:02.402769 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:02.402721    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhvpb" event={"ID":"f38c0a0b-6947-4244-930f-1068ec96cb2a","Type":"ContainerStarted","Data":"0981901b84ff030d48b3fa42c76f33bbbf938e2572bd8860978fab5ea14a0d10"}
May 21 10:33:03.378358 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:03.378323    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vvc9"
May 21 10:33:03.407346 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:03.407275    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv" podStartSLOduration=3.407255715 podStartE2EDuration="3.407255715s" podCreationTimestamp="2026-05-21 10:33:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:33:01.468251607 +0000 UTC m=+172.218355395" watchObservedRunningTime="2026-05-21 10:33:03.407255715 +0000 UTC m=+174.157359517"
May 21 10:33:03.407761 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:03.407485    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhvpb" event={"ID":"f38c0a0b-6947-4244-930f-1068ec96cb2a","Type":"ContainerStarted","Data":"b609a0e7c0aec62e0c15ead2f0026a1f210730e0856b4100b1a693a3862e6a31"}
May 21 10:33:03.443510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:03.443445    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qhvpb" podStartSLOduration=1.096929208 podStartE2EDuration="3.443429397s" podCreationTimestamp="2026-05-21 10:33:00 +0000 UTC" firstStartedPulling="2026-05-21 10:33:00.672146646 +0000 UTC m=+171.422250412" lastFinishedPulling="2026-05-21 10:33:03.018646832 +0000 UTC m=+173.768750601" observedRunningTime="2026-05-21 10:33:03.442265685 +0000 UTC m=+174.192369474" watchObservedRunningTime="2026-05-21 10:33:03.443429397 +0000 UTC m=+174.193533185"
May 21 10:33:21.947014 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.946973    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6bpk9"]
May 21 10:33:21.949995 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.949977    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:21.951763 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.951736    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"]
May 21 10:33:21.954127 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.954108    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8f84\""
May 21 10:33:21.954287 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.954271    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 10:33:21.954636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.954622    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:21.954710 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.954660    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 10:33:21.955449 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.955433    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 10:33:21.955449 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.955441    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 10:33:21.955646 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.955438    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 10:33:21.958194 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.958177    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 10:33:21.959099 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.959082    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 10:33:21.959290 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.959274    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 10:33:21.959381 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.959339    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b7q5k\""
May 21 10:33:21.959657 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.959642    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 10:33:21.978039 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:21.978009    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"]
May 21 10:33:22.032816 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-textfile\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.032816 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvc5c\" (UniqueName: \"kubernetes.io/projected/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-api-access-fvc5c\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-tls\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.032995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-metrics-client-ca\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033085 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-sys\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-wtmp\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-root\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033380 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.033622 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.033388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdh6g\" (UniqueName: \"kubernetes.io/projected/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-kube-api-access-xdh6g\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.133972 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.133932    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdh6g\" (UniqueName: \"kubernetes.io/projected/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-kube-api-access-xdh6g\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.133972 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.133973    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-textfile\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.133993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvc5c\" (UniqueName: \"kubernetes.io/projected/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-api-access-fvc5c\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134014    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-tls\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134040    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134067    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134090    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134126    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-metrics-client-ca\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134363    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-textfile\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134413    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134445    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134471    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-sys\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134490    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134494    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-wtmp\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134538    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134552    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-sys\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134578    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-root\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134604    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134664    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-wtmp\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.134742 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.134722    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-root\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.135147 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.135098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.135237 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.135139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.135291 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.135274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.135626 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.135601    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-metrics-client-ca\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.136769 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.136748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.136864 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.136847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-node-exporter-tls\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.137008 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.136988    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.137063 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.137049    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.152793 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.152762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdh6g\" (UniqueName: \"kubernetes.io/projected/450c51c6-bcf2-4a26-9c2a-d7e6c636e578-kube-api-access-xdh6g\") pod \"node-exporter-6bpk9\" (UID: \"450c51c6-bcf2-4a26-9c2a-d7e6c636e578\") " pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.153377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.153346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvc5c\" (UniqueName: \"kubernetes.io/projected/29820b0e-46d2-4b9d-9b71-e4f0107c2bae-kube-api-access-fvc5c\") pod \"kube-state-metrics-54fd6bc5c4-rltnm\" (UID: \"29820b0e-46d2-4b9d-9b71-e4f0107c2bae\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.261097 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.261000    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bpk9"
May 21 10:33:22.265437 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.265409    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"
May 21 10:33:22.271987 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:33:22.271939    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450c51c6_bcf2_4a26_9c2a_d7e6c636e578.slice/crio-7b1a6f7eac64642467ac5b7a7da13b425df97865cd99190d8aa920716f18e271 WatchSource:0}: Error finding container 7b1a6f7eac64642467ac5b7a7da13b425df97865cd99190d8aa920716f18e271: Status 404 returned error can't find the container with id 7b1a6f7eac64642467ac5b7a7da13b425df97865cd99190d8aa920716f18e271
May 21 10:33:22.401873 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.401685    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm"]
May 21 10:33:22.404463 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:33:22.404426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29820b0e_46d2_4b9d_9b71_e4f0107c2bae.slice/crio-07f9ab8161e3c604e54c6d5034a84da3074d198f310e4c13176711fc49fede37 WatchSource:0}: Error finding container 07f9ab8161e3c604e54c6d5034a84da3074d198f310e4c13176711fc49fede37: Status 404 returned error can't find the container with id 07f9ab8161e3c604e54c6d5034a84da3074d198f310e4c13176711fc49fede37
May 21 10:33:22.407154 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.407135    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bc75b9cd-ggpnv"
May 21 10:33:22.458446 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.458406    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bpk9" event={"ID":"450c51c6-bcf2-4a26-9c2a-d7e6c636e578","Type":"ContainerStarted","Data":"7b1a6f7eac64642467ac5b7a7da13b425df97865cd99190d8aa920716f18e271"}
May 21 10:33:22.460268 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:22.460231    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm" event={"ID":"29820b0e-46d2-4b9d-9b71-e4f0107c2bae","Type":"ContainerStarted","Data":"07f9ab8161e3c604e54c6d5034a84da3074d198f310e4c13176711fc49fede37"}
May 21 10:33:23.465333 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:23.464927    2563 generic.go:358] "Generic (PLEG): container finished" podID="450c51c6-bcf2-4a26-9c2a-d7e6c636e578" containerID="0c1892f690de53690f33c69f8acd3cdd3f345d390e8fcf4aff1ca0ce01c1205d" exitCode=0
May 21 10:33:23.465333 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:23.464990    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bpk9" event={"ID":"450c51c6-bcf2-4a26-9c2a-d7e6c636e578","Type":"ContainerDied","Data":"0c1892f690de53690f33c69f8acd3cdd3f345d390e8fcf4aff1ca0ce01c1205d"}
May 21 10:33:24.470797 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.470753    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm" event={"ID":"29820b0e-46d2-4b9d-9b71-e4f0107c2bae","Type":"ContainerStarted","Data":"9214e6c13adafbe896e397c6e368a4105be3a87a935f81162b86f9781ad4726e"}
May 21 10:33:24.470797 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.470799    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm" event={"ID":"29820b0e-46d2-4b9d-9b71-e4f0107c2bae","Type":"ContainerStarted","Data":"740a34d10f5accc44976b3d47cb2908c30e91873a21f265adef82bae7d658f88"}
May 21 10:33:24.470797 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.470810    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm" event={"ID":"29820b0e-46d2-4b9d-9b71-e4f0107c2bae","Type":"ContainerStarted","Data":"fab45a9b69a2f6a0a96bf0640efa4b5360242a7f257c6bc5797338f65cded129"}
May 21 10:33:24.472660 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.472637    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bpk9" event={"ID":"450c51c6-bcf2-4a26-9c2a-d7e6c636e578","Type":"ContainerStarted","Data":"f35ee09f0cdcd00b1c1cb7e0aab2bb0a0c3019b44db445af3b30c08bdcfba5da"}
May 21 10:33:24.472771 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.472667    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bpk9" event={"ID":"450c51c6-bcf2-4a26-9c2a-d7e6c636e578","Type":"ContainerStarted","Data":"03675f1a9fbb61cf02a85f3eb68fbdecb03954e78518da5335f48ffb9c30a59c"}
May 21 10:33:24.495820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.495764    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rltnm" podStartSLOduration=1.864417248 podStartE2EDuration="3.495747546s" podCreationTimestamp="2026-05-21 10:33:21 +0000 UTC" firstStartedPulling="2026-05-21 10:33:22.406569519 +0000 UTC m=+193.156673285" lastFinishedPulling="2026-05-21 10:33:24.037899817 +0000 UTC m=+194.788003583" observedRunningTime="2026-05-21 10:33:24.493609295 +0000 UTC m=+195.243713083" watchObservedRunningTime="2026-05-21 10:33:24.495747546 +0000 UTC m=+195.245851333"
May 21 10:33:24.515240 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:24.515162    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6bpk9" podStartSLOduration=2.602656342 podStartE2EDuration="3.515145735s" podCreationTimestamp="2026-05-21 10:33:21 +0000 UTC" firstStartedPulling="2026-05-21 10:33:22.274542311 +0000 UTC m=+193.024646084" lastFinishedPulling="2026-05-21 10:33:23.187031708 +0000 UTC m=+193.937135477" observedRunningTime="2026-05-21 10:33:24.513957486 +0000 UTC m=+195.264061276" watchObservedRunningTime="2026-05-21 10:33:24.515145735 +0000 UTC m=+195.265249519"
May 21 10:33:26.365637 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.365601    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54f4c77d8b-99rxh"]
May 21 10:33:26.375651 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.375621    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.379826 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379747    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5thcl\""
May 21 10:33:26.379826 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379784    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e3jpvjk9ia5vs\""
May 21 10:33:26.379826 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379796    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 10:33:26.379826 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379807    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 10:33:26.380273 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379836    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 10:33:26.380273 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.379795    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 10:33:26.383179 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.382943    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54f4c77d8b-99rxh"]
May 21 10:33:26.472919 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.472880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7jj\" (UniqueName: \"kubernetes.io/projected/3e25ab21-cdac-4255-b871-f745ba5fa93f-kube-api-access-fv7jj\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.472919 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.472928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-metrics-server-audit-profiles\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.473148 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.472952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e25ab21-cdac-4255-b871-f745ba5fa93f-audit-log\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.473148 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.473031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-tls\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.473148 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.473074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-client-certs\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.473270 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.473152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.473270 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.473181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-client-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574081 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574046    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-tls\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574081 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574088    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-client-certs\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574130    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574155    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-client-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574175    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7jj\" (UniqueName: \"kubernetes.io/projected/3e25ab21-cdac-4255-b871-f745ba5fa93f-kube-api-access-fv7jj\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574194    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-metrics-server-audit-profiles\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574377 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e25ab21-cdac-4255-b871-f745ba5fa93f-audit-log\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.574697 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574676    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e25ab21-cdac-4255-b871-f745ba5fa93f-audit-log\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.575013 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.574985    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.575362 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.575336    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e25ab21-cdac-4255-b871-f745ba5fa93f-metrics-server-audit-profiles\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.576717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.576698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-client-certs\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.576795 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.576744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-client-ca-bundle\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.576891 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.576872    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e25ab21-cdac-4255-b871-f745ba5fa93f-secret-metrics-server-tls\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.583177 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.583144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7jj\" (UniqueName: \"kubernetes.io/projected/3e25ab21-cdac-4255-b871-f745ba5fa93f-kube-api-access-fv7jj\") pod \"metrics-server-54f4c77d8b-99rxh\" (UID: \"3e25ab21-cdac-4255-b871-f745ba5fa93f\") " pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.685762 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.685721    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:26.835743 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:26.835708    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54f4c77d8b-99rxh"]
May 21 10:33:26.839731 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:33:26.839701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e25ab21_cdac_4255_b871_f745ba5fa93f.slice/crio-9bc1bff09a67a0d923e5c104e0a399ff7dfa1c05e97d1dd3f67c12680fe95ad0 WatchSource:0}: Error finding container 9bc1bff09a67a0d923e5c104e0a399ff7dfa1c05e97d1dd3f67c12680fe95ad0: Status 404 returned error can't find the container with id 9bc1bff09a67a0d923e5c104e0a399ff7dfa1c05e97d1dd3f67c12680fe95ad0
May 21 10:33:27.483259 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:27.483221    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh" event={"ID":"3e25ab21-cdac-4255-b871-f745ba5fa93f","Type":"ContainerStarted","Data":"9bc1bff09a67a0d923e5c104e0a399ff7dfa1c05e97d1dd3f67c12680fe95ad0"}
May 21 10:33:28.668281 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:28.668247    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" podUID="033400de-4150-4e17-87b7-13c660a3fafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 10:33:29.490960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:29.490913    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh" event={"ID":"3e25ab21-cdac-4255-b871-f745ba5fa93f","Type":"ContainerStarted","Data":"aedb20b1cc6718590eeef9ad7122acd9c024d8417fb18065b0d9e15109ff9cb3"}
May 21 10:33:29.511256 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:29.511185    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh" podStartSLOduration=1.71522356 podStartE2EDuration="3.511171587s" podCreationTimestamp="2026-05-21 10:33:26 +0000 UTC" firstStartedPulling="2026-05-21 10:33:26.841640359 +0000 UTC m=+197.591744124" lastFinishedPulling="2026-05-21 10:33:28.637588386 +0000 UTC m=+199.387692151" observedRunningTime="2026-05-21 10:33:29.510683293 +0000 UTC m=+200.260787082" watchObservedRunningTime="2026-05-21 10:33:29.511171587 +0000 UTC m=+200.261275374"
May 21 10:33:38.668763 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:38.668724    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" podUID="033400de-4150-4e17-87b7-13c660a3fafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 10:33:46.686337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:46.686279    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:46.686337 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:46.686340    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:33:48.668277 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:48.668232    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" podUID="033400de-4150-4e17-87b7-13c660a3fafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 10:33:48.668634 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:48.668322    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6"
May 21 10:33:48.668851 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:48.668820    2563 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a235dc117ba84f4d8cd9f348537d0c7a087270b0ed2b9953c5a0488abe1820a6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 10:33:48.668890 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:48.668880    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" podUID="033400de-4150-4e17-87b7-13c660a3fafc" containerName="service-proxy" containerID="cri-o://a235dc117ba84f4d8cd9f348537d0c7a087270b0ed2b9953c5a0488abe1820a6" gracePeriod=30
May 21 10:33:49.545797 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:49.545763    2563 generic.go:358] "Generic (PLEG): container finished" podID="033400de-4150-4e17-87b7-13c660a3fafc" containerID="a235dc117ba84f4d8cd9f348537d0c7a087270b0ed2b9953c5a0488abe1820a6" exitCode=2
May 21 10:33:49.546018 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:49.545833    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerDied","Data":"a235dc117ba84f4d8cd9f348537d0c7a087270b0ed2b9953c5a0488abe1820a6"}
May 21 10:33:49.546018 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:33:49.545876    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9b5cc5598-bf5v6" event={"ID":"033400de-4150-4e17-87b7-13c660a3fafc","Type":"ContainerStarted","Data":"3dc60bbb8cf329a1b9ae6bb974c4a9993b5eb45789d6c566e59bc0a125b500ce"}
May 21 10:34:06.691805 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:06.691774    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:34:06.695661 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:06.695633    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54f4c77d8b-99rxh"
May 21 10:34:21.615471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:21.615418    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:34:21.617763 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:21.617738    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a59cd83e-3ead-4201-aad4-1da906578979-metrics-certs\") pod \"network-metrics-daemon-fdfdp\" (UID: \"a59cd83e-3ead-4201-aad4-1da906578979\") " pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:34:21.721674 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:21.721643    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\""
May 21 10:34:21.729043 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:21.729004    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfdp"
May 21 10:34:21.864595 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:21.864561    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdfdp"]
May 21 10:34:21.869885 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:34:21.867926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59cd83e_3ead_4201_aad4_1da906578979.slice/crio-523d893a3ec7afda827aa348d9a97123ccf47e665bf52e3eac665531b8da49c0 WatchSource:0}: Error finding container 523d893a3ec7afda827aa348d9a97123ccf47e665bf52e3eac665531b8da49c0: Status 404 returned error can't find the container with id 523d893a3ec7afda827aa348d9a97123ccf47e665bf52e3eac665531b8da49c0
May 21 10:34:22.631170 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:22.631121    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfdp" event={"ID":"a59cd83e-3ead-4201-aad4-1da906578979","Type":"ContainerStarted","Data":"523d893a3ec7afda827aa348d9a97123ccf47e665bf52e3eac665531b8da49c0"}
May 21 10:34:23.634922 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:23.634883    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfdp" event={"ID":"a59cd83e-3ead-4201-aad4-1da906578979","Type":"ContainerStarted","Data":"1feb81c829184aa99df4e7e6945b60d32ccefbf2934038c29da909ab458605c5"}
May 21 10:34:23.634922 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:23.634926    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfdp" event={"ID":"a59cd83e-3ead-4201-aad4-1da906578979","Type":"ContainerStarted","Data":"ed26431987c23b0dea6c63420aed4b664416f54a69d71b7c000861c8acedbc9f"}
May 21 10:34:23.653048 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:34:23.652991    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdfdp" podStartSLOduration=253.775052209 podStartE2EDuration="4m14.652972867s" podCreationTimestamp="2026-05-21 10:30:09 +0000 UTC" firstStartedPulling="2026-05-21 10:34:21.87117638 +0000 UTC m=+252.621280150" lastFinishedPulling="2026-05-21 10:34:22.749097039 +0000 UTC m=+253.499200808" observedRunningTime="2026-05-21 10:34:23.651996372 +0000 UTC m=+254.402100150" watchObservedRunningTime="2026-05-21 10:34:23.652972867 +0000 UTC m=+254.403076691"
May 21 10:35:09.717601 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:09.717565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:35:09.719906 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:09.719881    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:35:09.724731 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:09.724710    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 21 10:35:55.412002 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.411919    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vzck8"]
May 21 10:35:55.414911 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.414891    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.418318 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.418296    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 10:35:55.424433 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.424407    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzck8"]
May 21 10:35:55.526285 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.526249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-dbus\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.526285 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.526294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0449162f-5315-40ba-b822-5506e57d219d-original-pull-secret\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.526510 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.526329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-kubelet-config\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.627500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.627449    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0449162f-5315-40ba-b822-5506e57d219d-original-pull-secret\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.627500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.627513    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-kubelet-config\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.627717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.627569    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-dbus\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.627717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.627650    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-kubelet-config\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.627717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.627698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0449162f-5315-40ba-b822-5506e57d219d-dbus\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.629792 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.629772    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0449162f-5315-40ba-b822-5506e57d219d-original-pull-secret\") pod \"global-pull-secret-syncer-vzck8\" (UID: \"0449162f-5315-40ba-b822-5506e57d219d\") " pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.725357 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.725263    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzck8"
May 21 10:35:55.851571 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.851534    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzck8"]
May 21 10:35:55.854592 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:35:55.854557    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0449162f_5315_40ba_b822_5506e57d219d.slice/crio-61e4b3c80f6df28f05995b366fdcf18ad60c38f2b5b9fd0a8fae310e26fe7a44 WatchSource:0}: Error finding container 61e4b3c80f6df28f05995b366fdcf18ad60c38f2b5b9fd0a8fae310e26fe7a44: Status 404 returned error can't find the container with id 61e4b3c80f6df28f05995b366fdcf18ad60c38f2b5b9fd0a8fae310e26fe7a44
May 21 10:35:55.856112 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.856097    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 10:35:55.878146 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:35:55.878118    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzck8" event={"ID":"0449162f-5315-40ba-b822-5506e57d219d","Type":"ContainerStarted","Data":"61e4b3c80f6df28f05995b366fdcf18ad60c38f2b5b9fd0a8fae310e26fe7a44"}
May 21 10:36:00.892960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:00.892919    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzck8" event={"ID":"0449162f-5315-40ba-b822-5506e57d219d","Type":"ContainerStarted","Data":"ed4cdf1d8688117afbb8a18de13e3f674b2015d2894c094f89b1c63450caa6ed"}
May 21 10:36:00.911709 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:00.911635    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vzck8" podStartSLOduration=1.376302523 podStartE2EDuration="5.911619172s" podCreationTimestamp="2026-05-21 10:35:55 +0000 UTC" firstStartedPulling="2026-05-21 10:35:55.856246905 +0000 UTC m=+346.606350671" lastFinishedPulling="2026-05-21 10:36:00.391563555 +0000 UTC m=+351.141667320" observedRunningTime="2026-05-21 10:36:00.910583534 +0000 UTC m=+351.660687322" watchObservedRunningTime="2026-05-21 10:36:00.911619172 +0000 UTC m=+351.661722960"
May 21 10:36:39.552490 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.552454    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"]
May 21 10:36:39.555752 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.555734    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.560414 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.560389    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 10:36:39.561950 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.561680    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 10:36:39.561950 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.561742    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\""
May 21 10:36:39.570555 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.570527    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"]
May 21 10:36:39.653610 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.653563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8ffd\" (UniqueName: \"kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.653794 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.653625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.653794 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.653678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.755008 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.754966    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.755008 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.755008    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.755231 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.755057    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8ffd\" (UniqueName: \"kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.755537 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.755502    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.755575 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.755509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.795674 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.795645    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8ffd\" (UniqueName: \"kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:39.864428 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:39.864342    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:40.007624 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:40.007537    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"]
May 21 10:36:40.010238 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:36:40.010193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82af2073_1c3e_4285_a1c4_f6c9bbd33c46.slice/crio-9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209 WatchSource:0}: Error finding container 9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209: Status 404 returned error can't find the container with id 9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209
May 21 10:36:41.000986 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:41.000939    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb" event={"ID":"82af2073-1c3e-4285-a1c4-f6c9bbd33c46","Type":"ContainerStarted","Data":"9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209"}
May 21 10:36:46.015478 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:46.015435    2563 generic.go:358] "Generic (PLEG): container finished" podID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerID="1706333c17d8df92518abf1d03185f349ea91c354ff254c25c218230d8bd80cc" exitCode=0
May 21 10:36:46.015478 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:46.015477    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb" event={"ID":"82af2073-1c3e-4285-a1c4-f6c9bbd33c46","Type":"ContainerDied","Data":"1706333c17d8df92518abf1d03185f349ea91c354ff254c25c218230d8bd80cc"}
May 21 10:36:49.026304 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:49.026263    2563 generic.go:358] "Generic (PLEG): container finished" podID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerID="f7416639ebdc3067a8df64dd6bdf2833264621a6586af2c7c994a141451fe2cd" exitCode=0
May 21 10:36:49.026790 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:49.026311    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb" event={"ID":"82af2073-1c3e-4285-a1c4-f6c9bbd33c46","Type":"ContainerDied","Data":"f7416639ebdc3067a8df64dd6bdf2833264621a6586af2c7c994a141451fe2cd"}
May 21 10:36:56.048716 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:56.048680    2563 generic.go:358] "Generic (PLEG): container finished" podID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerID="f765718a88dbcc89a75ad272707866cfc57ce024b634efd78000a12be43efda5" exitCode=0
May 21 10:36:56.049074 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:56.048735    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb" event={"ID":"82af2073-1c3e-4285-a1c4-f6c9bbd33c46","Type":"ContainerDied","Data":"f765718a88dbcc89a75ad272707866cfc57ce024b634efd78000a12be43efda5"}
May 21 10:36:57.166496 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.166474    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:57.205564 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.205538    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle\") pod \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") "
May 21 10:36:57.205723 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.205573    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util\") pod \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") "
May 21 10:36:57.205723 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.205625    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8ffd\" (UniqueName: \"kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd\") pod \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\" (UID: \"82af2073-1c3e-4285-a1c4-f6c9bbd33c46\") "
May 21 10:36:57.205958 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.205935    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle" (OuterVolumeSpecName: "bundle") pod "82af2073-1c3e-4285-a1c4-f6c9bbd33c46" (UID: "82af2073-1c3e-4285-a1c4-f6c9bbd33c46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:36:57.207912 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.207887    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd" (OuterVolumeSpecName: "kube-api-access-p8ffd") pod "82af2073-1c3e-4285-a1c4-f6c9bbd33c46" (UID: "82af2073-1c3e-4285-a1c4-f6c9bbd33c46"). InnerVolumeSpecName "kube-api-access-p8ffd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:36:57.209865 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.209836    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util" (OuterVolumeSpecName: "util") pod "82af2073-1c3e-4285-a1c4-f6c9bbd33c46" (UID: "82af2073-1c3e-4285-a1c4-f6c9bbd33c46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:36:57.306656 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.306566    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-bundle\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:36:57.306656 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.306599    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-util\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:36:57.306656 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:57.306609    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8ffd\" (UniqueName: \"kubernetes.io/projected/82af2073-1c3e-4285-a1c4-f6c9bbd33c46-kube-api-access-p8ffd\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:36:58.055619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:58.055569    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb" event={"ID":"82af2073-1c3e-4285-a1c4-f6c9bbd33c46","Type":"ContainerDied","Data":"9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209"}
May 21 10:36:58.055619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:58.055606    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvlmfb"
May 21 10:36:58.055619 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:36:58.055620    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9733ee99f4f812d3cac6c78702d9bedc4ff661fe3d7fdb8722dfde3243ae9209"
May 21 10:37:20.448869 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.448837    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"]
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449094    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="extract"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449107    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="extract"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449125    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="util"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449131    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="util"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449137    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="pull"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449142    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="pull"
May 21 10:37:20.449342 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.449181    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="82af2073-1c3e-4285-a1c4-f6c9bbd33c46" containerName="extract"
May 21 10:37:20.454883 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.454859    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.457961 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.457935    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 10:37:20.458102 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.457971    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 10:37:20.459181 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.459159    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\""
May 21 10:37:20.469562 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.469535    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"]
May 21 10:37:20.592536 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.592488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx9c4\" (UniqueName: \"kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.592716 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.592544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.592716 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.592622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.693404 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.693366    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.693404 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.693407    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.693647 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.693467    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx9c4\" (UniqueName: \"kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.693810 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.693790    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.693859 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.693840    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.703631 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.703569    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx9c4\" (UniqueName: \"kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.763074 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.763033    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:20.894665 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:20.894629    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"]
May 21 10:37:20.897463 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:20.897424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51352ce_5853_43c2_83b2_824f90e49e6a.slice/crio-a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781 WatchSource:0}: Error finding container a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781: Status 404 returned error can't find the container with id a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781
May 21 10:37:21.117324 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.117293    2563 generic.go:358] "Generic (PLEG): container finished" podID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerID="34d3adf7b9e35e3fbf4e9548b4b33862d9a06b1a7a4fc9d81a9cfb978ed6e645" exitCode=0
May 21 10:37:21.117609 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.117337    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9" event={"ID":"f51352ce-5853-43c2-83b2-824f90e49e6a","Type":"ContainerDied","Data":"34d3adf7b9e35e3fbf4e9548b4b33862d9a06b1a7a4fc9d81a9cfb978ed6e645"}
May 21 10:37:21.117609 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.117368    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9" event={"ID":"f51352ce-5853-43c2-83b2-824f90e49e6a","Type":"ContainerStarted","Data":"a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781"}
May 21 10:37:21.899931 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.899902    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"]
May 21 10:37:21.902979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.902956    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:21.907725 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.907700    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 10:37:21.907968 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.907947    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 10:37:21.908075 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.908015    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7hxq7\""
May 21 10:37:21.908075 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.908052    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 10:37:21.909255 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.909056    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 10:37:21.928865 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:21.928834    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"]
May 21 10:37:22.003641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.003533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmmm\" (UniqueName: \"kubernetes.io/projected/913f93c5-3b44-4c9b-ac87-4504ff007d55-kube-api-access-6mmmm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.003641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.003570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.003820 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.003655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.104359 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.104313    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmmm\" (UniqueName: \"kubernetes.io/projected/913f93c5-3b44-4c9b-ac87-4504ff007d55-kube-api-access-6mmmm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.104359 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.104362    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.104626 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.104404    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.106816 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.106792    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.106915 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.106831    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/913f93c5-3b44-4c9b-ac87-4504ff007d55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.125975 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.125941    2563 generic.go:358] "Generic (PLEG): container finished" podID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerID="63bebf8fb1bd93f985c4260c440149c7e04c8b167d88e4b63fff57607caaeee0" exitCode=0
May 21 10:37:22.126132 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.125991    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9" event={"ID":"f51352ce-5853-43c2-83b2-824f90e49e6a","Type":"ContainerDied","Data":"63bebf8fb1bd93f985c4260c440149c7e04c8b167d88e4b63fff57607caaeee0"}
May 21 10:37:22.128130 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.128106    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmmm\" (UniqueName: \"kubernetes.io/projected/913f93c5-3b44-4c9b-ac87-4504ff007d55-kube-api-access-6mmmm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k\" (UID: \"913f93c5-3b44-4c9b-ac87-4504ff007d55\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.215221 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.215170    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:22.355065 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:22.355033    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"]
May 21 10:37:22.359863 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:22.359835    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913f93c5_3b44_4c9b_ac87_4504ff007d55.slice/crio-0827dee995e8b5d4dca6f6b21331bdf435ba5a7c1ea1af0a2d6b5266856c8c2d WatchSource:0}: Error finding container 0827dee995e8b5d4dca6f6b21331bdf435ba5a7c1ea1af0a2d6b5266856c8c2d: Status 404 returned error can't find the container with id 0827dee995e8b5d4dca6f6b21331bdf435ba5a7c1ea1af0a2d6b5266856c8c2d
May 21 10:37:23.132160 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:23.132067    2563 generic.go:358] "Generic (PLEG): container finished" podID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerID="f1217ce86c19d8732f4ada33b7f5219f228283640145f446fef051db5f3bf134" exitCode=0
May 21 10:37:23.132650 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:23.132467    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9" event={"ID":"f51352ce-5853-43c2-83b2-824f90e49e6a","Type":"ContainerDied","Data":"f1217ce86c19d8732f4ada33b7f5219f228283640145f446fef051db5f3bf134"}
May 21 10:37:23.134083 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:23.134050    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k" event={"ID":"913f93c5-3b44-4c9b-ac87-4504ff007d55","Type":"ContainerStarted","Data":"0827dee995e8b5d4dca6f6b21331bdf435ba5a7c1ea1af0a2d6b5266856c8c2d"}
May 21 10:37:25.222263 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.222234    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:25.329822 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.329785    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle\") pod \"f51352ce-5853-43c2-83b2-824f90e49e6a\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") "
May 21 10:37:25.330002 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.329883    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx9c4\" (UniqueName: \"kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4\") pod \"f51352ce-5853-43c2-83b2-824f90e49e6a\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") "
May 21 10:37:25.330002 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.329906    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util\") pod \"f51352ce-5853-43c2-83b2-824f90e49e6a\" (UID: \"f51352ce-5853-43c2-83b2-824f90e49e6a\") "
May 21 10:37:25.330629 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.330601    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle" (OuterVolumeSpecName: "bundle") pod "f51352ce-5853-43c2-83b2-824f90e49e6a" (UID: "f51352ce-5853-43c2-83b2-824f90e49e6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:37:25.332120 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.332089    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4" (OuterVolumeSpecName: "kube-api-access-wx9c4") pod "f51352ce-5853-43c2-83b2-824f90e49e6a" (UID: "f51352ce-5853-43c2-83b2-824f90e49e6a"). InnerVolumeSpecName "kube-api-access-wx9c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:37:25.335167 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.335143    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util" (OuterVolumeSpecName: "util") pod "f51352ce-5853-43c2-83b2-824f90e49e6a" (UID: "f51352ce-5853-43c2-83b2-824f90e49e6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:37:25.430457 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.430421    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx9c4\" (UniqueName: \"kubernetes.io/projected/f51352ce-5853-43c2-83b2-824f90e49e6a-kube-api-access-wx9c4\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:25.430457 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.430451    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-util\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:25.430457 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:25.430461    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f51352ce-5853-43c2-83b2-824f90e49e6a-bundle\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:26.144602 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.144566    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9" event={"ID":"f51352ce-5853-43c2-83b2-824f90e49e6a","Type":"ContainerDied","Data":"a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781"}
May 21 10:37:26.144602 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.144600    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9td4q9"
May 21 10:37:26.144925 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.144601    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a53194fa7d9450108d1c499efb89bb62ac38eef54175b4b3d79b046db4c00781"
May 21 10:37:26.146059 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.146036    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k" event={"ID":"913f93c5-3b44-4c9b-ac87-4504ff007d55","Type":"ContainerStarted","Data":"83ca167ac4cad69de32269afdda5102ad479d4f51cb86612887faec6113e029f"}
May 21 10:37:26.146192 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.146177    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:26.174039 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:26.173979    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k" podStartSLOduration=2.279858361 podStartE2EDuration="5.173961984s" podCreationTimestamp="2026-05-21 10:37:21 +0000 UTC" firstStartedPulling="2026-05-21 10:37:22.361548927 +0000 UTC m=+433.111652705" lastFinishedPulling="2026-05-21 10:37:25.25565255 +0000 UTC m=+436.005756328" observedRunningTime="2026-05-21 10:37:26.171272069 +0000 UTC m=+436.921375856" watchObservedRunningTime="2026-05-21 10:37:26.173961984 +0000 UTC m=+436.924065775"
May 21 10:37:37.151069 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:37.151032    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k"
May 21 10:37:46.128299 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128261    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"]
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128553    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="util"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128567    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="util"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128575    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="pull"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128582    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="pull"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128604    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="extract"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128610    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="extract"
May 21 10:37:46.128678 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.128649    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f51352ce-5853-43c2-83b2-824f90e49e6a" containerName="extract"
May 21 10:37:46.132736 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.132713    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.135376 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.135351    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 10:37:46.136602 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.136581    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 10:37:46.136755 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.136609    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\""
May 21 10:37:46.138597 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.138576    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"]
May 21 10:37:46.188994 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.188941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.189237 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.189070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sf8d\" (UniqueName: \"kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.189237 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.189124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.289713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.289662    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sf8d\" (UniqueName: \"kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.289713 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.289711    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.289979 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.289757    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.290240 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.290185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.290303 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.290213    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.300829 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.300798    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sf8d\" (UniqueName: \"kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.443343 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.443266    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:46.579474 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.579435    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"]
May 21 10:37:46.582397 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:46.582366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc182614e_39a8_40fc_9211_c3d95df4a5a3.slice/crio-4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca WatchSource:0}: Error finding container 4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca: Status 404 returned error can't find the container with id 4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca
May 21 10:37:46.771887 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.771853    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"]
May 21 10:37:46.774963 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.774944    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.777628 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.777605    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 10:37:46.777975 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.777957    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 10:37:46.778077 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.777956    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 10:37:46.779620 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.779595    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 10:37:46.779758 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.779744    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mgn78\""
May 21 10:37:46.794647 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.794622    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"]
May 21 10:37:46.797409 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.797384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44a871f-231a-49fe-ab83-a49e15b09d51-tmp\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.797499 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.797462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnb8l\" (UniqueName: \"kubernetes.io/projected/d44a871f-231a-49fe-ab83-a49e15b09d51-kube-api-access-pnb8l\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.797570 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.797548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a871f-231a-49fe-ab83-a49e15b09d51-tls-certs\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.898468 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.898422    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a871f-231a-49fe-ab83-a49e15b09d51-tls-certs\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.898673 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.898481    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44a871f-231a-49fe-ab83-a49e15b09d51-tmp\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.898673 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.898536    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnb8l\" (UniqueName: \"kubernetes.io/projected/d44a871f-231a-49fe-ab83-a49e15b09d51-kube-api-access-pnb8l\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.900775 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.900750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d44a871f-231a-49fe-ab83-a49e15b09d51-tmp\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.901036 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.901016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a871f-231a-49fe-ab83-a49e15b09d51-tls-certs\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:46.907605 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:46.907578    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnb8l\" (UniqueName: \"kubernetes.io/projected/d44a871f-231a-49fe-ab83-a49e15b09d51-kube-api-access-pnb8l\") pod \"kube-auth-proxy-798cbbc998-wjqm9\" (UID: \"d44a871f-231a-49fe-ab83-a49e15b09d51\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:47.086218 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.086105    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"
May 21 10:37:47.207548 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.207508    2563 generic.go:358] "Generic (PLEG): container finished" podID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerID="27ffcd53c168e13abe75ecf8a9a856dccd77746b656a65da5fdfd42a8e2a6efc" exitCode=0
May 21 10:37:47.207910 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.207586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4" event={"ID":"c182614e-39a8-40fc-9211-c3d95df4a5a3","Type":"ContainerDied","Data":"27ffcd53c168e13abe75ecf8a9a856dccd77746b656a65da5fdfd42a8e2a6efc"}
May 21 10:37:47.207910 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.207623    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4" event={"ID":"c182614e-39a8-40fc-9211-c3d95df4a5a3","Type":"ContainerStarted","Data":"4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca"}
May 21 10:37:47.247418 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.247385    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7bxhv"]
May 21 10:37:47.251788 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.251772    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.255604 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.255576    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l64bw\""
May 21 10:37:47.256474 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.256461    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 10:37:47.269457 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.269426    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9"]
May 21 10:37:47.272309 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.272283    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7bxhv"]
May 21 10:37:47.273761 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:47.273269    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44a871f_231a_49fe_ab83_a49e15b09d51.slice/crio-fc9567997d7187490aa56388c53660fad8005b6314d2de07d9ec8049bb880d7d WatchSource:0}: Error finding container fc9567997d7187490aa56388c53660fad8005b6314d2de07d9ec8049bb880d7d: Status 404 returned error can't find the container with id fc9567997d7187490aa56388c53660fad8005b6314d2de07d9ec8049bb880d7d
May 21 10:37:47.301467 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.301427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8wkf\" (UniqueName: \"kubernetes.io/projected/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-kube-api-access-c8wkf\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.301658 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.301500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.402807 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.402772    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.402972 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.402851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wkf\" (UniqueName: \"kubernetes.io/projected/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-kube-api-access-c8wkf\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.402972 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:47.402943    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 10:37:47.403081 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:47.403021    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert podName:0bed74ca-e6ae-4493-9b30-d34ee8abfe70 nodeName:}" failed. No retries permitted until 2026-05-21 10:37:47.902999621 +0000 UTC m=+458.653103396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert") pod "odh-model-controller-858dbf95b8-7bxhv" (UID: "0bed74ca-e6ae-4493-9b30-d34ee8abfe70") : secret "odh-model-controller-webhook-cert" not found
May 21 10:37:47.412985 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.412959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8wkf\" (UniqueName: \"kubernetes.io/projected/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-kube-api-access-c8wkf\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.908042 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:47.907967    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:47.908253 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:47.908080    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 10:37:47.908253 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:47.908149    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert podName:0bed74ca-e6ae-4493-9b30-d34ee8abfe70 nodeName:}" failed. No retries permitted until 2026-05-21 10:37:48.908129014 +0000 UTC m=+459.658232779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert") pod "odh-model-controller-858dbf95b8-7bxhv" (UID: "0bed74ca-e6ae-4493-9b30-d34ee8abfe70") : secret "odh-model-controller-webhook-cert" not found
May 21 10:37:48.213633 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:48.213530    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9" event={"ID":"d44a871f-231a-49fe-ab83-a49e15b09d51","Type":"ContainerStarted","Data":"fc9567997d7187490aa56388c53660fad8005b6314d2de07d9ec8049bb880d7d"}
May 21 10:37:48.917763 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:48.917720    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:48.920847 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:48.920791    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bed74ca-e6ae-4493-9b30-d34ee8abfe70-cert\") pod \"odh-model-controller-858dbf95b8-7bxhv\" (UID: \"0bed74ca-e6ae-4493-9b30-d34ee8abfe70\") " pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:49.061860 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:49.061818    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:49.301842 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:49.301785    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7bxhv"]
May 21 10:37:49.305138 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:49.305107    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bed74ca_e6ae_4493_9b30_d34ee8abfe70.slice/crio-287cdec27005f160873f0e93273605d72a38003059697c9d57bc6cc9e8585a42 WatchSource:0}: Error finding container 287cdec27005f160873f0e93273605d72a38003059697c9d57bc6cc9e8585a42: Status 404 returned error can't find the container with id 287cdec27005f160873f0e93273605d72a38003059697c9d57bc6cc9e8585a42
May 21 10:37:50.222075 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:50.221985    2563 generic.go:358] "Generic (PLEG): container finished" podID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerID="7a6b20f5e4f54ab941f717e4d17096eaea7539d4f1a98ff1a27c4f636a8ebf62" exitCode=0
May 21 10:37:50.222271 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:50.222065    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4" event={"ID":"c182614e-39a8-40fc-9211-c3d95df4a5a3","Type":"ContainerDied","Data":"7a6b20f5e4f54ab941f717e4d17096eaea7539d4f1a98ff1a27c4f636a8ebf62"}
May 21 10:37:50.224060 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:50.224026    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" event={"ID":"0bed74ca-e6ae-4493-9b30-d34ee8abfe70","Type":"ContainerStarted","Data":"287cdec27005f160873f0e93273605d72a38003059697c9d57bc6cc9e8585a42"}
May 21 10:37:52.234122 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.234086    2563 generic.go:358] "Generic (PLEG): container finished" podID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerID="f7012a090582d2836ea8b264d27c13095937cfd9d583b52ea239488c4a3b2df3" exitCode=0
May 21 10:37:52.234527 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.234166    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4" event={"ID":"c182614e-39a8-40fc-9211-c3d95df4a5a3","Type":"ContainerDied","Data":"f7012a090582d2836ea8b264d27c13095937cfd9d583b52ea239488c4a3b2df3"}
May 21 10:37:52.235447 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.235420    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9" event={"ID":"d44a871f-231a-49fe-ab83-a49e15b09d51","Type":"ContainerStarted","Data":"13bdd84f42b9ac037ef7556c5733037da036698fcdb5fef7c4f899dc48ad28c5"}
May 21 10:37:52.236636 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.236615    2563 generic.go:358] "Generic (PLEG): container finished" podID="0bed74ca-e6ae-4493-9b30-d34ee8abfe70" containerID="54f4303c92a1c402c239d3057f14972e6d46c67429a9880304592cfe621be873" exitCode=1
May 21 10:37:52.236734 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.236695    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" event={"ID":"0bed74ca-e6ae-4493-9b30-d34ee8abfe70","Type":"ContainerDied","Data":"54f4303c92a1c402c239d3057f14972e6d46c67429a9880304592cfe621be873"}
May 21 10:37:52.236858 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.236846    2563 scope.go:117] "RemoveContainer" containerID="54f4303c92a1c402c239d3057f14972e6d46c67429a9880304592cfe621be873"
May 21 10:37:52.300489 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:52.300440    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-798cbbc998-wjqm9" podStartSLOduration=1.5945955550000002 podStartE2EDuration="6.300424611s" podCreationTimestamp="2026-05-21 10:37:46 +0000 UTC" firstStartedPulling="2026-05-21 10:37:47.275551459 +0000 UTC m=+458.025655225" lastFinishedPulling="2026-05-21 10:37:51.981380496 +0000 UTC m=+462.731484281" observedRunningTime="2026-05-21 10:37:52.29968109 +0000 UTC m=+463.049784879" watchObservedRunningTime="2026-05-21 10:37:52.300424611 +0000 UTC m=+463.050528398"
May 21 10:37:53.241663 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.241623    2563 generic.go:358] "Generic (PLEG): container finished" podID="0bed74ca-e6ae-4493-9b30-d34ee8abfe70" containerID="cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce" exitCode=1
May 21 10:37:53.242126 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.241714    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" event={"ID":"0bed74ca-e6ae-4493-9b30-d34ee8abfe70","Type":"ContainerDied","Data":"cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce"}
May 21 10:37:53.242126 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.241754    2563 scope.go:117] "RemoveContainer" containerID="54f4303c92a1c402c239d3057f14972e6d46c67429a9880304592cfe621be873"
May 21 10:37:53.242126 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.241921    2563 scope.go:117] "RemoveContainer" containerID="cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce"
May 21 10:37:53.242313 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:53.242132    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-7bxhv_opendatahub(0bed74ca-e6ae-4493-9b30-d34ee8abfe70)\"" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" podUID="0bed74ca-e6ae-4493-9b30-d34ee8abfe70"
May 21 10:37:53.370816 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.370791    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:53.454809 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.454768    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sf8d\" (UniqueName: \"kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d\") pod \"c182614e-39a8-40fc-9211-c3d95df4a5a3\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") "
May 21 10:37:53.454809 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.454812    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util\") pod \"c182614e-39a8-40fc-9211-c3d95df4a5a3\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") "
May 21 10:37:53.455026 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.454873    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle\") pod \"c182614e-39a8-40fc-9211-c3d95df4a5a3\" (UID: \"c182614e-39a8-40fc-9211-c3d95df4a5a3\") "
May 21 10:37:53.455768 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.455738    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle" (OuterVolumeSpecName: "bundle") pod "c182614e-39a8-40fc-9211-c3d95df4a5a3" (UID: "c182614e-39a8-40fc-9211-c3d95df4a5a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:37:53.456888 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.456863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d" (OuterVolumeSpecName: "kube-api-access-7sf8d") pod "c182614e-39a8-40fc-9211-c3d95df4a5a3" (UID: "c182614e-39a8-40fc-9211-c3d95df4a5a3"). InnerVolumeSpecName "kube-api-access-7sf8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:37:53.459117 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.459080    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util" (OuterVolumeSpecName: "util") pod "c182614e-39a8-40fc-9211-c3d95df4a5a3" (UID: "c182614e-39a8-40fc-9211-c3d95df4a5a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:37:53.556475 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.556389    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-bundle\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:53.556475 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.556421    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sf8d\" (UniqueName: \"kubernetes.io/projected/c182614e-39a8-40fc-9211-c3d95df4a5a3-kube-api-access-7sf8d\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:53.556475 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.556436    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c182614e-39a8-40fc-9211-c3d95df4a5a3-util\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:37:53.691212 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691179    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9s6sp"]
May 21 10:37:53.691478 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691467    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="extract"
May 21 10:37:53.691532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691479    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="extract"
May 21 10:37:53.691532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691492    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="util"
May 21 10:37:53.691532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691498    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="util"
May 21 10:37:53.691532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691514    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="pull"
May 21 10:37:53.691532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691520    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="pull"
May 21 10:37:53.691676 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.691560    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c182614e-39a8-40fc-9211-c3d95df4a5a3" containerName="extract"
May 21 10:37:53.695810 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.695781    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:53.699166 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.699144    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xmfv8\""
May 21 10:37:53.701137 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.701115    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 10:37:53.721372 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.721344    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9s6sp"]
May 21 10:37:53.757224 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.757167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wx7k\" (UniqueName: \"kubernetes.io/projected/3a265583-e3e0-4860-97c6-64e13e67c3ae-kube-api-access-8wx7k\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:53.757407 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.757297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:53.858761 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.858722    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:53.858922 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:53.858827    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 10:37:53.858922 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:53.858878    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert podName:3a265583-e3e0-4860-97c6-64e13e67c3ae nodeName:}" failed. No retries permitted until 2026-05-21 10:37:54.358861336 +0000 UTC m=+465.108965103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert") pod "kserve-controller-manager-856948b99f-9s6sp" (UID: "3a265583-e3e0-4860-97c6-64e13e67c3ae") : secret "kserve-webhook-server-cert" not found
May 21 10:37:53.859079 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.859055    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wx7k\" (UniqueName: \"kubernetes.io/projected/3a265583-e3e0-4860-97c6-64e13e67c3ae-kube-api-access-8wx7k\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:53.883813 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:53.883782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wx7k\" (UniqueName: \"kubernetes.io/projected/3a265583-e3e0-4860-97c6-64e13e67c3ae-kube-api-access-8wx7k\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:54.247425 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.247381    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4" event={"ID":"c182614e-39a8-40fc-9211-c3d95df4a5a3","Type":"ContainerDied","Data":"4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca"}
May 21 10:37:54.247425 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.247409    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zhpc4"
May 21 10:37:54.247425 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.247428    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4829c3f454483141b466e950400c65d647de204a295826e1c31e64832cb2cfca"
May 21 10:37:54.249104 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.249086    2563 scope.go:117] "RemoveContainer" containerID="cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce"
May 21 10:37:54.249350 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:54.249327    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-7bxhv_opendatahub(0bed74ca-e6ae-4493-9b30-d34ee8abfe70)\"" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" podUID="0bed74ca-e6ae-4493-9b30-d34ee8abfe70"
May 21 10:37:54.367715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.367674    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:54.370920 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.370892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a265583-e3e0-4860-97c6-64e13e67c3ae-cert\") pod \"kserve-controller-manager-856948b99f-9s6sp\" (UID: \"3a265583-e3e0-4860-97c6-64e13e67c3ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:54.608601 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.608506    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:54.740118 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:54.740088    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9s6sp"]
May 21 10:37:54.743687 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:37:54.743662    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a265583_e3e0_4860_97c6_64e13e67c3ae.slice/crio-1a9e0679a8842bf7b7172594e49c91e30a69b9fc6fdbff84dc44501ec68e3e9d WatchSource:0}: Error finding container 1a9e0679a8842bf7b7172594e49c91e30a69b9fc6fdbff84dc44501ec68e3e9d: Status 404 returned error can't find the container with id 1a9e0679a8842bf7b7172594e49c91e30a69b9fc6fdbff84dc44501ec68e3e9d
May 21 10:37:55.253267 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:55.253218    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp" event={"ID":"3a265583-e3e0-4860-97c6-64e13e67c3ae","Type":"ContainerStarted","Data":"1a9e0679a8842bf7b7172594e49c91e30a69b9fc6fdbff84dc44501ec68e3e9d"}
May 21 10:37:59.062434 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:59.062396    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:37:59.062840 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:59.062799    2563 scope.go:117] "RemoveContainer" containerID="cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce"
May 21 10:37:59.062979 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:37:59.062962    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-7bxhv_opendatahub(0bed74ca-e6ae-4493-9b30-d34ee8abfe70)\"" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" podUID="0bed74ca-e6ae-4493-9b30-d34ee8abfe70"
May 21 10:37:59.266681 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:59.266645    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp" event={"ID":"3a265583-e3e0-4860-97c6-64e13e67c3ae","Type":"ContainerStarted","Data":"971bf4b99557d65504e818a9ae94fd41a8a43fdf428108f630dd839023c0a0db"}
May 21 10:37:59.266873 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:59.266695    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:37:59.315406 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:37:59.312436    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp" podStartSLOduration=2.724543872 podStartE2EDuration="6.312417513s" podCreationTimestamp="2026-05-21 10:37:53 +0000 UTC" firstStartedPulling="2026-05-21 10:37:54.745079257 +0000 UTC m=+465.495183023" lastFinishedPulling="2026-05-21 10:37:58.332952884 +0000 UTC m=+469.083056664" observedRunningTime="2026-05-21 10:37:59.309611858 +0000 UTC m=+470.059715656" watchObservedRunningTime="2026-05-21 10:37:59.312417513 +0000 UTC m=+470.062521306"
May 21 10:38:01.210860 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.210824    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"]
May 21 10:38:01.214127 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.214110    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.223710 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.223692    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 10:38:01.228423 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.228405    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\""
May 21 10:38:01.229353 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.229339    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 10:38:01.247270 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.247238    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"]
May 21 10:38:01.332759 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.332708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg2j\" (UniqueName: \"kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.333003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.332774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.333003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.332802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.434049 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.434003    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg2j\" (UniqueName: \"kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.434281 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.434066    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.434281 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.434092    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.434524 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.434502    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.434594 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.434527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.453005 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.452971    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg2j\" (UniqueName: \"kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.522564 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.522479    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:01.665015 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:01.664986    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"]
May 21 10:38:01.667398 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:38:01.667371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e0960f_e72f_49b1_b3af_acfb254c2a95.slice/crio-c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1 WatchSource:0}: Error finding container c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1: Status 404 returned error can't find the container with id c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1
May 21 10:38:02.277389 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:02.277355    2563 generic.go:358] "Generic (PLEG): container finished" podID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerID="9356af02a133ff0c8ab630d28883c5a6c15c014442991f8fe18839ad09a1c721" exitCode=0
May 21 10:38:02.277873 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:02.277434    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb" event={"ID":"53e0960f-e72f-49b1-b3af-acfb254c2a95","Type":"ContainerDied","Data":"9356af02a133ff0c8ab630d28883c5a6c15c014442991f8fe18839ad09a1c721"}
May 21 10:38:02.277873 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:02.277461    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb" event={"ID":"53e0960f-e72f-49b1-b3af-acfb254c2a95","Type":"ContainerStarted","Data":"c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1"}
May 21 10:38:03.524378 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.524344    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"]
May 21 10:38:03.527630 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.527607    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.530791 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.530755    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-vpjmw\""
May 21 10:38:03.530791 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.530785    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 10:38:03.530961 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.530920    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 10:38:03.554617 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.554577    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"]
May 21 10:38:03.654010 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.653984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c66ae02-f027-428e-897e-4e56b4b95d7f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.654152 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.654017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prtlz\" (UniqueName: \"kubernetes.io/projected/9c66ae02-f027-428e-897e-4e56b4b95d7f-kube-api-access-prtlz\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.754863 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.754831    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c66ae02-f027-428e-897e-4e56b4b95d7f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.755009 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.754870    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prtlz\" (UniqueName: \"kubernetes.io/projected/9c66ae02-f027-428e-897e-4e56b4b95d7f-kube-api-access-prtlz\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.757386 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.757358    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c66ae02-f027-428e-897e-4e56b4b95d7f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.764936 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.764913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prtlz\" (UniqueName: \"kubernetes.io/projected/9c66ae02-f027-428e-897e-4e56b4b95d7f-kube-api-access-prtlz\") pod \"servicemesh-operator3-55f49c5f94-ztx6c\" (UID: \"9c66ae02-f027-428e-897e-4e56b4b95d7f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.837015 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.836934    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:03.971525 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:03.971493    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"]
May 21 10:38:03.973239 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:38:03.973187    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c66ae02_f027_428e_897e_4e56b4b95d7f.slice/crio-46dc66526888ed06da0bb5a900964af798cea658a247a2ced029356ebc373d10 WatchSource:0}: Error finding container 46dc66526888ed06da0bb5a900964af798cea658a247a2ced029356ebc373d10: Status 404 returned error can't find the container with id 46dc66526888ed06da0bb5a900964af798cea658a247a2ced029356ebc373d10
May 21 10:38:04.285190 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:04.285140    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c" event={"ID":"9c66ae02-f027-428e-897e-4e56b4b95d7f","Type":"ContainerStarted","Data":"46dc66526888ed06da0bb5a900964af798cea658a247a2ced029356ebc373d10"}
May 21 10:38:04.286618 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:04.286578    2563 generic.go:358] "Generic (PLEG): container finished" podID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerID="25d88ff83599a16afd4522f7cb7e60ae9ae05f00477ca021ba9ac7cd7e0ce81a" exitCode=0
May 21 10:38:04.286758 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:04.286624    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb" event={"ID":"53e0960f-e72f-49b1-b3af-acfb254c2a95","Type":"ContainerDied","Data":"25d88ff83599a16afd4522f7cb7e60ae9ae05f00477ca021ba9ac7cd7e0ce81a"}
May 21 10:38:05.291213 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:05.291159    2563 generic.go:358] "Generic (PLEG): container finished" podID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerID="e8ced4ccb4559706ad834cf752f647a0246495c1f2156b1d29370f7e429c5671" exitCode=0
May 21 10:38:05.291605 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:05.291233    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb" event={"ID":"53e0960f-e72f-49b1-b3af-acfb254c2a95","Type":"ContainerDied","Data":"e8ced4ccb4559706ad834cf752f647a0246495c1f2156b1d29370f7e429c5671"}
May 21 10:38:07.157177 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.157154    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:07.284953 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.284928    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzg2j\" (UniqueName: \"kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j\") pod \"53e0960f-e72f-49b1-b3af-acfb254c2a95\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") "
May 21 10:38:07.285082 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.284970    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util\") pod \"53e0960f-e72f-49b1-b3af-acfb254c2a95\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") "
May 21 10:38:07.285082 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.285014    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle\") pod \"53e0960f-e72f-49b1-b3af-acfb254c2a95\" (UID: \"53e0960f-e72f-49b1-b3af-acfb254c2a95\") "
May 21 10:38:07.285992 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.285965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle" (OuterVolumeSpecName: "bundle") pod "53e0960f-e72f-49b1-b3af-acfb254c2a95" (UID: "53e0960f-e72f-49b1-b3af-acfb254c2a95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:38:07.286899 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.286876    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j" (OuterVolumeSpecName: "kube-api-access-hzg2j") pod "53e0960f-e72f-49b1-b3af-acfb254c2a95" (UID: "53e0960f-e72f-49b1-b3af-acfb254c2a95"). InnerVolumeSpecName "kube-api-access-hzg2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:38:07.292414 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.292382    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util" (OuterVolumeSpecName: "util") pod "53e0960f-e72f-49b1-b3af-acfb254c2a95" (UID: "53e0960f-e72f-49b1-b3af-acfb254c2a95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:38:07.300066 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.300033    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c" event={"ID":"9c66ae02-f027-428e-897e-4e56b4b95d7f","Type":"ContainerStarted","Data":"b19d834ef1775cf2be1fe61d60ebc966c9d504fce0dd08c971e569bd227bc5a4"}
May 21 10:38:07.300220 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.300183    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:07.301722 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.301698    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb" event={"ID":"53e0960f-e72f-49b1-b3af-acfb254c2a95","Type":"ContainerDied","Data":"c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1"}
May 21 10:38:07.301815 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.301733    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5facc65e25c4e54bb04cd3fc74df7dd3e1b9591c18fa1658e6391465b7e9ff1"
May 21 10:38:07.301815 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.301709    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajhhrb"
May 21 10:38:07.332405 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.332355    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c" podStartSLOduration=1.1006636300000001 podStartE2EDuration="4.332339931s" podCreationTimestamp="2026-05-21 10:38:03 +0000 UTC" firstStartedPulling="2026-05-21 10:38:03.975644541 +0000 UTC m=+474.725748306" lastFinishedPulling="2026-05-21 10:38:07.207320832 +0000 UTC m=+477.957424607" observedRunningTime="2026-05-21 10:38:07.330524592 +0000 UTC m=+478.080628408" watchObservedRunningTime="2026-05-21 10:38:07.332339931 +0000 UTC m=+478.082443719"
May 21 10:38:07.385989 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.385951    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-bundle\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:38:07.385989 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.385981    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzg2j\" (UniqueName: \"kubernetes.io/projected/53e0960f-e72f-49b1-b3af-acfb254c2a95-kube-api-access-hzg2j\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:38:07.385989 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:07.385991    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e0960f-e72f-49b1-b3af-acfb254c2a95-util\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:38:09.062354 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:09.062328    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:38:09.062721 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:09.062712    2563 scope.go:117] "RemoveContainer" containerID="cba5abefe5a04f73f941948d2613c3a4509b5136610791c7cb2eb23b37a5a6ce"
May 21 10:38:10.312800 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:10.312760    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" event={"ID":"0bed74ca-e6ae-4493-9b30-d34ee8abfe70","Type":"ContainerStarted","Data":"06533b03d71e289b02b3f53454864fd374ff46b711859d1b1e965891442d3815"}
May 21 10:38:10.313244 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:10.313001    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:38:10.336857 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:10.336788    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv" podStartSLOduration=3.292242518 podStartE2EDuration="23.3367716s" podCreationTimestamp="2026-05-21 10:37:47 +0000 UTC" firstStartedPulling="2026-05-21 10:37:49.306826653 +0000 UTC m=+460.056930426" lastFinishedPulling="2026-05-21 10:38:09.351355742 +0000 UTC m=+480.101459508" observedRunningTime="2026-05-21 10:38:10.336177198 +0000 UTC m=+481.086280988" watchObservedRunningTime="2026-05-21 10:38:10.3367716 +0000 UTC m=+481.086875388"
May 21 10:38:13.201970 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.201932    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"]
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="util"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202302    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="util"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202315    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="extract"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="extract"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202335    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="pull"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202345    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="pull"
May 21 10:38:13.202470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.202422    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="53e0960f-e72f-49b1-b3af-acfb254c2a95" containerName="extract"
May 21 10:38:13.208705 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.208684    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.211489 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.211463    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 10:38:13.211489 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.211478    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 10:38:13.211682 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.211625    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 10:38:13.211682 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.211656    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t6m9n\""
May 21 10:38:13.213540 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.213513    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 10:38:13.219692 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.219670    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"]
May 21 10:38:13.338086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-istio-token\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvtmh\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-kube-api-access-tvtmh\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-cacerts\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.338398 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.338344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536629-e051-4054-b1ea-04f034b87d72-local-certs\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439152 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439096    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439152 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439170    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-cacerts\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439212    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439232    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536629-e051-4054-b1ea-04f034b87d72-local-certs\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439256    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439282    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-istio-token\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439439 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439350    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvtmh\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-kube-api-access-tvtmh\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.439870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.439844    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.442718 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.442690    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8536629-e051-4054-b1ea-04f034b87d72-local-certs\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.442830 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.442727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.442930 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.442914    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-cacerts\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.442997 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.442917    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8536629-e051-4054-b1ea-04f034b87d72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.448015 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.447984    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-istio-token\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.448451 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.448428    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvtmh\" (UniqueName: \"kubernetes.io/projected/d8536629-e051-4054-b1ea-04f034b87d72-kube-api-access-tvtmh\") pod \"istiod-openshift-gateway-798958bb55-srdct\" (UID: \"d8536629-e051-4054-b1ea-04f034b87d72\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.519475 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.519376    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:13.658635 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:13.658415    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"]
May 21 10:38:13.660866 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:38:13.660834    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8536629_e051_4054_b1ea_04f034b87d72.slice/crio-32d4dae9ef76074f37fe723f9c4912afa87bfbe41c769dfd18bcdf0bc1b9ea52 WatchSource:0}: Error finding container 32d4dae9ef76074f37fe723f9c4912afa87bfbe41c769dfd18bcdf0bc1b9ea52: Status 404 returned error can't find the container with id 32d4dae9ef76074f37fe723f9c4912afa87bfbe41c769dfd18bcdf0bc1b9ea52
May 21 10:38:14.327586 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:14.327545    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct" event={"ID":"d8536629-e051-4054-b1ea-04f034b87d72","Type":"ContainerStarted","Data":"32d4dae9ef76074f37fe723f9c4912afa87bfbe41c769dfd18bcdf0bc1b9ea52"}
May 21 10:38:16.367983 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:16.367938    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 10:38:16.368277 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:16.368025    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 10:38:17.341566 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:17.341530    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct" event={"ID":"d8536629-e051-4054-b1ea-04f034b87d72","Type":"ContainerStarted","Data":"b53ed2f56db820ba47a7661014d2954d645217d32fb82ba0b78e0f22ecf50b95"}
May 21 10:38:17.341854 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:17.341821    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:17.343526 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:17.343490    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-srdct container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 10:38:17.343641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:17.343553    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct" podUID="d8536629-e051-4054-b1ea-04f034b87d72" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 10:38:17.381630 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:17.381560    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct" podStartSLOduration=1.676785765 podStartE2EDuration="4.381543765s" podCreationTimestamp="2026-05-21 10:38:13 +0000 UTC" firstStartedPulling="2026-05-21 10:38:13.662923456 +0000 UTC m=+484.413027222" lastFinishedPulling="2026-05-21 10:38:16.367681455 +0000 UTC m=+487.117785222" observedRunningTime="2026-05-21 10:38:17.379433174 +0000 UTC m=+488.129536963" watchObservedRunningTime="2026-05-21 10:38:17.381543765 +0000 UTC m=+488.131647552"
May 21 10:38:18.307740 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:18.307704    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ztx6c"
May 21 10:38:18.346067 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:18.346039    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-srdct"
May 21 10:38:21.318635 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:21.318597    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-7bxhv"
May 21 10:38:30.274280 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:30.274249    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-9s6sp"
May 21 10:38:41.974354 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.974312    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l977q"]
May 21 10:38:41.977654 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.977637    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:41.980613 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.980583    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 10:38:41.980613 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.980611    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kxzws\""
May 21 10:38:41.980794 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.980673    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 10:38:41.984895 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:41.984861    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l977q"]
May 21 10:38:42.088022 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.087978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vss5l\" (UniqueName: \"kubernetes.io/projected/90da3490-a327-4f5e-ac7f-4abe7c198f88-kube-api-access-vss5l\") pod \"kuadrant-operator-catalog-l977q\" (UID: \"90da3490-a327-4f5e-ac7f-4abe7c198f88\") " pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:42.188647 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.188587    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vss5l\" (UniqueName: \"kubernetes.io/projected/90da3490-a327-4f5e-ac7f-4abe7c198f88-kube-api-access-vss5l\") pod \"kuadrant-operator-catalog-l977q\" (UID: \"90da3490-a327-4f5e-ac7f-4abe7c198f88\") " pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:42.197925 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.197899    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vss5l\" (UniqueName: \"kubernetes.io/projected/90da3490-a327-4f5e-ac7f-4abe7c198f88-kube-api-access-vss5l\") pod \"kuadrant-operator-catalog-l977q\" (UID: \"90da3490-a327-4f5e-ac7f-4abe7c198f88\") " pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:42.287813 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.287705    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:42.416690 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.416537    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l977q"]
May 21 10:38:42.419599 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:38:42.419567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90da3490_a327_4f5e_ac7f_4abe7c198f88.slice/crio-720320535ca20feddad30fae8137307454c88bcf1d5176971e07cf3fa2f022b8 WatchSource:0}: Error finding container 720320535ca20feddad30fae8137307454c88bcf1d5176971e07cf3fa2f022b8: Status 404 returned error can't find the container with id 720320535ca20feddad30fae8137307454c88bcf1d5176971e07cf3fa2f022b8
May 21 10:38:42.429643 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:42.429614    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l977q" event={"ID":"90da3490-a327-4f5e-ac7f-4abe7c198f88","Type":"ContainerStarted","Data":"720320535ca20feddad30fae8137307454c88bcf1d5176971e07cf3fa2f022b8"}
May 21 10:38:44.437807 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:44.437771    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l977q" event={"ID":"90da3490-a327-4f5e-ac7f-4abe7c198f88","Type":"ContainerStarted","Data":"67bd0b6aa3b034095bc0d2babf5ff512304a0165d48f43e6468532722aacb092"}
May 21 10:38:44.458067 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:44.457948    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l977q" podStartSLOduration=1.5186904220000002 podStartE2EDuration="3.457928911s" podCreationTimestamp="2026-05-21 10:38:41 +0000 UTC" firstStartedPulling="2026-05-21 10:38:42.420978478 +0000 UTC m=+513.171082243" lastFinishedPulling="2026-05-21 10:38:44.360216953 +0000 UTC m=+515.110320732" observedRunningTime="2026-05-21 10:38:44.455660384 +0000 UTC m=+515.205764173" watchObservedRunningTime="2026-05-21 10:38:44.457928911 +0000 UTC m=+515.208032699"
May 21 10:38:52.288786 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:52.288699    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:52.289305 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:52.288845    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:52.310509 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:52.310469    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:38:52.483405 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:38:52.483378    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-l977q"
May 21 10:39:03.904080 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:03.901668    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"]
May 21 10:39:03.906591 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:03.906569    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:03.910063 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:03.910031    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w62hv\""
May 21 10:39:03.911405 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:03.911378    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"]
May 21 10:39:04.077558 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.077522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9x6x\" (UniqueName: \"kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.077752 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.077578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.077752 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.077609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.178091 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.177993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9x6x\" (UniqueName: \"kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.178091 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.178049    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.178419 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.178118    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.178472 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.178427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.178472 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.178449    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.193394 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.193367    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9x6x\" (UniqueName: \"kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.217178 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.217150    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:04.346910 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.346878    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"]
May 21 10:39:04.348876 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:39:04.348849    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc251cc10_61ec_4c7d_addb_e6f120bbe2ba.slice/crio-a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0 WatchSource:0}: Error finding container a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0: Status 404 returned error can't find the container with id a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0
May 21 10:39:04.507715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.506450    2563 generic.go:358] "Generic (PLEG): container finished" podID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerID="e2a51b71f28b9e3147e25d21adb3bfa293864065ca96d8a5361be5020fd2758a" exitCode=0
May 21 10:39:04.507715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.506549    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r" event={"ID":"c251cc10-61ec-4c7d-addb-e6f120bbe2ba","Type":"ContainerDied","Data":"e2a51b71f28b9e3147e25d21adb3bfa293864065ca96d8a5361be5020fd2758a"}
May 21 10:39:04.507715 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:04.506575    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r" event={"ID":"c251cc10-61ec-4c7d-addb-e6f120bbe2ba","Type":"ContainerStarted","Data":"a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0"}
May 21 10:39:05.511092 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:05.510997    2563 generic.go:358] "Generic (PLEG): container finished" podID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerID="c8d058b436354ca18e6dc1666af7474c13ea29b6cfb91fe93362f4a4c1d3024c" exitCode=0
May 21 10:39:05.511092 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:05.511080    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r" event={"ID":"c251cc10-61ec-4c7d-addb-e6f120bbe2ba","Type":"ContainerDied","Data":"c8d058b436354ca18e6dc1666af7474c13ea29b6cfb91fe93362f4a4c1d3024c"}
May 21 10:39:06.516238 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:06.516182    2563 generic.go:358] "Generic (PLEG): container finished" podID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerID="0c64a20f9a4f738e22f4eec7266dc445252f3e30229811cec6ce3fbde52e471e" exitCode=0
May 21 10:39:06.516618 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:06.516267    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r" event={"ID":"c251cc10-61ec-4c7d-addb-e6f120bbe2ba","Type":"ContainerDied","Data":"0c64a20f9a4f738e22f4eec7266dc445252f3e30229811cec6ce3fbde52e471e"}
May 21 10:39:07.648287 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.648265    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:07.810569 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.810482    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util\") pod \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") "
May 21 10:39:07.810569 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.810537    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle\") pod \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") "
May 21 10:39:07.810569 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.810565    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9x6x\" (UniqueName: \"kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x\") pod \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\" (UID: \"c251cc10-61ec-4c7d-addb-e6f120bbe2ba\") "
May 21 10:39:07.811082 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.811050    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle" (OuterVolumeSpecName: "bundle") pod "c251cc10-61ec-4c7d-addb-e6f120bbe2ba" (UID: "c251cc10-61ec-4c7d-addb-e6f120bbe2ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:39:07.812911 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.812882    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x" (OuterVolumeSpecName: "kube-api-access-b9x6x") pod "c251cc10-61ec-4c7d-addb-e6f120bbe2ba" (UID: "c251cc10-61ec-4c7d-addb-e6f120bbe2ba"). InnerVolumeSpecName "kube-api-access-b9x6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:39:07.815676 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.815642    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util" (OuterVolumeSpecName: "util") pod "c251cc10-61ec-4c7d-addb-e6f120bbe2ba" (UID: "c251cc10-61ec-4c7d-addb-e6f120bbe2ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:39:07.911727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.911682    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-util\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:07.911727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.911724    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-bundle\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:07.911727 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:07.911734    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9x6x\" (UniqueName: \"kubernetes.io/projected/c251cc10-61ec-4c7d-addb-e6f120bbe2ba-kube-api-access-b9x6x\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:08.531269 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:08.531227    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r" event={"ID":"c251cc10-61ec-4c7d-addb-e6f120bbe2ba","Type":"ContainerDied","Data":"a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0"}
May 21 10:39:08.531269 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:08.531272    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a57aab49b434ae0c88c34405f5f2c2ef19ebbc2bea88fbfd9f80d8e381a0ebe0"
May 21 10:39:08.531468 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:08.531304    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r"
May 21 10:39:25.001966 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.001930    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"]
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002238    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="util"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002250    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="util"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002257    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="pull"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002263    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="pull"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002276    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="extract"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002281    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="extract"
May 21 10:39:25.002473 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.002353    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c251cc10-61ec-4c7d-addb-e6f120bbe2ba" containerName="extract"
May 21 10:39:25.004875 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.004858    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.007706 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.007681    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2qs6\""
May 21 10:39:25.031453 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.031415    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"]
May 21 10:39:25.043823 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.043776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrtc\" (UniqueName: \"kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.044012 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.043836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.145459 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.145418    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrtc\" (UniqueName: \"kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.145644 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.145466    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.145883 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.145863    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.158110 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.158079    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrtc\" (UniqueName: \"kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.316317 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.316184    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:25.450316 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.450290    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"]
May 21 10:39:25.453022 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:39:25.452992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fad3a2c_a35f_489e_8222_6466a2e42671.slice/crio-9ac0d961b75b70fe9f4b7c5bad73a1060920b40d2d00dcb8776b8981a316de68 WatchSource:0}: Error finding container 9ac0d961b75b70fe9f4b7c5bad73a1060920b40d2d00dcb8776b8981a316de68: Status 404 returned error can't find the container with id 9ac0d961b75b70fe9f4b7c5bad73a1060920b40d2d00dcb8776b8981a316de68
May 21 10:39:25.588724 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:25.588631    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" event={"ID":"1fad3a2c-a35f-489e-8222-6466a2e42671","Type":"ContainerStarted","Data":"9ac0d961b75b70fe9f4b7c5bad73a1060920b40d2d00dcb8776b8981a316de68"}
May 21 10:39:30.611854 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:30.611759    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" event={"ID":"1fad3a2c-a35f-489e-8222-6466a2e42671","Type":"ContainerStarted","Data":"9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74"}
May 21 10:39:30.611854 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:30.611820    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:30.635550 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:30.635483    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" podStartSLOduration=1.901996778 podStartE2EDuration="6.635463864s" podCreationTimestamp="2026-05-21 10:39:24 +0000 UTC" firstStartedPulling="2026-05-21 10:39:25.455262854 +0000 UTC m=+556.205366620" lastFinishedPulling="2026-05-21 10:39:30.188729937 +0000 UTC m=+560.938833706" observedRunningTime="2026-05-21 10:39:30.632617928 +0000 UTC m=+561.382721709" watchObservedRunningTime="2026-05-21 10:39:30.635463864 +0000 UTC m=+561.385567653"
May 21 10:39:31.674278 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.674239    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n6s4b"]
May 21 10:39:31.678002 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.677977    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:31.680578 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.680553    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9hfr5\""
May 21 10:39:31.693880 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.693853    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n6s4b"]
May 21 10:39:31.704477 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.704446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59bwc\" (UniqueName: \"kubernetes.io/projected/ae2139a0-74e9-463a-91c5-d78a08f5cdbf-kube-api-access-59bwc\") pod \"authorino-operator-657f44b778-n6s4b\" (UID: \"ae2139a0-74e9-463a-91c5-d78a08f5cdbf\") " pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:31.805098 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.805046    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59bwc\" (UniqueName: \"kubernetes.io/projected/ae2139a0-74e9-463a-91c5-d78a08f5cdbf-kube-api-access-59bwc\") pod \"authorino-operator-657f44b778-n6s4b\" (UID: \"ae2139a0-74e9-463a-91c5-d78a08f5cdbf\") " pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:31.814081 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.814049    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59bwc\" (UniqueName: \"kubernetes.io/projected/ae2139a0-74e9-463a-91c5-d78a08f5cdbf-kube-api-access-59bwc\") pod \"authorino-operator-657f44b778-n6s4b\" (UID: \"ae2139a0-74e9-463a-91c5-d78a08f5cdbf\") " pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:31.988252 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:31.988131    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:32.131064 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:32.125812    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n6s4b"]
May 21 10:39:32.131866 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:39:32.131828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2139a0_74e9_463a_91c5_d78a08f5cdbf.slice/crio-157d6efc82b1ae21432b27a31fc521ea17a87ef510f258457f0c01c672256e12 WatchSource:0}: Error finding container 157d6efc82b1ae21432b27a31fc521ea17a87ef510f258457f0c01c672256e12: Status 404 returned error can't find the container with id 157d6efc82b1ae21432b27a31fc521ea17a87ef510f258457f0c01c672256e12
May 21 10:39:32.621977 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:32.621928    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b" event={"ID":"ae2139a0-74e9-463a-91c5-d78a08f5cdbf","Type":"ContainerStarted","Data":"157d6efc82b1ae21432b27a31fc521ea17a87ef510f258457f0c01c672256e12"}
May 21 10:39:34.631391 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:34.631353    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b" event={"ID":"ae2139a0-74e9-463a-91c5-d78a08f5cdbf","Type":"ContainerStarted","Data":"7ae649ab602b039f5db51f5184db614d8b765dac775fc9523293979b865e5c2e"}
May 21 10:39:34.631816 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:34.631484    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:34.651262 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:34.651187    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b" podStartSLOduration=1.9277051630000002 podStartE2EDuration="3.651171137s" podCreationTimestamp="2026-05-21 10:39:31 +0000 UTC" firstStartedPulling="2026-05-21 10:39:32.133357848 +0000 UTC m=+562.883461614" lastFinishedPulling="2026-05-21 10:39:33.856823819 +0000 UTC m=+564.606927588" observedRunningTime="2026-05-21 10:39:34.650245113 +0000 UTC m=+565.400348903" watchObservedRunningTime="2026-05-21 10:39:34.651171137 +0000 UTC m=+565.401274925"
May 21 10:39:41.617332 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:41.617293    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:43.417180 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.417144    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"]
May 21 10:39:43.417613 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.417366    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" containerName="manager" containerID="cri-o://9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74" gracePeriod=2
May 21 10:39:43.419749 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.419706    2563 status_manager.go:895] "Failed to get status for pod" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" is forbidden: User \"system:node:ip-10-0-142-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-243.ec2.internal' and this object"
May 21 10:39:43.422126 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.422098    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"]
May 21 10:39:43.447235 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.447179    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:43.447891 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.447859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" containerName="manager"
May 21 10:39:43.447891 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.447891    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" containerName="manager"
May 21 10:39:43.448034 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.447993    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" containerName="manager"
May 21 10:39:43.451173 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.451149    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.453733 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.453696    2563 status_manager.go:895] "Failed to get status for pod" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" is forbidden: User \"system:node:ip-10-0-142-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-243.ec2.internal' and this object"
May 21 10:39:43.464115 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.464085    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:43.512714 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.512680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.512897 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.512745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qtg\" (UniqueName: \"kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.613754 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.613718    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qtg\" (UniqueName: \"kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.613939 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.613782    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.614135 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.614114    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.623427 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.623396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qtg\" (UniqueName: \"kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jhcm9\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.651858 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.651835    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:43.654465 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.654440    2563 status_manager.go:895] "Failed to get status for pod" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" is forbidden: User \"system:node:ip-10-0-142-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-243.ec2.internal' and this object"
May 21 10:39:43.670558 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.670475    2563 generic.go:358] "Generic (PLEG): container finished" podID="1fad3a2c-a35f-489e-8222-6466a2e42671" containerID="9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74" exitCode=0
May 21 10:39:43.670558 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.670524    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z"
May 21 10:39:43.670558 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.670534    2563 scope.go:117] "RemoveContainer" containerID="9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74"
May 21 10:39:43.673327 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.673296    2563 status_manager.go:895] "Failed to get status for pod" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kjf9z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kjf9z\" is forbidden: User \"system:node:ip-10-0-142-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-243.ec2.internal' and this object"
May 21 10:39:43.678872 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.678855    2563 scope.go:117] "RemoveContainer" containerID="9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74"
May 21 10:39:43.679171 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:39:43.679147    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74\": container with ID starting with 9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74 not found: ID does not exist" containerID="9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74"
May 21 10:39:43.679227 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.679182    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74"} err="failed to get container status \"9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74\": rpc error: code = NotFound desc = could not find container \"9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74\": container with ID starting with 9098b91ef0065cc07b51a5696771a4ee0d47a65c96b97de75db3893d3d40ac74 not found: ID does not exist"
May 21 10:39:43.714638 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.714597    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume\") pod \"1fad3a2c-a35f-489e-8222-6466a2e42671\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") "
May 21 10:39:43.714828 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.714726    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mrtc\" (UniqueName: \"kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc\") pod \"1fad3a2c-a35f-489e-8222-6466a2e42671\" (UID: \"1fad3a2c-a35f-489e-8222-6466a2e42671\") "
May 21 10:39:43.715171 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.715147    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1fad3a2c-a35f-489e-8222-6466a2e42671" (UID: "1fad3a2c-a35f-489e-8222-6466a2e42671"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:39:43.716751 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.716731    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc" (OuterVolumeSpecName: "kube-api-access-6mrtc") pod "1fad3a2c-a35f-489e-8222-6466a2e42671" (UID: "1fad3a2c-a35f-489e-8222-6466a2e42671"). InnerVolumeSpecName "kube-api-access-6mrtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:39:43.798767 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.798721    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:43.815822 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.815793    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fad3a2c-a35f-489e-8222-6466a2e42671-extensions-socket-volume\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:43.815822 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.815823    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mrtc\" (UniqueName: \"kubernetes.io/projected/1fad3a2c-a35f-489e-8222-6466a2e42671-kube-api-access-6mrtc\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:43.821728 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.821698    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fad3a2c-a35f-489e-8222-6466a2e42671" path="/var/lib/kubelet/pods/1fad3a2c-a35f-489e-8222-6466a2e42671/volumes"
May 21 10:39:43.933335 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:43.933309    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:43.935333 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:39:43.935305    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22aee4fd_c553_48d7_9ad7_034953b9a259.slice/crio-00638a6d25f467e671e64be0fe802660b2b6743753aec0f50af429d21dd6cc82 WatchSource:0}: Error finding container 00638a6d25f467e671e64be0fe802660b2b6743753aec0f50af429d21dd6cc82: Status 404 returned error can't find the container with id 00638a6d25f467e671e64be0fe802660b2b6743753aec0f50af429d21dd6cc82
May 21 10:39:44.656121 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.656085    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:39:44.659551 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.659528    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.675472 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.675432    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" event={"ID":"22aee4fd-c553-48d7-9ad7-034953b9a259","Type":"ContainerStarted","Data":"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"}
May 21 10:39:44.675650 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.675473    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" event={"ID":"22aee4fd-c553-48d7-9ad7-034953b9a259","Type":"ContainerStarted","Data":"00638a6d25f467e671e64be0fe802660b2b6743753aec0f50af429d21dd6cc82"}
May 21 10:39:44.675650 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.675532    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:44.681719 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.681690    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:39:44.716121 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.716066    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" podStartSLOduration=1.716047852 podStartE2EDuration="1.716047852s" podCreationTimestamp="2026-05-21 10:39:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:39:44.714704527 +0000 UTC m=+575.464808317" watchObservedRunningTime="2026-05-21 10:39:44.716047852 +0000 UTC m=+575.466151640"
May 21 10:39:44.725400 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.725363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.725550 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.725420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvbv\" (UniqueName: \"kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.826518 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.826476    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.826684 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.826533    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvbv\" (UniqueName: \"kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.826872 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.826853    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.838800 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.838774    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvbv\" (UniqueName: \"kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k52ld\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:44.970692 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:44.970588    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:45.110732 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.110705    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:39:45.112356 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:39:45.112326    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ee78bc_0ac7_42d9_a075_fc7c7fbc22f5.slice/crio-3ddef6611540ea8f3e6314864f9be88cd04cc7498686395383fbf871be585cb1 WatchSource:0}: Error finding container 3ddef6611540ea8f3e6314864f9be88cd04cc7498686395383fbf871be585cb1: Status 404 returned error can't find the container with id 3ddef6611540ea8f3e6314864f9be88cd04cc7498686395383fbf871be585cb1
May 21 10:39:45.639520 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.639479    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-n6s4b"
May 21 10:39:45.681943 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.681898    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" event={"ID":"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5","Type":"ContainerStarted","Data":"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"}
May 21 10:39:45.681943 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.681945    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" event={"ID":"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5","Type":"ContainerStarted","Data":"3ddef6611540ea8f3e6314864f9be88cd04cc7498686395383fbf871be585cb1"}
May 21 10:39:45.682509 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.682102    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:45.710722 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:45.710663    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" podStartSLOduration=1.710643724 podStartE2EDuration="1.710643724s" podCreationTimestamp="2026-05-21 10:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:39:45.708699992 +0000 UTC m=+576.458803781" watchObservedRunningTime="2026-05-21 10:39:45.710643724 +0000 UTC m=+576.460747515"
May 21 10:39:55.684092 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:55.684059    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:56.688235 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:56.688181    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:39:56.748849 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:56.748816    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:56.749088 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:56.749051    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" podUID="22aee4fd-c553-48d7-9ad7-034953b9a259" containerName="manager" containerID="cri-o://dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6" gracePeriod=10
May 21 10:39:56.996676 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:56.996651    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:57.131470 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.131437    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume\") pod \"22aee4fd-c553-48d7-9ad7-034953b9a259\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") "
May 21 10:39:57.131639 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.131512    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2qtg\" (UniqueName: \"kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg\") pod \"22aee4fd-c553-48d7-9ad7-034953b9a259\" (UID: \"22aee4fd-c553-48d7-9ad7-034953b9a259\") "
May 21 10:39:57.131882 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.131847    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22aee4fd-c553-48d7-9ad7-034953b9a259" (UID: "22aee4fd-c553-48d7-9ad7-034953b9a259"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:39:57.133545 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.133521    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg" (OuterVolumeSpecName: "kube-api-access-m2qtg") pod "22aee4fd-c553-48d7-9ad7-034953b9a259" (UID: "22aee4fd-c553-48d7-9ad7-034953b9a259"). InnerVolumeSpecName "kube-api-access-m2qtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:39:57.232995 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.232899    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22aee4fd-c553-48d7-9ad7-034953b9a259-extensions-socket-volume\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:57.232995 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.232931    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2qtg\" (UniqueName: \"kubernetes.io/projected/22aee4fd-c553-48d7-9ad7-034953b9a259-kube-api-access-m2qtg\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:39:57.723549 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.723515    2563 generic.go:358] "Generic (PLEG): container finished" podID="22aee4fd-c553-48d7-9ad7-034953b9a259" containerID="dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6" exitCode=0
May 21 10:39:57.724003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.723579    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"
May 21 10:39:57.724003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.723609    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" event={"ID":"22aee4fd-c553-48d7-9ad7-034953b9a259","Type":"ContainerDied","Data":"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"}
May 21 10:39:57.724003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.723649    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9" event={"ID":"22aee4fd-c553-48d7-9ad7-034953b9a259","Type":"ContainerDied","Data":"00638a6d25f467e671e64be0fe802660b2b6743753aec0f50af429d21dd6cc82"}
May 21 10:39:57.724003 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.723665    2563 scope.go:117] "RemoveContainer" containerID="dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"
May 21 10:39:57.732396 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.732378    2563 scope.go:117] "RemoveContainer" containerID="dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"
May 21 10:39:57.732699 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:39:57.732682    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6\": container with ID starting with dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6 not found: ID does not exist" containerID="dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"
May 21 10:39:57.732746 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.732706    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6"} err="failed to get container status \"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6\": rpc error: code = NotFound desc = could not find container \"dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6\": container with ID starting with dc3ab3fb265bf591f456858a78ce6d4a5c143a75a71a3caf457e3580e7110bc6 not found: ID does not exist"
May 21 10:39:57.764606 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.764567    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:57.778037 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.778006    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jhcm9"]
May 21 10:39:57.821837 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:39:57.821803    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22aee4fd-c553-48d7-9ad7-034953b9a259" path="/var/lib/kubelet/pods/22aee4fd-c553-48d7-9ad7-034953b9a259/volumes"
May 21 10:40:09.745944 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:09.745916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:40:09.746768 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:09.746745    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:40:38.607687 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.607650    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tqfk6"]
May 21 10:40:38.608348 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.607999    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22aee4fd-c553-48d7-9ad7-034953b9a259" containerName="manager"
May 21 10:40:38.608348 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.608011    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22aee4fd-c553-48d7-9ad7-034953b9a259" containerName="manager"
May 21 10:40:38.608348 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.608060    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="22aee4fd-c553-48d7-9ad7-034953b9a259" containerName="manager"
May 21 10:40:38.611120 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.611094    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.617305 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.617281    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 10:40:38.617618 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.617596    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xcgbh\""
May 21 10:40:38.629897 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.629865    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tqfk6"]
May 21 10:40:38.675066 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.675024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqrr\" (UniqueName: \"kubernetes.io/projected/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-kube-api-access-cpqrr\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.675289 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.675107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-data\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.776004 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.775962    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-data\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.776190 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.776046    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqrr\" (UniqueName: \"kubernetes.io/projected/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-kube-api-access-cpqrr\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.776478 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.776458    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-data\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.790539 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.790504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqrr\" (UniqueName: \"kubernetes.io/projected/37d9b176-162b-4fe5-8e3b-21fb1c594bc1-kube-api-access-cpqrr\") pod \"postgres-68c4fbbd6f-tqfk6\" (UID: \"37d9b176-162b-4fe5-8e3b-21fb1c594bc1\") " pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:38.922388 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:38.922343    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:39.056556 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:39.056517    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tqfk6"]
May 21 10:40:39.059806 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:40:39.059772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d9b176_162b_4fe5_8e3b_21fb1c594bc1.slice/crio-52d810bee3ffee383acb770660bd38fd9eaa0d6014f16191d7fc75e76da9a747 WatchSource:0}: Error finding container 52d810bee3ffee383acb770660bd38fd9eaa0d6014f16191d7fc75e76da9a747: Status 404 returned error can't find the container with id 52d810bee3ffee383acb770660bd38fd9eaa0d6014f16191d7fc75e76da9a747
May 21 10:40:39.870827 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:39.870794    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-tqfk6" event={"ID":"37d9b176-162b-4fe5-8e3b-21fb1c594bc1","Type":"ContainerStarted","Data":"52d810bee3ffee383acb770660bd38fd9eaa0d6014f16191d7fc75e76da9a747"}
May 21 10:40:44.893135 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:44.893090    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-tqfk6" event={"ID":"37d9b176-162b-4fe5-8e3b-21fb1c594bc1","Type":"ContainerStarted","Data":"c767423a3b6b807c7c8cb3d7759c66d27088eb4990df0a91554eea7c2a6d46da"}
May 21 10:40:44.893562 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:44.893236    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:40:44.911442 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:44.911379    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-tqfk6" podStartSLOduration=1.934236157 podStartE2EDuration="6.911356752s" podCreationTimestamp="2026-05-21 10:40:38 +0000 UTC" firstStartedPulling="2026-05-21 10:40:39.061462452 +0000 UTC m=+629.811566230" lastFinishedPulling="2026-05-21 10:40:44.038583044 +0000 UTC m=+634.788686825" observedRunningTime="2026-05-21 10:40:44.909656553 +0000 UTC m=+635.659760343" watchObservedRunningTime="2026-05-21 10:40:44.911356752 +0000 UTC m=+635.661460541"
May 21 10:40:50.925895 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:40:50.925856    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-tqfk6"
May 21 10:42:00.029927 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.029843    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"]
May 21 10:42:00.032983 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.032966    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.037157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.037131    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 10:42:00.037157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.037145    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tnd62\""
May 21 10:42:00.037376 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.037320    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 10:42:00.037471 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.037456    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 10:42:00.043057 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.043035    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"]
May 21 10:42:00.089814 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.089762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c3f388-1447-4ea0-96d0-2b4527ba2946-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.090001 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.089891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.090001 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.089962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.090125 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.090005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.090125 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.090035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.090125 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.090098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldxl\" (UniqueName: \"kubernetes.io/projected/09c3f388-1447-4ea0-96d0-2b4527ba2946-kube-api-access-xldxl\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191187 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191138    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c3f388-1447-4ea0-96d0-2b4527ba2946-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191258    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191299    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191326    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191413 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191376    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xldxl\" (UniqueName: \"kubernetes.io/projected/09c3f388-1447-4ea0-96d0-2b4527ba2946-kube-api-access-xldxl\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191783 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.191850 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.191835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.192026 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.192006    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.193679 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.193655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09c3f388-1447-4ea0-96d0-2b4527ba2946-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.193825 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.193810    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c3f388-1447-4ea0-96d0-2b4527ba2946-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.205622 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.205578    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldxl\" (UniqueName: \"kubernetes.io/projected/09c3f388-1447-4ea0-96d0-2b4527ba2946-kube-api-access-xldxl\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl\" (UID: \"09c3f388-1447-4ea0-96d0-2b4527ba2946\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.345222 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.345101    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:00.482547 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.482520    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"]
May 21 10:42:00.484649 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:42:00.484622    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c3f388_1447_4ea0_96d0_2b4527ba2946.slice/crio-895d2cdd6cc43574307da5f04ddd74b714376855a4134ec179bdbf8f23bf5816 WatchSource:0}: Error finding container 895d2cdd6cc43574307da5f04ddd74b714376855a4134ec179bdbf8f23bf5816: Status 404 returned error can't find the container with id 895d2cdd6cc43574307da5f04ddd74b714376855a4134ec179bdbf8f23bf5816
May 21 10:42:00.486632 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:00.486614    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 10:42:01.157822 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:01.157783    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl" event={"ID":"09c3f388-1447-4ea0-96d0-2b4527ba2946","Type":"ContainerStarted","Data":"895d2cdd6cc43574307da5f04ddd74b714376855a4134ec179bdbf8f23bf5816"}
May 21 10:42:04.916390 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:04.916330    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"]
May 21 10:42:04.943306 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:04.943234    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"]
May 21 10:42:04.943522 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:04.943390    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:04.946503 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:04.946469    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 10:42:05.032448 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k4tf\" (UniqueName: \"kubernetes.io/projected/1e52641e-d175-4eb7-a594-7c52475e0b71-kube-api-access-4k4tf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.032645 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e52641e-d175-4eb7-a594-7c52475e0b71-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.032645 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.032645 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.032837 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.032837 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.032674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134140    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k4tf\" (UniqueName: \"kubernetes.io/projected/1e52641e-d175-4eb7-a594-7c52475e0b71-kube-api-access-4k4tf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134249    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e52641e-d175-4eb7-a594-7c52475e0b71-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134294    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134322    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134414    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.134870 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134443    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.135339 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134981    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.135339 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.134994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.135339 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.135191    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.136880 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.136855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e52641e-d175-4eb7-a594-7c52475e0b71-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.137588 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.137567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e52641e-d175-4eb7-a594-7c52475e0b71-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.143249 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.143227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k4tf\" (UniqueName: \"kubernetes.io/projected/1e52641e-d175-4eb7-a594-7c52475e0b71-kube-api-access-4k4tf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5\" (UID: \"1e52641e-d175-4eb7-a594-7c52475e0b71\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:05.256171 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:05.256091    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:06.736160 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:06.736131    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"]
May 21 10:42:06.738952 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:42:06.738921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e52641e_d175_4eb7_a594_7c52475e0b71.slice/crio-50ea250e55a5834971f44eb541573bd996edfc41d4436a168bb4b6c4ffcb0773 WatchSource:0}: Error finding container 50ea250e55a5834971f44eb541573bd996edfc41d4436a168bb4b6c4ffcb0773: Status 404 returned error can't find the container with id 50ea250e55a5834971f44eb541573bd996edfc41d4436a168bb4b6c4ffcb0773
May 21 10:42:07.188455 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:07.188414    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl" event={"ID":"09c3f388-1447-4ea0-96d0-2b4527ba2946","Type":"ContainerStarted","Data":"be7b753b229e417af13a9ddb1f34e40a7bafde36820c2238714e79cb9e1b632b"}
May 21 10:42:07.190240 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:07.190186    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5" event={"ID":"1e52641e-d175-4eb7-a594-7c52475e0b71","Type":"ContainerStarted","Data":"dcfc9d1b211d47e57d62f1ba47b5145959bae4c8bf4169a0d48af251bd91bb4c"}
May 21 10:42:07.190399 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:07.190248    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5" event={"ID":"1e52641e-d175-4eb7-a594-7c52475e0b71","Type":"ContainerStarted","Data":"50ea250e55a5834971f44eb541573bd996edfc41d4436a168bb4b6c4ffcb0773"}
May 21 10:42:13.223620 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:13.223584    2563 generic.go:358] "Generic (PLEG): container finished" podID="09c3f388-1447-4ea0-96d0-2b4527ba2946" containerID="be7b753b229e417af13a9ddb1f34e40a7bafde36820c2238714e79cb9e1b632b" exitCode=0
May 21 10:42:13.223995 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:13.223658    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl" event={"ID":"09c3f388-1447-4ea0-96d0-2b4527ba2946","Type":"ContainerDied","Data":"be7b753b229e417af13a9ddb1f34e40a7bafde36820c2238714e79cb9e1b632b"}
May 21 10:42:15.234276 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:15.234239    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl" event={"ID":"09c3f388-1447-4ea0-96d0-2b4527ba2946","Type":"ContainerStarted","Data":"35159a6f4f5fd08be22bc48f4aa5dd73181134d1339434a35063cefd4b3faeb4"}
May 21 10:42:15.234699 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:15.234456    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:15.254250 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:15.254166    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl" podStartSLOduration=1.193553593 podStartE2EDuration="15.254144158s" podCreationTimestamp="2026-05-21 10:42:00 +0000 UTC" firstStartedPulling="2026-05-21 10:42:00.486775294 +0000 UTC m=+711.236879060" lastFinishedPulling="2026-05-21 10:42:14.547365859 +0000 UTC m=+725.297469625" observedRunningTime="2026-05-21 10:42:15.253379683 +0000 UTC m=+726.003483470" watchObservedRunningTime="2026-05-21 10:42:15.254144158 +0000 UTC m=+726.004247947"
May 21 10:42:16.245231 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:16.245181    2563 generic.go:358] "Generic (PLEG): container finished" podID="1e52641e-d175-4eb7-a594-7c52475e0b71" containerID="dcfc9d1b211d47e57d62f1ba47b5145959bae4c8bf4169a0d48af251bd91bb4c" exitCode=0
May 21 10:42:16.245700 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:16.245267    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5" event={"ID":"1e52641e-d175-4eb7-a594-7c52475e0b71","Type":"ContainerDied","Data":"dcfc9d1b211d47e57d62f1ba47b5145959bae4c8bf4169a0d48af251bd91bb4c"}
May 21 10:42:17.250288 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:17.250243    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5" event={"ID":"1e52641e-d175-4eb7-a594-7c52475e0b71","Type":"ContainerStarted","Data":"670ff076db4f6ea191fa561185b80d43aaf599278f54f689733cd474ccdd19a9"}
May 21 10:42:17.250692 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:17.250448    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:17.271549 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:17.271480    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5" podStartSLOduration=12.987924231000001 podStartE2EDuration="13.271461312s" podCreationTimestamp="2026-05-21 10:42:04 +0000 UTC" firstStartedPulling="2026-05-21 10:42:16.24597292 +0000 UTC m=+726.996076686" lastFinishedPulling="2026-05-21 10:42:16.529509996 +0000 UTC m=+727.279613767" observedRunningTime="2026-05-21 10:42:17.270508921 +0000 UTC m=+728.020612709" watchObservedRunningTime="2026-05-21 10:42:17.271461312 +0000 UTC m=+728.021565102"
May 21 10:42:18.121447 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.121406    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"]
May 21 10:42:18.126051 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.126030    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.128943 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.128921    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 10:42:18.136502 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.136475    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"]
May 21 10:42:18.257383 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0249ff4-3597-48be-8dd0-67aad5e736e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.257782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.257782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.257782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxz6\" (UniqueName: \"kubernetes.io/projected/b0249ff4-3597-48be-8dd0-67aad5e736e9-kube-api-access-klxz6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.257782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.257782 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.257530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358305 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358271    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358490 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358318    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0249ff4-3597-48be-8dd0-67aad5e736e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358490 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358358    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358490 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358392    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358490 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358417    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klxz6\" (UniqueName: \"kubernetes.io/projected/b0249ff4-3597-48be-8dd0-67aad5e736e9-kube-api-access-klxz6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358694 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358492    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358769 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358742    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.358831 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.358798    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.359050 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.359027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.360792 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.360766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0249ff4-3597-48be-8dd0-67aad5e736e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.361010 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.360990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0249ff4-3597-48be-8dd0-67aad5e736e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.367168 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.367144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxz6\" (UniqueName: \"kubernetes.io/projected/b0249ff4-3597-48be-8dd0-67aad5e736e9-kube-api-access-klxz6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz\" (UID: \"b0249ff4-3597-48be-8dd0-67aad5e736e9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.437086 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.436991    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:18.580743 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:18.580695    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"]
May 21 10:42:18.583565 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:42:18.583537    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0249ff4_3597_48be_8dd0_67aad5e736e9.slice/crio-9ee7dc0d782d3de3fe21220f10206e8ffb604c1f4da64e5882ec72f6a6ba14ee WatchSource:0}: Error finding container 9ee7dc0d782d3de3fe21220f10206e8ffb604c1f4da64e5882ec72f6a6ba14ee: Status 404 returned error can't find the container with id 9ee7dc0d782d3de3fe21220f10206e8ffb604c1f4da64e5882ec72f6a6ba14ee
May 21 10:42:19.258253 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:19.258189    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz" event={"ID":"b0249ff4-3597-48be-8dd0-67aad5e736e9","Type":"ContainerStarted","Data":"532075108f1f77c47d6c482b1ae3968fe5e2d52f1d2d324a860698a89a1ed255"}
May 21 10:42:19.258253 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:19.258257    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz" event={"ID":"b0249ff4-3597-48be-8dd0-67aad5e736e9","Type":"ContainerStarted","Data":"9ee7dc0d782d3de3fe21220f10206e8ffb604c1f4da64e5882ec72f6a6ba14ee"}
May 21 10:42:25.283364 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:25.283328    2563 generic.go:358] "Generic (PLEG): container finished" podID="b0249ff4-3597-48be-8dd0-67aad5e736e9" containerID="532075108f1f77c47d6c482b1ae3968fe5e2d52f1d2d324a860698a89a1ed255" exitCode=0
May 21 10:42:25.283792 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:25.283401    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz" event={"ID":"b0249ff4-3597-48be-8dd0-67aad5e736e9","Type":"ContainerDied","Data":"532075108f1f77c47d6c482b1ae3968fe5e2d52f1d2d324a860698a89a1ed255"}
May 21 10:42:26.258683 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:26.258653    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl"
May 21 10:42:26.289163 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:26.289121    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz" event={"ID":"b0249ff4-3597-48be-8dd0-67aad5e736e9","Type":"ContainerStarted","Data":"8e0aa6c33789d0b5303b989279d592bc8f5524db92609fc5d69f88673fd35811"}
May 21 10:42:26.289657 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:26.289452    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:26.309857 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:26.309803    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz" podStartSLOduration=7.864422879 podStartE2EDuration="8.309788019s" podCreationTimestamp="2026-05-21 10:42:18 +0000 UTC" firstStartedPulling="2026-05-21 10:42:25.284039943 +0000 UTC m=+736.034143709" lastFinishedPulling="2026-05-21 10:42:25.729405075 +0000 UTC m=+736.479508849" observedRunningTime="2026-05-21 10:42:26.308818688 +0000 UTC m=+737.058922479" watchObservedRunningTime="2026-05-21 10:42:26.309788019 +0000 UTC m=+737.059891807"
May 21 10:42:28.267738 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:28.267707    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5"
May 21 10:42:37.306109 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:37.306072    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz"
May 21 10:42:46.318012 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.317974    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"]
May 21 10:42:46.351960 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.351926    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"]
May 21 10:42:46.352132 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.352082    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.355211 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.355179    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 10:42:46.416537 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b903a6fa-1483-487b-9102-7e7297d9a5e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.416717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.416717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99p72\" (UniqueName: \"kubernetes.io/projected/b903a6fa-1483-487b-9102-7e7297d9a5e6-kube-api-access-99p72\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.416717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.416717 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.416852 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.416724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.517957 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.517921    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b903a6fa-1483-487b-9102-7e7297d9a5e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.517977    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518009    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99p72\" (UniqueName: \"kubernetes.io/projected/b903a6fa-1483-487b-9102-7e7297d9a5e6-kube-api-access-99p72\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518045    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518071    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518157 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518133    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518608 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518585    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518682 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518610    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.518682 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.518644    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.520641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.520615    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b903a6fa-1483-487b-9102-7e7297d9a5e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.520753 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.520699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b903a6fa-1483-487b-9102-7e7297d9a5e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.527770 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.527742    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99p72\" (UniqueName: \"kubernetes.io/projected/b903a6fa-1483-487b-9102-7e7297d9a5e6-kube-api-access-99p72\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26\" (UID: \"b903a6fa-1483-487b-9102-7e7297d9a5e6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.663122 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.663080    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:46.814700 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:46.814673    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"]
May 21 10:42:46.816998 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:42:46.816966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb903a6fa_1483_487b_9102_7e7297d9a5e6.slice/crio-055e76de0cdc5d993b8c2d80d8873e1efb262adfa8eab882fcbd631722e7970b WatchSource:0}: Error finding container 055e76de0cdc5d993b8c2d80d8873e1efb262adfa8eab882fcbd631722e7970b: Status 404 returned error can't find the container with id 055e76de0cdc5d993b8c2d80d8873e1efb262adfa8eab882fcbd631722e7970b
May 21 10:42:47.373612 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:47.373571    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26" event={"ID":"b903a6fa-1483-487b-9102-7e7297d9a5e6","Type":"ContainerStarted","Data":"09b4310468afa0d71e9c564d5cdf2bce2d17a20aa294b52e286296909e028949"}
May 21 10:42:47.374100 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:47.373621    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26" event={"ID":"b903a6fa-1483-487b-9102-7e7297d9a5e6","Type":"ContainerStarted","Data":"055e76de0cdc5d993b8c2d80d8873e1efb262adfa8eab882fcbd631722e7970b"}
May 21 10:42:53.399094 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:53.399050    2563 generic.go:358] "Generic (PLEG): container finished" podID="b903a6fa-1483-487b-9102-7e7297d9a5e6" containerID="09b4310468afa0d71e9c564d5cdf2bce2d17a20aa294b52e286296909e028949" exitCode=0
May 21 10:42:53.399094 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:53.399097    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26" event={"ID":"b903a6fa-1483-487b-9102-7e7297d9a5e6","Type":"ContainerDied","Data":"09b4310468afa0d71e9c564d5cdf2bce2d17a20aa294b52e286296909e028949"}
May 21 10:42:54.405109 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:54.405070    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26" event={"ID":"b903a6fa-1483-487b-9102-7e7297d9a5e6","Type":"ContainerStarted","Data":"091fcceb32b6aa7a6b3361d0bd829d76909e290dac7adc025f06cccd49a8b52c"}
May 21 10:42:54.405532 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:54.405376    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:42:54.426533 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:42:54.426473    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26" podStartSLOduration=8.142471399 podStartE2EDuration="8.426458233s" podCreationTimestamp="2026-05-21 10:42:46 +0000 UTC" firstStartedPulling="2026-05-21 10:42:53.399770747 +0000 UTC m=+764.149874513" lastFinishedPulling="2026-05-21 10:42:53.683757564 +0000 UTC m=+764.433861347" observedRunningTime="2026-05-21 10:42:54.423486827 +0000 UTC m=+765.173590628" watchObservedRunningTime="2026-05-21 10:42:54.426458233 +0000 UTC m=+765.176562020"
May 21 10:43:05.422418 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:43:05.422384    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26"
May 21 10:45:09.779209 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:45:09.779116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:45:09.779209 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:45:09.779116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:50:09.814910 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:50:09.814882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:50:09.815451 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:50:09.815269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:54:49.547912 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:49.547877    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:54:49.550407 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:49.548096    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" podUID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" containerName="manager" containerID="cri-o://bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1" gracePeriod=10
May 21 10:54:50.895596 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:50.895573    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:54:51.039301 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.039191    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume\") pod \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") "
May 21 10:54:51.039469 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.039305    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdvbv\" (UniqueName: \"kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv\") pod \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\" (UID: \"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5\") "
May 21 10:54:51.039598 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.039571    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" (UID: "b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 10:54:51.041347 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.041320    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv" (OuterVolumeSpecName: "kube-api-access-bdvbv") pod "b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" (UID: "b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5"). InnerVolumeSpecName "kube-api-access-bdvbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 10:54:51.087483 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.087443    2563 generic.go:358] "Generic (PLEG): container finished" podID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" containerID="bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1" exitCode=0
May 21 10:54:51.087675 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.087512    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"
May 21 10:54:51.087675 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.087526    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" event={"ID":"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5","Type":"ContainerDied","Data":"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"}
May 21 10:54:51.087675 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.087574    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld" event={"ID":"b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5","Type":"ContainerDied","Data":"3ddef6611540ea8f3e6314864f9be88cd04cc7498686395383fbf871be585cb1"}
May 21 10:54:51.087675 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.087598    2563 scope.go:117] "RemoveContainer" containerID="bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"
May 21 10:54:51.096956 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.096936    2563 scope.go:117] "RemoveContainer" containerID="bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"
May 21 10:54:51.097188 ip-10-0-142-243 kubenswrapper[2563]: E0521 10:54:51.097169    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1\": container with ID starting with bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1 not found: ID does not exist" containerID="bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"
May 21 10:54:51.097281 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.097226    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1"} err="failed to get container status \"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1\": rpc error: code = NotFound desc = could not find container \"bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1\": container with ID starting with bf3ce6cb0c056f3a51734cbfc2f48a3ef0988e72e754468486e830bcf89b9ae1 not found: ID does not exist"
May 21 10:54:51.114244 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.114216    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:54:51.119801 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.119776    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k52ld"]
May 21 10:54:51.140615 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.140588    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdvbv\" (UniqueName: \"kubernetes.io/projected/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-kube-api-access-bdvbv\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:54:51.140615 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.140614    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5-extensions-socket-volume\") on node \"ip-10-0-142-243.ec2.internal\" DevicePath \"\""
May 21 10:54:51.821428 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:54:51.821395    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" path="/var/lib/kubelet/pods/b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5/volumes"
May 21 10:55:09.842993 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:09.842966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:55:09.845641 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:09.845613    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 10:55:55.893500 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.893462    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"]
May 21 10:55:55.893951 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.893812    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" containerName="manager"
May 21 10:55:55.893951 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.893824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" containerName="manager"
May 21 10:55:55.893951 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.893895    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9ee78bc-0ac7-42d9-a075-fc7c7fbc22f5" containerName="manager"
May 21 10:55:55.896709 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.896692    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:55.899969 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.899949    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2qs6\""
May 21 10:55:55.918031 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.918005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slhxz\" (UniqueName: \"kubernetes.io/projected/5c3b3cc4-550e-483a-a51d-2c80812080b1-kube-api-access-slhxz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:55.918159 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.918075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3b3cc4-550e-483a-a51d-2c80812080b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:55.919022 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:55.918999    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"]
May 21 10:55:56.018852 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.018813    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slhxz\" (UniqueName: \"kubernetes.io/projected/5c3b3cc4-550e-483a-a51d-2c80812080b1-kube-api-access-slhxz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:56.019042 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.018884    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3b3cc4-550e-483a-a51d-2c80812080b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:56.019221 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.019186    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3b3cc4-550e-483a-a51d-2c80812080b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:56.032382 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.032349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slhxz\" (UniqueName: \"kubernetes.io/projected/5c3b3cc4-550e-483a-a51d-2c80812080b1-kube-api-access-slhxz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rbdqn\" (UID: \"5c3b3cc4-550e-483a-a51d-2c80812080b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:56.206850 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.206755    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:56.345265 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.345238    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"]
May 21 10:55:56.346806 ip-10-0-142-243 kubenswrapper[2563]: W0521 10:55:56.346779    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3b3cc4_550e_483a_a51d_2c80812080b1.slice/crio-584dbc79fe72cf0d7efb99fb7341de3511111214bc300c4ba2f4fcf44e44589a WatchSource:0}: Error finding container 584dbc79fe72cf0d7efb99fb7341de3511111214bc300c4ba2f4fcf44e44589a: Status 404 returned error can't find the container with id 584dbc79fe72cf0d7efb99fb7341de3511111214bc300c4ba2f4fcf44e44589a
May 21 10:55:56.349065 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:56.349046    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 10:55:57.330669 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:57.330636    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn" event={"ID":"5c3b3cc4-550e-483a-a51d-2c80812080b1","Type":"ContainerStarted","Data":"40a8b312477b7cd221d56399bbef3ba8bdb8666181c5684ce912b006affe0806"}
May 21 10:55:57.330669 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:57.330674    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn" event={"ID":"5c3b3cc4-550e-483a-a51d-2c80812080b1","Type":"ContainerStarted","Data":"584dbc79fe72cf0d7efb99fb7341de3511111214bc300c4ba2f4fcf44e44589a"}
May 21 10:55:57.331082 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:57.330756    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 10:55:57.354895 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:55:57.354848    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn" podStartSLOduration=2.354834422 podStartE2EDuration="2.354834422s" podCreationTimestamp="2026-05-21 10:55:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:55:57.351769179 +0000 UTC m=+1548.101872967" watchObservedRunningTime="2026-05-21 10:55:57.354834422 +0000 UTC m=+1548.104938209"
May 21 10:56:08.336505 ip-10-0-142-243 kubenswrapper[2563]: I0521 10:56:08.336470    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rbdqn"
May 21 11:00:09.875739 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:00:09.875705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 11:00:09.878448 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:00:09.878424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 11:05:09.902853 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:09.902824    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 11:05:09.907499 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:09.907477    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mm2_b1abebf1-764f-40df-adcb-9f38e9d9cb24/ovn-acl-logging/0.log"
May 21 11:05:43.278215 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:43.278162    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-9s6sp_3a265583-e3e0-4860-97c6-64e13e67c3ae/manager/0.log"
May 21 11:05:43.851554 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:43.851514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7bxhv_0bed74ca-e6ae-4493-9b30-d34ee8abfe70/manager/2.log"
May 21 11:05:44.084736 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:44.084703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k_913f93c5-3b44-4c9b-ac87-4504ff007d55/manager/0.log"
May 21 11:05:44.307094 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:44.307066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-tqfk6_37d9b176-162b-4fe5-8e3b-21fb1c594bc1/postgres/0.log"
May 21 11:05:45.424349 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:45.424320    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/util/0.log"
May 21 11:05:45.431482 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:45.431451    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/pull/0.log"
May 21 11:05:45.437508 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:45.437486    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/extract/0.log"
May 21 11:05:45.670252 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:45.670184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-n6s4b_ae2139a0-74e9-463a-91c5-d78a08f5cdbf/manager/0.log"
May 21 11:05:45.996247 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:45.996187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l977q_90da3490-a327-4f5e-ac7f-4abe7c198f88/registry-server/0.log"
May 21 11:05:46.112443 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:46.112405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rbdqn_5c3b3cc4-550e-483a-a51d-2c80812080b1/manager/0.log"
May 21 11:05:46.777216 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:46.777166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-srdct_d8536629-e051-4054-b1ea-04f034b87d72/discovery/0.log"
May 21 11:05:46.985807 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:46.985781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798cbbc998-wjqm9_d44a871f-231a-49fe-ab83-a49e15b09d51/kube-auth-proxy/0.log"
May 21 11:05:47.653023 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:47.652984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26_b903a6fa-1483-487b-9102-7e7297d9a5e6/storage-initializer/0.log"
May 21 11:05:47.661659 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:47.661636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-qhm26_b903a6fa-1483-487b-9102-7e7297d9a5e6/main/0.log"
May 21 11:05:47.765926 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:47.765897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl_09c3f388-1447-4ea0-96d0-2b4527ba2946/storage-initializer/0.log"
May 21 11:05:47.774034 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:47.774007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-btzzl_09c3f388-1447-4ea0-96d0-2b4527ba2946/main/0.log"
May 21 11:05:48.110265 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:48.110160    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz_b0249ff4-3597-48be-8dd0-67aad5e736e9/storage-initializer/0.log"
May 21 11:05:48.117119 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:48.117085    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-c4bsz_b0249ff4-3597-48be-8dd0-67aad5e736e9/main/0.log"
May 21 11:05:48.226617 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:48.226588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5_1e52641e-d175-4eb7-a594-7c52475e0b71/storage-initializer/0.log"
May 21 11:05:48.234820 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:48.234795    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-pkwj5_1e52641e-d175-4eb7-a594-7c52475e0b71/main/0.log"
May 21 11:05:55.607765 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:55.607678    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vzck8_0449162f-5315-40ba-b822-5506e57d219d/global-pull-secret-syncer/0.log"
May 21 11:05:55.744355 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:55.744318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vlfr6_1282ea1a-d2dd-48dc-b866-036fcf17ad38/konnectivity-agent/0.log"
May 21 11:05:55.815212 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:55.815179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-243.ec2.internal_c6c67bdaff929766e0715c164801ff23/haproxy/0.log"
May 21 11:05:59.813913 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:59.813878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/extract/0.log"
May 21 11:05:59.836638 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:59.836610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/util/0.log"
May 21 11:05:59.858852 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:05:59.858819    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pgm5r_c251cc10-61ec-4c7d-addb-e6f120bbe2ba/pull/0.log"
May 21 11:06:00.134872 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:00.134843    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-n6s4b_ae2139a0-74e9-463a-91c5-d78a08f5cdbf/manager/0.log"
May 21 11:06:00.248012 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:00.247975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l977q_90da3490-a327-4f5e-ac7f-4abe7c198f88/registry-server/0.log"
May 21 11:06:00.344007 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:00.343976    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rbdqn_5c3b3cc4-550e-483a-a51d-2c80812080b1/manager/0.log"
May 21 11:06:02.208114 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.208082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rltnm_29820b0e-46d2-4b9d-9b71-e4f0107c2bae/kube-state-metrics/0.log"
May 21 11:06:02.230307 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.230271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rltnm_29820b0e-46d2-4b9d-9b71-e4f0107c2bae/kube-rbac-proxy-main/0.log"
May 21 11:06:02.251513 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.251485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rltnm_29820b0e-46d2-4b9d-9b71-e4f0107c2bae/kube-rbac-proxy-self/0.log"
May 21 11:06:02.276680 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.276652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54f4c77d8b-99rxh_3e25ab21-cdac-4255-b871-f745ba5fa93f/metrics-server/0.log"
May 21 11:06:02.334843 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.334817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bpk9_450c51c6-bcf2-4a26-9c2a-d7e6c636e578/node-exporter/0.log"
May 21 11:06:02.354313 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.354286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bpk9_450c51c6-bcf2-4a26-9c2a-d7e6c636e578/kube-rbac-proxy/0.log"
May 21 11:06:02.373970 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:02.373945    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bpk9_450c51c6-bcf2-4a26-9c2a-d7e6c636e578/init-textfile/0.log"
May 21 11:06:04.489912 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.489863    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"]
May 21 11:06:04.493565 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.493543    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.496213 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.496179    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"openshift-service-ca.crt\""
May 21 11:06:04.496346 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.496249    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjg6n\"/\"default-dockercfg-cs654\""
May 21 11:06:04.497394 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.497379    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"kube-root-ca.crt\""
May 21 11:06:04.501380 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.501358    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"]
May 21 11:06:04.528818 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.528781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-proc\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.528818 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.528824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2627\" (UniqueName: \"kubernetes.io/projected/d7b6299e-0f9a-4d9b-907a-727ea8b09335-kube-api-access-r2627\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.529034 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.528882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-lib-modules\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.529034 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.528928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-podres\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.529034 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.528958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-sys\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.629827 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629776    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-sys\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630010 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629901    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-proc\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630010 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-sys\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630010 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629934    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2627\" (UniqueName: \"kubernetes.io/projected/d7b6299e-0f9a-4d9b-907a-727ea8b09335-kube-api-access-r2627\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630010 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629965    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-lib-modules\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630010 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.630006    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-podres\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630165 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.629967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-proc\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630165 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.630129    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-podres\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.630165 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.630132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7b6299e-0f9a-4d9b-907a-727ea8b09335-lib-modules\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.639843 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.639816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2627\" (UniqueName: \"kubernetes.io/projected/d7b6299e-0f9a-4d9b-907a-727ea8b09335-kube-api-access-r2627\") pod \"perf-node-gather-daemonset-mfkql\" (UID: \"d7b6299e-0f9a-4d9b-907a-727ea8b09335\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.804627 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.804526    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:04.944407 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.944377    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"]
May 21 11:06:04.946515 ip-10-0-142-243 kubenswrapper[2563]: W0521 11:06:04.946485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7b6299e_0f9a_4d9b_907a_727ea8b09335.slice/crio-21493c23413bd8eb5a66d80869379b4cba29e5d9ef9032242ff920b29ceca2e9 WatchSource:0}: Error finding container 21493c23413bd8eb5a66d80869379b4cba29e5d9ef9032242ff920b29ceca2e9: Status 404 returned error can't find the container with id 21493c23413bd8eb5a66d80869379b4cba29e5d9ef9032242ff920b29ceca2e9
May 21 11:06:04.948097 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:04.948074    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 11:06:05.607365 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:05.607330    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql" event={"ID":"d7b6299e-0f9a-4d9b-907a-727ea8b09335","Type":"ContainerStarted","Data":"9baa25ca18f2781bc09abce1aec654d6e2bcaf19a572873a63ffb408c827e81c"}
May 21 11:06:05.607365 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:05.607366    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql" event={"ID":"d7b6299e-0f9a-4d9b-907a-727ea8b09335","Type":"ContainerStarted","Data":"21493c23413bd8eb5a66d80869379b4cba29e5d9ef9032242ff920b29ceca2e9"}
May 21 11:06:05.607857 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:05.607392    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:05.626605 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:05.626557    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql" podStartSLOduration=1.626543457 podStartE2EDuration="1.626543457s" podCreationTimestamp="2026-05-21 11:06:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:06:05.623891681 +0000 UTC m=+2156.373995471" watchObservedRunningTime="2026-05-21 11:06:05.626543457 +0000 UTC m=+2156.376647245"
May 21 11:06:06.717467 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:06.717438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vvc9_060f8229-535f-4818-bde5-2b21e1cb5536/dns/0.log"
May 21 11:06:06.737226 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:06.737179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vvc9_060f8229-535f-4818-bde5-2b21e1cb5536/kube-rbac-proxy/0.log"
May 21 11:06:06.856363 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:06.856339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5pwz_a6cd8e68-e8b0-4522-b9ae-98c890c40c17/dns-node-resolver/0.log"
May 21 11:06:07.327461 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:07.327430    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bc75b9cd-ggpnv_f2400029-90ec-4332-b87b-2919d947d3f1/registry/0.log"
May 21 11:06:07.347743 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:07.347716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7fgn_f29ca414-c08c-4f25-b9c4-934f032b34b0/node-ca/0.log"
May 21 11:06:08.400617 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:08.400581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-srdct_d8536629-e051-4054-b1ea-04f034b87d72/discovery/0.log"
May 21 11:06:08.451980 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:08.451950    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798cbbc998-wjqm9_d44a871f-231a-49fe-ab83-a49e15b09d51/kube-auth-proxy/0.log"
May 21 11:06:09.199538 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:09.199503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vtq29_80c57ce5-4aa0-42a2-bd3e-9e299bda1f39/serve-healthcheck-canary/0.log"
May 21 11:06:09.815617 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:09.815577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhvpb_f38c0a0b-6947-4244-930f-1068ec96cb2a/kube-rbac-proxy/0.log"
May 21 11:06:09.836244 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:09.836213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhvpb_f38c0a0b-6947-4244-930f-1068ec96cb2a/exporter/0.log"
May 21 11:06:09.856824 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:09.856788    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhvpb_f38c0a0b-6947-4244-930f-1068ec96cb2a/extractor/0.log"
May 21 11:06:11.620979 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:11.620945    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-mfkql"
May 21 11:06:11.887614 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:11.887518    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-9s6sp_3a265583-e3e0-4860-97c6-64e13e67c3ae/manager/0.log"
May 21 11:06:12.056144 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:12.056111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7bxhv_0bed74ca-e6ae-4493-9b30-d34ee8abfe70/manager/1.log"
May 21 11:06:12.078798 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:12.078764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7bxhv_0bed74ca-e6ae-4493-9b30-d34ee8abfe70/manager/2.log"
May 21 11:06:12.162211 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:12.162106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-9rq5k_913f93c5-3b44-4c9b-ac87-4504ff007d55/manager/0.log"
May 21 11:06:12.215388 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:12.215362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-tqfk6_37d9b176-162b-4fe5-8e3b-21fb1c594bc1/postgres/0.log"
May 21 11:06:19.921836 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:19.921802    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/kube-multus-additional-cni-plugins/0.log"
May 21 11:06:19.942806 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:19.942778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/egress-router-binary-copy/0.log"
May 21 11:06:19.963595 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:19.963564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/cni-plugins/0.log"
May 21 11:06:19.985131 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:19.985104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/bond-cni-plugin/0.log"
May 21 11:06:20.014936 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.014903    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/routeoverride-cni/0.log"
May 21 11:06:20.044723 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.044692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/whereabouts-cni-bincopy/0.log"
May 21 11:06:20.072394 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.072361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnqt2_812c2141-6d2f-4334-a705-50d6b726f927/whereabouts-cni/0.log"
May 21 11:06:20.341466 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.341380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xldp4_5ec0be34-4423-4431-b0ea-b3ad001937b7/kube-multus/0.log"
May 21 11:06:20.364156 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.364122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdfdp_a59cd83e-3ead-4201-aad4-1da906578979/network-metrics-daemon/0.log"
May 21 11:06:20.386140 ip-10-0-142-243 kubenswrapper[2563]: I0521 11:06:20.386101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdfdp_a59cd83e-3ead-4201-aad4-1da906578979/kube-rbac-proxy/0.log"