May 21 16:51:38.806376 ip-10-0-135-101 systemd[1]: Starting Kubernetes Kubelet...
May 21 16:51:39.302844 ip-10-0-135-101 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:51:39.302844 ip-10-0-135-101 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 16:51:39.302844 ip-10-0-135-101 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:51:39.302844 ip-10-0-135-101 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 16:51:39.302844 ip-10-0-135-101 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:51:39.304669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.304553    2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 16:51:39.308520 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308505    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:51:39.308520 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308519    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308523    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308527    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308530    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308532    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308537    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308541    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308550    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308553    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308555    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308558    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308561    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308563    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308566    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308568    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308571    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308574    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308576    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308579    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308581    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:51:39.308589 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308584    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308587    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308589    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308592    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308595    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308598    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308601    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308604    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308607    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308610    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308612    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308615    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308617    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308620    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308623    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308626    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308628    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308631    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308633    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308635    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:51:39.309059 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308639    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308641    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308644    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308646    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308649    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308651    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308654    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308656    2570 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308659    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308661    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308665    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308667    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308670    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308672    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308676    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308679    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308682    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308684    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308687    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308690    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:51:39.309562 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308692    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308695    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308698    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308700    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308702    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308705    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308708    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308710    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308713    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308716    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308720    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308724    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308727    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308730    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308733    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308735    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308738    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308741    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308745    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:51:39.310045 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308747    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308750    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308752    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308754    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308757    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.308760    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309155    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309161    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309163    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309166    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309169    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309172    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309174    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309177    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309180    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309182    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309185    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309187    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309191    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309193    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:51:39.310578 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309196    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309198    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309201    2570 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309203    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309206    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309208    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309211    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309214    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309216    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309218    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309221    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309223    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309226    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309228    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309231    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309233    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309236    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309239    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309241    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309245    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:51:39.311061 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309248    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309251    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309253    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309255    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309258    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309261    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309263    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309266    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309268    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309270    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309273    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309277    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309279    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309282    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309285    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309288    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309291    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309293    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309296    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309298    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:51:39.311580 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309300    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309303    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309305    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309308    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309311    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309314    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309316    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309319    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309322    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309324    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309327    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309330    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309333    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309335    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309338    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309340    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309343    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309346    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309348    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309351    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:51:39.312060 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309353    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309356    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309361    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309364    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309367    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309370    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309373    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309375    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309378    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309380    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309383    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.309385    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310781    2570 flags.go:64] FLAG: --address="0.0.0.0"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310790    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310797    2570 flags.go:64] FLAG: --anonymous-auth="true"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310802    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310806    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310809    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310814    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310819    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310822    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 16:51:39.312567 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310825    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310829    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310832    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310836    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310839    2570 flags.go:64] FLAG: --cgroup-root=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310842    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310845    2570 flags.go:64] FLAG: --client-ca-file=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310848    2570 flags.go:64] FLAG: --cloud-config=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310850    2570 flags.go:64] FLAG: --cloud-provider="external"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310854    2570 flags.go:64] FLAG: --cluster-dns="[]"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310859    2570 flags.go:64] FLAG: --cluster-domain=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310862    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310865    2570 flags.go:64] FLAG: --config-dir=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310868    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310871    2570 flags.go:64] FLAG: --container-log-max-files="5"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310875    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310879    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310882    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310886    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310889    2570 flags.go:64] FLAG: --contention-profiling="false"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310892    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310895    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310898    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310901    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310906    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 16:51:39.313096 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310909    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310912    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310915    2570 flags.go:64] FLAG: --enable-load-reader="false"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310919    2570 flags.go:64] FLAG: --enable-server="true"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310922    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310926    2570 flags.go:64] FLAG: --event-burst="100"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310929    2570 flags.go:64] FLAG: --event-qps="50"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310932    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310935    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310939    2570 flags.go:64] FLAG: --eviction-hard=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310942    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310945    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310949    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310952    2570 flags.go:64] FLAG: --eviction-soft=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310955    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310957    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310960    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310963    2570 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310966    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310969    2570 flags.go:64] FLAG: --fail-swap-on="true"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310972    2570 flags.go:64] FLAG: --feature-gates=""
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310976    2570 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310979    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310982    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310986    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310989    2570 flags.go:64] FLAG: --healthz-port="10248"
May 21 16:51:39.313698 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310992    2570 flags.go:64] FLAG: --help="false"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310995    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-135-101.ec2.internal"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.310998    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311001    2570 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311004    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311008    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311011    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311014    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311017    2570 flags.go:64] FLAG: --image-service-endpoint=""
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311020    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311023    2570 flags.go:64] FLAG: --kube-api-burst="100"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311026    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311030    2570 flags.go:64] FLAG: --kube-api-qps="50"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311032    2570 flags.go:64] FLAG: --kube-reserved=""
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311035    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311038    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311041    2570 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311044    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311047    2570 flags.go:64] FLAG: --lock-file=""
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311050    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311053    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311056    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311062    2570 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 16:51:39.314335 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311065    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311081    2570 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311084    2570 flags.go:64] FLAG: --logging-format="text"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311087    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311091    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311094    2570 flags.go:64] FLAG: --manifest-url=""
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311096    2570 flags.go:64] FLAG: --manifest-url-header=""
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311104    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311108    2570 flags.go:64] FLAG: --max-open-files="1000000"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311112    2570 flags.go:64] FLAG: --max-pods="110"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311116    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311119    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311122    2570 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311125    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311128    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311131    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311133    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311140    2570 flags.go:64] FLAG: --node-status-max-images="50"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311144    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311147    2570 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311150    2570 flags.go:64] FLAG: --pod-cidr=""
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311153    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311159    2570 flags.go:64] FLAG: --pod-manifest-path=""
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311162    2570 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 16:51:39.314896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311165    2570 flags.go:64] FLAG: --pods-per-core="0"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311168    2570 flags.go:64] FLAG: --port="10250"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311171    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311174    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d359f49251e76cbc"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311177    2570 flags.go:64] FLAG: --qos-reserved=""
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311180    2570 flags.go:64] FLAG: --read-only-port="10255"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311182    2570 flags.go:64] FLAG: --register-node="true"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311185    2570 flags.go:64] FLAG: --register-schedulable="true"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311188    2570 flags.go:64] FLAG: --register-with-taints=""
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311192    2570 flags.go:64] FLAG: --registry-burst="10"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311195    2570 flags.go:64] FLAG: --registry-qps="5"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311197    2570 flags.go:64] FLAG: --reserved-cpus=""
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311200    2570 flags.go:64] FLAG: --reserved-memory=""
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311204    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311208    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311211    2570 flags.go:64] FLAG: --rotate-certificates="false"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311214    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311218    2570 flags.go:64] FLAG: --runonce="false"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311221    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311224    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311227    2570 flags.go:64] FLAG: --seccomp-default="false"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311230    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311232    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311235    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311238    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311241    2570 flags.go:64] FLAG: --storage-driver-password="root"
May 21 16:51:39.315528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311244    2570 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311248    2570 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311251    2570 flags.go:64] FLAG: --storage-driver-user="root"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311254    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311256    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311259    2570 flags.go:64] FLAG: --system-cgroups=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311262    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311267    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311270    2570 flags.go:64] FLAG: --tls-cert-file=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311273    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311278    2570 flags.go:64] FLAG: --tls-min-version=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311283    2570 flags.go:64] FLAG: --tls-private-key-file=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311286    2570 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311289    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311292    2570 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311296    2570 flags.go:64] FLAG: --v="2"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311300    2570 flags.go:64] FLAG: --version="false"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311304    2570 flags.go:64] FLAG: --vmodule=""
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311308    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.311312    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311412    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311416    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311419    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311422    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:51:39.316184 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311425    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311428    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311430    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311433    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311435    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311439    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311443    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311446    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311448    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311451    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311454    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311457    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311459    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311463    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311466    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311469    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311472    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311475    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311477    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:51:39.316753 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311481    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311484    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311487    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311489    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311492    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311494    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311497    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311499    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311502    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311504    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311507    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311509    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311512    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311515    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311518    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311520    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311523    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311525    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311528    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:51:39.317351 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311531    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311533    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311535    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311538    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311541    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311543    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311546    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311548    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311550    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311553    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311556    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311558    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311560    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311564    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311567    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311569    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311572    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311574    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311577    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311579    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:51:39.317825 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311582    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311584    2570 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311587    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311590    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311593    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311596    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311598    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311601    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311603    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311606    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311609    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311612    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311614    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311638    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311641    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311648    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311651    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311654    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311657    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311659    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:51:39.318343 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311662    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:51:39.318868 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311665    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:51:39.318868 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311667    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:51:39.318868 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.311670    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:51:39.318868 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.312376    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:51:39.321922 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.321896    2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 16:51:39.321922 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.321921    2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.321990    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.321998    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322003    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322007    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322012    2570 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322017    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322023    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322030    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322035    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322039    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322044    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322049    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322053    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322061    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322066    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322086    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322092    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322097    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:51:39.322099 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322101    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322105    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322109    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322113    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322117    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322122    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322126    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322130    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322134    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322139    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322143    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322147    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322151    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322156    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322160    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322164    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322168    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322171    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322178    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:51:39.322935 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322184    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322188    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322192    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322196    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322201    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322205    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322209    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322213    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322217    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322223    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322227    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322231    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322235    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322239    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322243    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322248    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322253    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322257    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322261    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322266    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:51:39.323609 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322270    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322274    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322278    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322283    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322298    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322303    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322307    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322312    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322316    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322320    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322324    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322329    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322333    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322337    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322341    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322345    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322350    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322354    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322359    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322363    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:51:39.324216 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322367    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322371    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322376    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322380    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322385    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322389    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322394    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322399    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322404    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.322412    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322574    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322582    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322586    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322591    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322595    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:51:39.324770 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322600    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322604    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322608    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322612    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322617    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322621    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322625    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322629    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322633    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322637    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322641    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322646    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322650    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322654    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322658    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322662    2570 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322669    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322674    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322679    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:51:39.325405 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322683    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322689    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322693    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322698    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322702    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322707    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322712    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322716    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322720    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322724    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322729    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322733    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322737    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322742    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322746    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322750    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322755    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322759    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322763    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322767    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:51:39.326205 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322771    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322776    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322780    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322785    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322789    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322793    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322797    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322801    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322806    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322810    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322814    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322819    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322823    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322827    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322833    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322837    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322842    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322847    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322852    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322856    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:51:39.326758 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322861    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322865    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322868    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322872    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322877    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322881    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322885    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322889    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322894    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322898    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322902    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322906    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322911    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322915    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322919    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322923    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322928    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322932    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322936    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322940    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:51:39.327303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322943    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:51:39.327786 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:39.322948    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:51:39.327786 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.322956    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:51:39.327786 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.323884    2570 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 16:51:39.327972 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.327955    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 16:51:39.329098 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.329085    2570 server.go:1019] "Starting client certificate rotation"
May 21 16:51:39.329205 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.329188    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:51:39.329239 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.329233    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:51:39.359051 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.359020    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:51:39.360985 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.360958    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:51:39.379828 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.379799    2570 log.go:25] "Validated CRI v1 runtime API"
May 21 16:51:39.386765 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.386743    2570 log.go:25] "Validated CRI v1 image API"
May 21 16:51:39.388251 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.388235    2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 16:51:39.391614 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.391596    2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:51:39.392755 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.392728    2570 fs.go:135] Filesystem UUIDs: map[09f6e415-5df8-48d1-870d-bbd21d35172b:/dev/nvme0n1p4 1b1a68c4-54c1-4ff4-a344-ae6efc671e85:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 21 16:51:39.392808 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.392756    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 16:51:39.397210 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.397099    2570 manager.go:217] Machine: {Timestamp:2026-05-21 16:51:39.396579796 +0000 UTC m=+0.463185306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096425 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cc47c5471afffa80da198ec2adaf SystemUUID:ec20cc47-c547-1aff-fa80-da198ec2adaf BootID:03a5675f-fa48-4a71-9e72-b0f4fc96b527 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:dd:8d:1c:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:dd:8d:1c:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:58:e5:5f:e3:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 16:51:39.398044 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.398034    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 16:51:39.398148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.398136    2570 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 16:51:39.400869 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.400837    2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 16:51:39.401039 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.400872    2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 16:51:39.401149 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.401054    2570 topology_manager.go:138] "Creating topology manager with none policy"
May 21 16:51:39.401149 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.401067    2570 container_manager_linux.go:306] "Creating device plugin manager"
May 21 16:51:39.401149 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.401094    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:51:39.401149 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.401120    2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:51:39.402999 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.402984    2570 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:51:39.403158 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.403147    2570 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 16:51:39.405773 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.405761    2570 kubelet.go:491] "Attempting to sync node with API server"
May 21 16:51:39.405841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.405787    2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 16:51:39.405841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.405804    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 16:51:39.405841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.405819    2570 kubelet.go:397] "Adding apiserver pod source"
May 21 16:51:39.405841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.405831    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 16:51:39.407160 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.407146    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:51:39.407237 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.407171    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:51:39.410568 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.410553    2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 16:51:39.412824 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.412801    2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 16:51:39.413768 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413753    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 16:51:39.413768 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413770    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413777    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413782    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413790    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413796    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413802    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413808    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413815    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413821    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 16:51:39.413901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.413846    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 16:51:39.414233 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.414225    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 16:51:39.416119 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.416105    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 16:51:39.416119 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.416122    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 16:51:39.417167 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.417145    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 16:51:39.417238 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.417146    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 16:51:39.419890 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.419869    2570 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 16:51:39.419959 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.419951    2570 server.go:1295] "Started kubelet"
May 21 16:51:39.420050 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.420019    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 16:51:39.420289 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.420052    2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 16:51:39.420396 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.420314    2570 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 16:51:39.420797 ip-10-0-135-101 systemd[1]: Started Kubernetes Kubelet.
May 21 16:51:39.421721 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.421705    2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 16:51:39.423194 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.423169    2570 server.go:317] "Adding debug handlers to kubelet server"
May 21 16:51:39.428742 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.428719    2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 16:51:39.429209 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.429188    2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 16:51:39.429835 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.428756    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-101.ec2.internal.18b1a2c6148a4629  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-101.ec2.internal,UID:ip-10-0-135-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-101.ec2.internal,},FirstTimestamp:2026-05-21 16:51:39.419887145 +0000 UTC m=+0.486492658,LastTimestamp:2026-05-21 16:51:39.419887145 +0000 UTC m=+0.486492658,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-101.ec2.internal,}"
May 21 16:51:39.430142 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.430129    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 16:51:39.430701 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.430683    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 16:51:39.431082 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431054    2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 16:51:39.431183 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431065    2570 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 16:51:39.431183 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431098    2570 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 16:51:39.431183 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431168    2570 reconstruct.go:97] "Volume reconstruction finished"
May 21 16:51:39.431183 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431176    2570 reconciler.go:26] "Reconciler: start to sync state"
May 21 16:51:39.431371 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431358    2570 factory.go:55] Registering systemd factory
May 21 16:51:39.431419 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431407    2570 factory.go:223] Registration of the systemd container factory successfully
May 21 16:51:39.431587 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.431566    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.431687 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431620    2570 factory.go:153] Registering CRI-O factory
May 21 16:51:39.431687 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431633    2570 factory.go:223] Registration of the crio container factory successfully
May 21 16:51:39.431782 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431688    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 16:51:39.431782 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431703    2570 factory.go:103] Registering Raw factory
May 21 16:51:39.431782 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.431715    2570 manager.go:1196] Started watching for new ooms in manager
May 21 16:51:39.432058 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.432045    2570 manager.go:319] Starting recovery of all containers
May 21 16:51:39.434650 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.434628    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 16:51:39.435123 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.435054    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 16:51:39.441801 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.441771    2570 manager.go:324] Recovery completed
May 21 16:51:39.446403 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.446353    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pmzc7"
May 21 16:51:39.447101 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.447088    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.448865 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.448851    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.448911 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.448880    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.448911 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.448890    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.449362 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.449347    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 16:51:39.449362 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.449360    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 16:51:39.449426 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.449378    2570 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:51:39.450808 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.450743    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-101.ec2.internal.18b1a2c61644794b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-101.ec2.internal,UID:ip-10-0-135-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-101.ec2.internal,},FirstTimestamp:2026-05-21 16:51:39.448867147 +0000 UTC m=+0.515472658,LastTimestamp:2026-05-21 16:51:39.448867147 +0000 UTC m=+0.515472658,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-101.ec2.internal,}"
May 21 16:51:39.452209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.452196    2570 policy_none.go:49] "None policy: Start"
May 21 16:51:39.452262 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.452214    2570 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 16:51:39.452262 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.452224    2570 state_mem.go:35] "Initializing new in-memory state store"
May 21 16:51:39.455340 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.455177    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pmzc7"
May 21 16:51:39.494704 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.494686    2570 manager.go:341] "Starting Device Plugin manager"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.494724    2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.494737    2570 server.go:85] "Starting device plugin registration server"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.494967    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.494978    2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.495096    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.495196    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.495205    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.495667    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 16:51:39.499597 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.495699    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.521308 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.521278    2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 16:51:39.522446 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.522433    2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 16:51:39.522523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.522462    2570 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 16:51:39.522523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.522485    2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 16:51:39.522523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.522494    2570 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 16:51:39.522650 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.522539    2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 16:51:39.528969 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.528953    2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:51:39.595205 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.595122    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.596029 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.596010    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.596136 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.596040    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.596136 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.596052    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.596136 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.596098    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-101.ec2.internal"
May 21 16:51:39.608153 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.608134    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-101.ec2.internal"
May 21 16:51:39.608239 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.608161    2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-101.ec2.internal\": node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.621375 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.621351    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.623437 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.623421    2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"]
May 21 16:51:39.623488 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.623480    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.624994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.624979    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.625058 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.625011    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.625058 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.625022    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.626266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626253    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.626430 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626416    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.626470 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626443    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.626905 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626892    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.626984 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626911    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.626984 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626922    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.626984 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626958    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.626984 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626979    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.627159 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.626993    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.627889 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.627874    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.627969 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.627899    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:51:39.628514 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.628500    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:51:39.628599 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.628526    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:51:39.628599 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.628540    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeHasSufficientPID"
May 21 16:51:39.632658 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.632643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.632725 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.632667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7351469ed0e965f52e9a91736742ff82-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"7351469ed0e965f52e9a91736742ff82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.632725 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.632700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.645673 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.645648    2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-101.ec2.internal\" not found" node="ip-10-0-135-101.ec2.internal"
May 21 16:51:39.649202 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.649184    2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-101.ec2.internal\" not found" node="ip-10-0-135-101.ec2.internal"
May 21 16:51:39.722089 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.722033    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.732863 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732827    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.732863 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732865    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.733038 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732894    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7351469ed0e965f52e9a91736742ff82-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"7351469ed0e965f52e9a91736742ff82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.733038 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732925    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7351469ed0e965f52e9a91736742ff82-config\") pod \"kube-apiserver-proxy-ip-10-0-135-101.ec2.internal\" (UID: \"7351469ed0e965f52e9a91736742ff82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.733038 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732927    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.733038 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.732927    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3b3e926d68173954090dcf483b5a34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal\" (UID: \"0b3b3e926d68173954090dcf483b5a34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.822891 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.822854    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.923675 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:39.923607    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:39.948100 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.948058    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:39.951849 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:39.951826    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:40.024741 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.024703    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.125290 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.125252    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.225880 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.225792    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.326555 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.326522    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.328703 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.328685    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 16:51:40.328866 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.328847    2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 16:51:40.368747 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.368718    2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:51:40.426697 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.426659    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.430929 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.430908    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 16:51:40.441873 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.441849    2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:51:40.456031 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:40.456001    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7351469ed0e965f52e9a91736742ff82.slice/crio-901d61bd642c0ca0aa98a0ccec961deb5ccbb785165ae34dfa9f43ff6513ea5a WatchSource:0}: Error finding container 901d61bd642c0ca0aa98a0ccec961deb5ccbb785165ae34dfa9f43ff6513ea5a: Status 404 returned error can't find the container with id 901d61bd642c0ca0aa98a0ccec961deb5ccbb785165ae34dfa9f43ff6513ea5a
May 21 16:51:40.456355 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:40.456334    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3b3e926d68173954090dcf483b5a34.slice/crio-e687a41eb1d51d9c3c16fc11e1bce45449f2166a77015550f3f57a293ce052e3 WatchSource:0}: Error finding container e687a41eb1d51d9c3c16fc11e1bce45449f2166a77015550f3f57a293ce052e3: Status 404 returned error can't find the container with id e687a41eb1d51d9c3c16fc11e1bce45449f2166a77015550f3f57a293ce052e3
May 21 16:51:40.457452 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.457432    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 16:46:39 +0000 UTC" deadline="2028-02-22 20:22:03.758104276 +0000 UTC"
May 21 16:51:40.457497 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.457453    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15411h30m23.30065469s"
May 21 16:51:40.460509 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.460495    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:51:40.499439 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.499354    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qflpc"
May 21 16:51:40.508011 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.507992    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qflpc"
May 21 16:51:40.525805 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.525762    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"0b3b3e926d68173954090dcf483b5a34","Type":"ContainerStarted","Data":"e687a41eb1d51d9c3c16fc11e1bce45449f2166a77015550f3f57a293ce052e3"}
May 21 16:51:40.526649 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.526629    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" event={"ID":"7351469ed0e965f52e9a91736742ff82","Type":"ContainerStarted","Data":"901d61bd642c0ca0aa98a0ccec961deb5ccbb785165ae34dfa9f43ff6513ea5a"}
May 21 16:51:40.527745 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.527731    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.628240 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.628211    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.662540 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.662515    2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:51:40.728814 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:40.728771    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-101.ec2.internal\" not found"
May 21 16:51:40.769921 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.769845    2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:51:40.831229 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.831204    2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal"
May 21 16:51:40.869154 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.869125    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:51:40.870253 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.870214    2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal"
May 21 16:51:40.884736 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:40.884606    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:51:41.407757 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.407727    2570 apiserver.go:52] "Watching apiserver"
May 21 16:51:41.419326 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.419258    2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 16:51:41.421067 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.421033    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9d6bm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal","openshift-network-operator/iptables-alerter-jspsc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp","openshift-image-registry/node-ca-q8mgq","openshift-multus/multus-additional-cni-plugins-l26pl","openshift-multus/multus-tf4ng","openshift-multus/network-metrics-daemon-fvlmp","openshift-network-diagnostics/network-check-target-nj9vt","openshift-ovn-kubernetes/ovnkube-node-9nfr2","kube-system/konnectivity-agent-4jtfc"]
May 21 16:51:41.422425 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.422406    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.423484 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.423459    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.424733 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.424712    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.425013 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.424995    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 16:51:41.425260 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.425172    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 16:51:41.425260 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.425186    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q9m4g\""
May 21 16:51:41.425260 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.425186    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 16:51:41.425938 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.425911    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.426036 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.426015    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:41.426494 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.426250    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 16:51:41.426494 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.426311    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 16:51:41.426494 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.426397    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 16:51:41.426494 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.426465    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqqb9\""
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427093    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427142    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.427198    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427285    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhqf6\""
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427290    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 16:51:41.427465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427340    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 16:51:41.427799 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427513    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 16:51:41.427799 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.427582    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 16:51:41.428399 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.428382    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.429609 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.429591    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.431028 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.430988    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.431893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.431875    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f5qqm\""
May 21 16:51:41.431994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.431899    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 16:51:41.431994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.431966    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 16:51:41.431994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.431899    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 16:51:41.432162 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432002    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 16:51:41.432213 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432200    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 16:51:41.432298 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432243    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 16:51:41.432363 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432323    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vh886\""
May 21 16:51:41.432363 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432332    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 16:51:41.432552 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432516    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 16:51:41.432552 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.432526    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.433187 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.433150    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 16:51:41.433403 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.433386    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ndzfr\""
May 21 16:51:41.433555 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.433539    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.434196 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.434178    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 16:51:41.434876 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.434850    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 16:51:41.434991 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.434898    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jskjq\""
May 21 16:51:41.434991 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.434898    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 16:51:41.435383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.435366    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 16:51:41.435854 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.435838    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 16:51:41.435938 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.435843    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hj2t6\""
May 21 16:51:41.442884 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.442865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-bin\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.442986 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.442891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sqr\" (UniqueName: \"kubernetes.io/projected/a3605cf4-5414-4c99-8427-98dde62979c1-kube-api-access-k8sqr\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.442986 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.442910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/913e2e52-5686-4433-9e9b-f4a220b2b163-agent-certs\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.442986 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.442929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-systemd\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.442986 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.442943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-lib-modules\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.443669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-var-lib-kubelet\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.443669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.443669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cnibin\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.443847 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysconfig\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.443847 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-etc-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.443847 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.443982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7twnj\" (UniqueName: \"kubernetes.io/projected/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-kube-api-access-7twnj\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.443982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkjzp\" (UniqueName: \"kubernetes.io/projected/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-kube-api-access-zkjzp\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.444087 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.443999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-conf\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444228 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-systemd-units\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444293 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444345 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-modprobe-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444345 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.444440 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-systemd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444440 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-node-log\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444440 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-log-socket\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444569 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-run\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444569 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-netd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444569 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-env-overrides\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444569 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2abbec04-c628-462b-8c39-66f3276bcc47-iptables-alerter-script\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.444723 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.444723 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-etc-selinux\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.444723 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-tmp\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444723 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-ovn\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444723 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkdx\" (UniqueName: \"kubernetes.io/projected/a8a068b4-42bd-49d9-985d-b66ac1394fd1-kube-api-access-hqkdx\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.444893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-host\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-tuned\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.444893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-registration-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.444893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3605cf4-5414-4c99-8427-98dde62979c1-ovn-node-metrics-cert\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.444893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8a068b4-42bd-49d9-985d-b66ac1394fd1-host\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-kubernetes\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-device-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-netns\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.444981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:41.445091 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/913e2e52-5686-4433-9e9b-f4a220b2b163-konnectivity-ca\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.445356 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-var-lib-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.445356 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.445356 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445311    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.445476 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abbec04-c628-462b-8c39-66f3276bcc47-host-slash\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-sys\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-config\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv7v5\" (UniqueName: \"kubernetes.io/projected/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-kube-api-access-wv7v5\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-socket-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8a068b4-42bd-49d9-985d-b66ac1394fd1-serviceca\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.445957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-sys-fs\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqqs7\" (UniqueName: \"kubernetes.io/projected/840a1f87-d43e-4250-a13f-499bc405092a-kube-api-access-pqqs7\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-kubelet\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-slash\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-script-lib\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv7vp\" (UniqueName: \"kubernetes.io/projected/2abbec04-c628-462b-8c39-66f3276bcc47-kube-api-access-kv7vp\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-os-release\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.447035 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.446260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.508792 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.508760    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:46:40 +0000 UTC" deadline="2027-11-16 13:22:02.043734295 +0000 UTC"
May 21 16:51:41.508792 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.508789    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13052h30m20.534949148s"
May 21 16:51:41.531842 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.531820    2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 16:51:41.546429 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546395    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-bin\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546543 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546437    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sqr\" (UniqueName: \"kubernetes.io/projected/a3605cf4-5414-4c99-8427-98dde62979c1-kube-api-access-k8sqr\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546543 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546472    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-bin\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546543 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546479    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cnibin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.546543 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-socket-dir-parent\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-bin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546587    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/913e2e52-5686-4433-9e9b-f4a220b2b163-agent-certs\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546625    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-systemd\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546651    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-lib-modules\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546690    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-var-lib-kubelet\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546722    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546748    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cnibin\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546772    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysconfig\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546779    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-lib-modules\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546780    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-var-lib-kubelet\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546813    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-etc-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546827    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-systemd\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546838    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cnibin\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546838    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546891    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546913    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-etc-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546909    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7twnj\" (UniqueName: \"kubernetes.io/projected/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-kube-api-access-7twnj\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.546966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546969    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkjzp\" (UniqueName: \"kubernetes.io/projected/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-kube-api-access-zkjzp\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.546989    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-multus\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547007    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-kubelet\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547046    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysconfig\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-etc-kubernetes\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547103    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-conf\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547106    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547122    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-systemd-units\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547164    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-systemd-units\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547189    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547225    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-modprobe-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547254    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547267    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547280    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-systemd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547226    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-conf\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547321    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-modprobe-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.547534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547332    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547323    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-node-log\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547358    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-node-log\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547340    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-systemd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547369    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-log-socket\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547399    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-log-socket\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547406    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-run\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547431    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-netd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547442    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-run\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547457    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-env-overrides\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547467    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-cni-netd\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547483    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2abbec04-c628-462b-8c39-66f3276bcc47-iptables-alerter-script\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547513    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547551    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-etc-selinux\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547651    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-etc-selinux\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547683    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-tmp\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547707    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-ovn\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.548315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547731    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkdx\" (UniqueName: \"kubernetes.io/projected/a8a068b4-42bd-49d9-985d-b66ac1394fd1-kube-api-access-hqkdx\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-system-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-hostroot\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547859    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-host\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547884    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-tuned\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547909    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-registration-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-multus-certs\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547965    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3605cf4-5414-4c99-8427-98dde62979c1-ovn-node-metrics-cert\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548004    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8a068b4-42bd-49d9-985d-b66ac1394fd1-host\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548013    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-env-overrides\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-k8s-cni-cncf-io\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.547885    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-ovn\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lds\" (UniqueName: \"kubernetes.io/projected/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-kube-api-access-h5lds\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548122    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-kubernetes\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548125    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548170    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-device-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548193    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8a068b4-42bd-49d9-985d-b66ac1394fd1-host\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.549124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548198    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-netns\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548220    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-registration-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548232    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548252    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-host\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548260    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548121    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2abbec04-c628-462b-8c39-66f3276bcc47-iptables-alerter-script\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548309    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/913e2e52-5686-4433-9e9b-f4a220b2b163-konnectivity-ca\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548432    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-kubernetes\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548467    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-run-netns\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548510    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-run-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548545    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-var-lib-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548585    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-var-lib-openvswitch\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548616    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548654    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cni-binary-copy\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-daemon-config\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548833    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abbec04-c628-462b-8c39-66f3276bcc47-host-slash\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.549904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548860    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548881    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/913e2e52-5686-4433-9e9b-f4a220b2b163-konnectivity-ca\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548908    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abbec04-c628-462b-8c39-66f3276bcc47-host-slash\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-os-release\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-conf-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.548974    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.548992    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-sys\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549098    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-sys\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.549106    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:42.049023647 +0000 UTC m=+3.115629166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549127    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549131    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-config\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549222    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549287    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-device-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549297    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549331    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv7v5\" (UniqueName: \"kubernetes.io/projected/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-kube-api-access-wv7v5\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549359    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-socket-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549385    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8a068b4-42bd-49d9-985d-b66ac1394fd1-serviceca\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.550716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549391    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-sysctl-d\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549564    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-socket-dir\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549600    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-netns\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549616    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-config\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549629    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-sys-fs\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549670    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqqs7\" (UniqueName: \"kubernetes.io/projected/840a1f87-d43e-4250-a13f-499bc405092a-kube-api-access-pqqs7\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549700    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-kubelet\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549726    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-slash\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549751    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-script-lib\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549779    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kv7vp\" (UniqueName: \"kubernetes.io/projected/2abbec04-c628-462b-8c39-66f3276bcc47-kube-api-access-kv7vp\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549796    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8a068b4-42bd-49d9-985d-b66ac1394fd1-serviceca\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549808    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-os-release\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549674    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/840a1f87-d43e-4250-a13f-499bc405092a-sys-fs\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549835    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549851    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-slash\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549958    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-os-release\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.551538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.549996    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3605cf4-5414-4c99-8427-98dde62979c1-host-kubelet\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.552317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.550313    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.552317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.550450    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3605cf4-5414-4c99-8427-98dde62979c1-ovnkube-script-lib\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.552317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.550965    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3605cf4-5414-4c99-8427-98dde62979c1-ovn-node-metrics-cert\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.552317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.551066    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/913e2e52-5686-4433-9e9b-f4a220b2b163-agent-certs\") pod \"konnectivity-agent-4jtfc\" (UID: \"913e2e52-5686-4433-9e9b-f4a220b2b163\") " pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.552317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.551785    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-etc-tuned\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.552511 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.552353    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-tmp\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.557757 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.557234    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:41.557757 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.557260    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:41.557757 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.557277    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:41.557757 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:41.557335    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:42.057318806 +0000 UTC m=+3.123924302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:41.558173 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.558060    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sqr\" (UniqueName: \"kubernetes.io/projected/a3605cf4-5414-4c99-8427-98dde62979c1-kube-api-access-k8sqr\") pod \"ovnkube-node-9nfr2\" (UID: \"a3605cf4-5414-4c99-8427-98dde62979c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.558558 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.558522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkdx\" (UniqueName: \"kubernetes.io/projected/a8a068b4-42bd-49d9-985d-b66ac1394fd1-kube-api-access-hqkdx\") pod \"node-ca-q8mgq\" (UID: \"a8a068b4-42bd-49d9-985d-b66ac1394fd1\") " pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.559998 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.559518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7twnj\" (UniqueName: \"kubernetes.io/projected/d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db-kube-api-access-7twnj\") pod \"multus-additional-cni-plugins-l26pl\" (UID: \"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db\") " pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.560271 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.560009    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv7vp\" (UniqueName: \"kubernetes.io/projected/2abbec04-c628-462b-8c39-66f3276bcc47-kube-api-access-kv7vp\") pod \"iptables-alerter-jspsc\" (UID: \"2abbec04-c628-462b-8c39-66f3276bcc47\") " pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.560862 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.560787    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkjzp\" (UniqueName: \"kubernetes.io/projected/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-kube-api-access-zkjzp\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:41.560939 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.560912    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv7v5\" (UniqueName: \"kubernetes.io/projected/b51ae6a3-a780-4344-bf3a-3d1a1a46564a-kube-api-access-wv7v5\") pod \"tuned-9d6bm\" (UID: \"b51ae6a3-a780-4344-bf3a-3d1a1a46564a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.561260 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.561238    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqqs7\" (UniqueName: \"kubernetes.io/projected/840a1f87-d43e-4250-a13f-499bc405092a-kube-api-access-pqqs7\") pod \"aws-ebs-csi-driver-node-btkdp\" (UID: \"840a1f87-d43e-4250-a13f-499bc405092a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.573105 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.573052    2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:51:41.650705 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650666    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cni-binary-copy\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650705 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650698    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-daemon-config\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650718    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-os-release\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650739    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-conf-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650776    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-conf-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650806    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650830    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-netns\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650835    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-os-release\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650859    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cnibin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650886    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-socket-dir-parent\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650910    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-bin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.650933 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650929    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-netns\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650983    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cnibin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650987    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-multus\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650994    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.650939    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-multus\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-cni-bin\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651042    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-socket-dir-parent\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651038    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-kubelet\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651066    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-var-lib-kubelet\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651089    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-etc-kubernetes\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651117    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-etc-kubernetes\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651132    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-system-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651158    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-hostroot\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651183    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-multus-certs\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651205    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-k8s-cni-cncf-io\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651226    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lds\" (UniqueName: \"kubernetes.io/projected/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-kube-api-access-h5lds\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651228    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-system-cni-dir\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651281    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-k8s-cni-cncf-io\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.651416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651297    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-multus-daemon-config\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.652053 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-hostroot\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.652053 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651358    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-host-run-multus-certs\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.652053 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.651559    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-cni-binary-copy\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.659463 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.659433    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lds\" (UniqueName: \"kubernetes.io/projected/b83ce725-bac4-47f2-8df4-8d1f79d7c0ff-kube-api-access-h5lds\") pod \"multus-tf4ng\" (UID: \"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff\") " pod="openshift-multus/multus-tf4ng"
May 21 16:51:41.734528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.734446    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jspsc"
May 21 16:51:41.742340 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.742305    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp"
May 21 16:51:41.752923 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.752900    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l26pl"
May 21 16:51:41.758538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.758519    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:51:41.765118 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.765092    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:51:41.771690 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.771674    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9d6bm"
May 21 16:51:41.779200 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.779183    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8mgq"
May 21 16:51:41.783748 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:41.783733    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tf4ng"
May 21 16:51:42.039476 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.039447    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abbec04_c628_462b_8c39_66f3276bcc47.slice/crio-cf6f7e9e02693e86f9ad6937550c9f9190ff5b7c81387cb59965aa501b890a9a WatchSource:0}: Error finding container cf6f7e9e02693e86f9ad6937550c9f9190ff5b7c81387cb59965aa501b890a9a: Status 404 returned error can't find the container with id cf6f7e9e02693e86f9ad6937550c9f9190ff5b7c81387cb59965aa501b890a9a
May 21 16:51:42.041118 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.041084    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51ae6a3_a780_4344_bf3a_3d1a1a46564a.slice/crio-0bf6f82405de3993b64231f81ab76a923e3af069ad13301ff14575572fba9482 WatchSource:0}: Error finding container 0bf6f82405de3993b64231f81ab76a923e3af069ad13301ff14575572fba9482: Status 404 returned error can't find the container with id 0bf6f82405de3993b64231f81ab76a923e3af069ad13301ff14575572fba9482
May 21 16:51:42.041421 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.041400    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20f208c_64e4_4e6c_8cd1_6b09e2c8a7db.slice/crio-c1a562d84e07a2aa01961b8398c1e3f8db3317bc4227a3e449b2ef2915eb51bb WatchSource:0}: Error finding container c1a562d84e07a2aa01961b8398c1e3f8db3317bc4227a3e449b2ef2915eb51bb: Status 404 returned error can't find the container with id c1a562d84e07a2aa01961b8398c1e3f8db3317bc4227a3e449b2ef2915eb51bb
May 21 16:51:42.042471 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.042242    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840a1f87_d43e_4250_a13f_499bc405092a.slice/crio-0ee8c6e5cb946f82d8c3d3a3b0d543cd7e1c6e5fdc657975db9409d136de3c1b WatchSource:0}: Error finding container 0ee8c6e5cb946f82d8c3d3a3b0d543cd7e1c6e5fdc657975db9409d136de3c1b: Status 404 returned error can't find the container with id 0ee8c6e5cb946f82d8c3d3a3b0d543cd7e1c6e5fdc657975db9409d136de3c1b
May 21 16:51:42.045573 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.045549    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3605cf4_5414_4c99_8427_98dde62979c1.slice/crio-4db20e6145e59eb02e3b32df6356257d6562dd151b8d5a8f745351b551120d90 WatchSource:0}: Error finding container 4db20e6145e59eb02e3b32df6356257d6562dd151b8d5a8f745351b551120d90: Status 404 returned error can't find the container with id 4db20e6145e59eb02e3b32df6356257d6562dd151b8d5a8f745351b551120d90
May 21 16:51:42.046594 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.046571    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a068b4_42bd_49d9_985d_b66ac1394fd1.slice/crio-d23601bb4db3391f6c3b15188be6ff772f46e149d7ea083fc364ef66cb554d56 WatchSource:0}: Error finding container d23601bb4db3391f6c3b15188be6ff772f46e149d7ea083fc364ef66cb554d56: Status 404 returned error can't find the container with id d23601bb4db3391f6c3b15188be6ff772f46e149d7ea083fc364ef66cb554d56
May 21 16:51:42.047995 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.047825    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83ce725_bac4_47f2_8df4_8d1f79d7c0ff.slice/crio-53d69c94f83aa0128f08f0db388ac2ed7b7fbf9f0a083f6fe063f63e7ceecc96 WatchSource:0}: Error finding container 53d69c94f83aa0128f08f0db388ac2ed7b7fbf9f0a083f6fe063f63e7ceecc96: Status 404 returned error can't find the container with id 53d69c94f83aa0128f08f0db388ac2ed7b7fbf9f0a083f6fe063f63e7ceecc96
May 21 16:51:42.050193 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:51:42.050160    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913e2e52_5686_4433_9e9b_f4a220b2b163.slice/crio-0588dfa6df50a46e3148028edf184b616ab282475bab07d8c30a3b1b2bb0261f WatchSource:0}: Error finding container 0588dfa6df50a46e3148028edf184b616ab282475bab07d8c30a3b1b2bb0261f: Status 404 returned error can't find the container with id 0588dfa6df50a46e3148028edf184b616ab282475bab07d8c30a3b1b2bb0261f
May 21 16:51:42.054383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.054365    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:42.054490 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.054477    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:42.054541 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.054532    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:43.054515413 +0000 UTC m=+4.121120912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:42.155564 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.155358    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:42.155712 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.155528    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:42.155712 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.155663    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:42.155712 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.155678    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:42.155877 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:42.155743    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:43.155717723 +0000 UTC m=+4.222323236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:42.509941 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.509898    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:46:40 +0000 UTC" deadline="2027-11-23 22:39:18.922674959 +0000 UTC"
May 21 16:51:42.509941 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.509937    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13229h47m36.412740965s"
May 21 16:51:42.532906 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.532873    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tf4ng" event={"ID":"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff","Type":"ContainerStarted","Data":"53d69c94f83aa0128f08f0db388ac2ed7b7fbf9f0a083f6fe063f63e7ceecc96"}
May 21 16:51:42.534730 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.534705    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jtfc" event={"ID":"913e2e52-5686-4433-9e9b-f4a220b2b163","Type":"ContainerStarted","Data":"0588dfa6df50a46e3148028edf184b616ab282475bab07d8c30a3b1b2bb0261f"}
May 21 16:51:42.538269 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.538201    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"4db20e6145e59eb02e3b32df6356257d6562dd151b8d5a8f745351b551120d90"}
May 21 16:51:42.539741 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.539715    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerStarted","Data":"c1a562d84e07a2aa01961b8398c1e3f8db3317bc4227a3e449b2ef2915eb51bb"}
May 21 16:51:42.542541 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.542517    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jspsc" event={"ID":"2abbec04-c628-462b-8c39-66f3276bcc47","Type":"ContainerStarted","Data":"cf6f7e9e02693e86f9ad6937550c9f9190ff5b7c81387cb59965aa501b890a9a"}
May 21 16:51:42.545786 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.544961    2570 generic.go:358] "Generic (PLEG): container finished" podID="0b3b3e926d68173954090dcf483b5a34" containerID="62724267d8ac0ba2559a36dbcf0fff1242c2c8b7b2550245059ef699a825ec4f" exitCode=0
May 21 16:51:42.545786 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.545023    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"0b3b3e926d68173954090dcf483b5a34","Type":"ContainerDied","Data":"62724267d8ac0ba2559a36dbcf0fff1242c2c8b7b2550245059ef699a825ec4f"}
May 21 16:51:42.548570 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.548047    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" event={"ID":"7351469ed0e965f52e9a91736742ff82","Type":"ContainerStarted","Data":"39af206d570c6a125210271f42eb7f28a17226d343a2b660b2f097177351352f"}
May 21 16:51:42.564109 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.562666    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8mgq" event={"ID":"a8a068b4-42bd-49d9-985d-b66ac1394fd1","Type":"ContainerStarted","Data":"d23601bb4db3391f6c3b15188be6ff772f46e149d7ea083fc364ef66cb554d56"}
May 21 16:51:42.571534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.571469    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp" event={"ID":"840a1f87-d43e-4250-a13f-499bc405092a","Type":"ContainerStarted","Data":"0ee8c6e5cb946f82d8c3d3a3b0d543cd7e1c6e5fdc657975db9409d136de3c1b"}
May 21 16:51:42.577819 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:42.577770    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9d6bm" event={"ID":"b51ae6a3-a780-4344-bf3a-3d1a1a46564a","Type":"ContainerStarted","Data":"0bf6f82405de3993b64231f81ab76a923e3af069ad13301ff14575572fba9482"}
May 21 16:51:43.066572 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.066536    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:43.066851 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.066704    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:43.066851 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.066779    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:45.066759516 +0000 UTC m=+6.133365035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:43.167460 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.167398    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:43.167624 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.167577    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:43.167624 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.167595    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:43.167624 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.167607    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:43.167778 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.167702    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:45.167682188 +0000 UTC m=+6.234287698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:43.525590 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.525442    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:43.525590 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.525490    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:43.526187 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.525589    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:43.526187 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:43.525701    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:43.595821 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.595213    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" event={"ID":"0b3b3e926d68173954090dcf483b5a34","Type":"ContainerStarted","Data":"4cf7c3db31a7878b286ec4d7f295135ea181e40efcaa43b94d62e42ef222bf01"}
May 21 16:51:43.609682 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:43.608510    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-101.ec2.internal" podStartSLOduration=3.608489797 podStartE2EDuration="3.608489797s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:51:42.577566164 +0000 UTC m=+3.644171683" watchObservedRunningTime="2026-05-21 16:51:43.608489797 +0000 UTC m=+4.675095317"
May 21 16:51:45.083140 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:45.083095    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:45.083621 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.083244    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:45.083621 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.083310    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:49.08329168 +0000 UTC m=+10.149897186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:45.183950 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:45.183879    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:45.184153 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.184092    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:45.184153 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.184130    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:45.184153 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.184144    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:45.184320 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.184210    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:49.184190906 +0000 UTC m=+10.250796418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:45.523998 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:45.523455    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:45.523998 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.523601    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:45.523998 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:45.523789    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:45.523998 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:45.523893    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:47.523296 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:47.522669    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:47.523296 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:47.522801    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:47.523296 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:47.523249    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:47.523833 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:47.523333    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:49.114152 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:49.114097    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:49.114592 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.114274    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:49.114592 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.114376    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:57.114356205 +0000 UTC m=+18.180961708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:49.215451 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:49.215410    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:49.215632 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.215617    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:49.215684 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.215639    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:49.215684 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.215651    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:49.215796 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.215710    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:57.215691944 +0000 UTC m=+18.282297445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:49.524225 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:49.524141    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:49.524225 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:49.524201    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:49.524451 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.524299    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:49.524451 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:49.524362    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:51.522694 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:51.522661    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:51.522694 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:51.522681    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:51.523237 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:51.522790    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:51.523237 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:51.522877    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:53.523534 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:53.523492    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:53.523973 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:53.523492    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:53.523973 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:53.523644    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:53.523973 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:53.523706    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:54.618306 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.618239    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-101.ec2.internal" podStartSLOduration=14.618203108 podStartE2EDuration="14.618203108s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:51:43.609664033 +0000 UTC m=+4.676269557" watchObservedRunningTime="2026-05-21 16:51:54.618203108 +0000 UTC m=+15.684808626"
May 21 16:51:54.619188 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.619163    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nr9ps"]
May 21 16:51:54.641036 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.640986    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.641274 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:54.641116    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:51:54.754902 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.754856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.755129 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.754966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-kubelet-config\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.755129 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.755019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-dbus\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856312 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.856272    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-dbus\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856500 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.856427    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856500 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.856480    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-kubelet-config\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856602 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.856500    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-dbus\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856602 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:54.856557    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c487812-0c0e-4c3c-b284-4ba24545c6b2-kubelet-config\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:54.856664 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:54.856604    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:51:54.856711 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:54.856679    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:55.356658159 +0000 UTC m=+16.423263669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:51:55.360293 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:55.360256    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:55.360454 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:55.360370    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:51:55.360454 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:55.360418    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:56.360404411 +0000 UTC m=+17.427009907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:51:55.522884 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:55.522802    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:55.523044 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:55.522804    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:55.523044 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:55.522956    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:55.523044 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:55.523028    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:56.366463 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:56.366415    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:56.366910 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:56.366568    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:51:56.366910 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:56.366635    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:51:58.366619799 +0000 UTC m=+19.433225295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:51:56.522895 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:56.522853    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:56.523093 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:56.522965    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:51:57.171975 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:57.171928    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:57.172175 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.172137    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:57.172257 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.172222    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.172200545 +0000 UTC m=+34.238806065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:51:57.273180 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:57.273135    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:57.273357 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.273328    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:51:57.273357 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.273353    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:51:57.273448 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.273363    2570 projected.go:194] Error preparing data for projected volume kube-api-access-pjd99 for pod openshift-network-diagnostics/network-check-target-nj9vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:57.273448 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.273428    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99 podName:50e8aafd-06fc-4bcb-8c87-ec761edc7550 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.273403317 +0000 UTC m=+34.340008829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjd99" (UniqueName: "kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99") pod "network-check-target-nj9vt" (UID: "50e8aafd-06fc-4bcb-8c87-ec761edc7550") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:51:57.523359 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:57.523269    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:57.523359 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:57.523318    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:57.523841 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.523405    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:57.523841 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:57.523534    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:51:58.382575 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:58.382537    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:58.382767 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:58.382711    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:51:58.382842 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:58.382784    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:02.382763242 +0000 UTC m=+23.449368750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:51:58.522753 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:58.522717    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:51:58.522930 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:58.522848    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:51:59.523279 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:59.523248    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:51:59.523705 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:51:59.523616    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:51:59.523870 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:59.523344    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:51:59.524044 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:51:59.523913    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:00.523105 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.522922    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:00.523200 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:00.523182    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:00.628283 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.628253    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp" event={"ID":"840a1f87-d43e-4250-a13f-499bc405092a","Type":"ContainerStarted","Data":"10cb8755038dba42a32c438a37372fada19451a002d7cfc7449c417c37573a1b"}
May 21 16:52:00.629444 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.629422    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9d6bm" event={"ID":"b51ae6a3-a780-4344-bf3a-3d1a1a46564a","Type":"ContainerStarted","Data":"e3159f08b34d035c1dce2009c0eb944414ff973a3fd92d805d17a8f586b736ca"}
May 21 16:52:00.630681 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.630657    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tf4ng" event={"ID":"b83ce725-bac4-47f2-8df4-8d1f79d7c0ff","Type":"ContainerStarted","Data":"3af214dc49a868d1244a8734f1236a8a08e0e6eb15b940faeb99ccc8f978886d"}
May 21 16:52:00.631861 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.631839    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jtfc" event={"ID":"913e2e52-5686-4433-9e9b-f4a220b2b163","Type":"ContainerStarted","Data":"8d412b38ba3457137d9ba36b55d572bf9564a97c136509fc2df78bcb39893cdf"}
May 21 16:52:00.633889 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.633870    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"cbe6320554676d170367b6cef432661cea951ea5e1a7310a45d7afadcfb39c48"}
May 21 16:52:00.633974 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.633894    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"559b3dc0466f2a356aa3b3167dc52c6bce97ab588cabcc5ff97d822a839f7973"}
May 21 16:52:00.633974 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.633908    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"42836936b65b3c6215df5d57c360937ca42154d6af20796a4a5f609279090fd2"}
May 21 16:52:00.633974 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.633921    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"9901a44f4f13dbd960fd0414c45417c0ba60e4e83c4d175849f5842368b746b5"}
May 21 16:52:00.635093 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.635048    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="05044c5281be6baebde19a6b0cc9c577d57e0deef9a973a8534acf26f99f4071" exitCode=0
May 21 16:52:00.635153 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.635098    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"05044c5281be6baebde19a6b0cc9c577d57e0deef9a973a8534acf26f99f4071"}
May 21 16:52:00.636270 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.636238    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8mgq" event={"ID":"a8a068b4-42bd-49d9-985d-b66ac1394fd1","Type":"ContainerStarted","Data":"d27342ed4edc665a5c202f5556043921c36d3afad50400479e85aab80385fce5"}
May 21 16:52:00.665716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.665671    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jtfc" podStartSLOduration=3.763205561 podStartE2EDuration="21.665659573s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.05232414 +0000 UTC m=+3.118929646" lastFinishedPulling="2026-05-21 16:51:59.954778144 +0000 UTC m=+21.021383658" observedRunningTime="2026-05-21 16:52:00.66546131 +0000 UTC m=+21.732066829" watchObservedRunningTime="2026-05-21 16:52:00.665659573 +0000 UTC m=+21.732265091"
May 21 16:52:00.665785 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.665761    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9d6bm" podStartSLOduration=2.721853534 podStartE2EDuration="20.665756709s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.042622227 +0000 UTC m=+3.109227725" lastFinishedPulling="2026-05-21 16:51:59.986525391 +0000 UTC m=+21.053130900" observedRunningTime="2026-05-21 16:52:00.64732883 +0000 UTC m=+21.713934346" watchObservedRunningTime="2026-05-21 16:52:00.665756709 +0000 UTC m=+21.732362227"
May 21 16:52:00.688167 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.688120    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tf4ng" podStartSLOduration=2.7525757669999997 podStartE2EDuration="20.688104013s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.050578284 +0000 UTC m=+3.117183796" lastFinishedPulling="2026-05-21 16:51:59.986106529 +0000 UTC m=+21.052712042" observedRunningTime="2026-05-21 16:52:00.687429091 +0000 UTC m=+21.754034637" watchObservedRunningTime="2026-05-21 16:52:00.688104013 +0000 UTC m=+21.754709533"
May 21 16:52:00.735061 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:00.735023    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q8mgq" podStartSLOduration=7.54753602 podStartE2EDuration="20.7350056s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.049265479 +0000 UTC m=+3.115870975" lastFinishedPulling="2026-05-21 16:51:55.236735054 +0000 UTC m=+16.303340555" observedRunningTime="2026-05-21 16:52:00.734927429 +0000 UTC m=+21.801532949" watchObservedRunningTime="2026-05-21 16:52:00.7350056 +0000 UTC m=+21.801611120"
May 21 16:52:01.522708 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.522685    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:01.522861 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.522718    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:01.522861 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:01.522788    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:01.522960 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:01.522923    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:01.583575 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.583550    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 16:52:01.640722 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.640646    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"a85c1ef1c0b62a11e76e698e126bac1afcdb5a73ccc40dfdf3d9887f3c7bd37c"}
May 21 16:52:01.640722 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.640686    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"058aaed58546a6eb40a60b8e74514279e984217081548d5e1b09754b43fd0e6b"}
May 21 16:52:01.641841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.641808    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jspsc" event={"ID":"2abbec04-c628-462b-8c39-66f3276bcc47","Type":"ContainerStarted","Data":"696d4c49f2f55e13377a99f3043d194d1ac3bc1e7079e9a1b3dc5cbcacd598a3"}
May 21 16:52:01.643295 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.643273    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp" event={"ID":"840a1f87-d43e-4250-a13f-499bc405092a","Type":"ContainerStarted","Data":"f3c19c6c3d82afe40667b43e512804104393301d7d1af4a181686fdc64443f0c"}
May 21 16:52:01.679530 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:01.679487    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jspsc" podStartSLOduration=4.735729346 podStartE2EDuration="22.67947413s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.041005062 +0000 UTC m=+3.107610576" lastFinishedPulling="2026-05-21 16:51:59.984749849 +0000 UTC m=+21.051355360" observedRunningTime="2026-05-21 16:52:01.679147348 +0000 UTC m=+22.745752867" watchObservedRunningTime="2026-05-21 16:52:01.67947413 +0000 UTC m=+22.746079649"
May 21 16:52:02.414680 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:02.414643    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:02.414868 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:02.414781    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:52:02.414868 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:02.414847    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:10.41483218 +0000 UTC m=+31.481437678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:52:02.506151 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:02.505962    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T16:52:01.583569876Z","UUID":"0ecb9f5b-7776-470f-b896-14ee462e60db","Handler":null,"Name":"","Endpoint":""}
May 21 16:52:02.508218 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:02.508188    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 16:52:02.508444 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:02.508421    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 16:52:02.523167 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:02.523132    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:02.523343 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:02.523248    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:03.522895 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:03.522863    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:03.523365 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:03.522858    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:03.523365 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:03.522980    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:03.523365 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:03.523125    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:03.649198 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:03.649156    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp" event={"ID":"840a1f87-d43e-4250-a13f-499bc405092a","Type":"ContainerStarted","Data":"de9f7747fe22d997b70347b7552259731819727b584cf5c01345b0299eed698d"}
May 21 16:52:03.652121 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:03.652091    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"a9dc99bd3ee04ce0cb799d11a82ec3fc147e13da9938c984742a5f5ca9d31d53"}
May 21 16:52:03.668012 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:03.667930    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btkdp" podStartSLOduration=4.098327892 podStartE2EDuration="24.667916789s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.044668355 +0000 UTC m=+3.111273868" lastFinishedPulling="2026-05-21 16:52:02.614257265 +0000 UTC m=+23.680862765" observedRunningTime="2026-05-21 16:52:03.667581507 +0000 UTC m=+24.734187025" watchObservedRunningTime="2026-05-21 16:52:03.667916789 +0000 UTC m=+24.734522330"
May 21 16:52:04.523631 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:04.523600    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:04.524033 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:04.523730    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:05.525909 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.525682    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:05.526602 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.525682    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:05.526602 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:05.525920    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:05.526602 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:05.526008    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:05.592039 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.591999    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:52:05.592975 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.592959    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:52:05.658498 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.658464    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" event={"ID":"a3605cf4-5414-4c99-8427-98dde62979c1","Type":"ContainerStarted","Data":"51e71082275f5b7cd3af748618a4e69138ca0d0d359762a4411d760bbdc2f70b"}
May 21 16:52:05.658817 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.658786    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:05.658817 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.658815    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:05.660314 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.660283    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="ec7d0fafa39e558a0d09a0b22ab2657241367d010cc437f1d59b5c6bc0459ab4" exitCode=0
May 21 16:52:05.660420 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.660364    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"ec7d0fafa39e558a0d09a0b22ab2657241367d010cc437f1d59b5c6bc0459ab4"}
May 21 16:52:05.675574 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.675538    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:05.684695 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:05.684650    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2" podStartSLOduration=8.528984555 podStartE2EDuration="26.684635827s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.049354835 +0000 UTC m=+3.115960332" lastFinishedPulling="2026-05-21 16:52:00.205006107 +0000 UTC m=+21.271611604" observedRunningTime="2026-05-21 16:52:05.683178081 +0000 UTC m=+26.749783601" watchObservedRunningTime="2026-05-21 16:52:05.684635827 +0000 UTC m=+26.751241346"
May 21 16:52:06.523191 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.523160    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:06.523357 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:06.523284    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:06.662810 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.662774    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:06.677413 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.677389    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:06.905781 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.905594    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nj9vt"]
May 21 16:52:06.905959 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.905878    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:06.906024 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:06.905987    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:06.909214 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.909189    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr9ps"]
May 21 16:52:06.909351 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.909287    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:06.909423 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:06.909362    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:06.909867 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.909848    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvlmp"]
May 21 16:52:06.909967 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:06.909954    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:06.910113 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:06.910058    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:07.665705 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:07.665670    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="ebc5f959af77f4c780e383c419028efca0f882028408f32464e5e2c89df37b86" exitCode=0
May 21 16:52:07.666217 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:07.665758    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"ebc5f959af77f4c780e383c419028efca0f882028408f32464e5e2c89df37b86"}
May 21 16:52:08.414868 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.414828    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:52:08.415025 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.414964    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 16:52:08.415413 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.415391    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jtfc"
May 21 16:52:08.522950 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.522927    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:08.523048 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.522927    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:08.523181 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.522927    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:08.523223 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:08.523196    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:08.523269 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:08.523233    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:08.523269 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:08.523030    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:08.669673 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.669593    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="080aa65a8a841a1d74661748aa688eaedbc737c049db570dfc100e58151e54a7" exitCode=0
May 21 16:52:08.670118 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:08.669684    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"080aa65a8a841a1d74661748aa688eaedbc737c049db570dfc100e58151e54a7"}
May 21 16:52:10.471264 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:10.471228    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:10.471736 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:10.471341    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:52:10.471736 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:10.471407    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret podName:8c487812-0c0e-4c3c-b284-4ba24545c6b2 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:26.471391219 +0000 UTC m=+47.537996728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret") pod "global-pull-secret-syncer-nr9ps" (UID: "8c487812-0c0e-4c3c-b284-4ba24545c6b2") : object "kube-system"/"original-pull-secret" not registered
May 21 16:52:10.523087 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:10.523052    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:10.523269 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:10.523100    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:10.523269 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:10.523112    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:10.523269 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:10.523203    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:10.523437 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:10.523341    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:10.523437 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:10.523422    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:12.523253 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.523225    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:12.523618 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.523225    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:12.523618 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.523319    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr9ps" podUID="8c487812-0c0e-4c3c-b284-4ba24545c6b2"
May 21 16:52:12.523618 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.523426    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj9vt" podUID="50e8aafd-06fc-4bcb-8c87-ec761edc7550"
May 21 16:52:12.523618 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.523230    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:12.523618 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.523542    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvlmp" podUID="49c4e0d0-2a0c-4bc2-ba8b-884b0c472870"
May 21 16:52:12.724195 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.724167    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-101.ec2.internal" event="NodeReady"
May 21 16:52:12.724373 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.724321    2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 16:52:12.758736 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.758702    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dzdsv"]
May 21 16:52:12.779370 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.779248    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:52:12.779370 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.779358    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.784739 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.784714    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 21 16:52:12.784739 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.784714    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 21 16:52:12.785217 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.785200    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 21 16:52:12.785500 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.785205    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 21 16:52:12.785500 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.785277    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nbw8w\""
May 21 16:52:12.792178 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.792138    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 21 16:52:12.793151 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.793128    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dzdsv"]
May 21 16:52:12.793243 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.793161    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"]
May 21 16:52:12.793306 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.793273    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.799538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.798898    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 16:52:12.801040 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.801019    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 16:52:12.801205 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.801161    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jq5vp\""
May 21 16:52:12.801591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.801575    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 16:52:12.805054 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.805035    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 16:52:12.821475 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.821380    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-759f558cf8-g47cn"]
May 21 16:52:12.821669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.821572    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"
May 21 16:52:12.824639 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.824612    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 16:52:12.824923 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.824890    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rwn67\""
May 21 16:52:12.825027 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.824742    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 16:52:12.841297 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.841270    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"]
May 21 16:52:12.841468 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.841448    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.844305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844280    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kpcvk\""
May 21 16:52:12.844737 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844715    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 21 16:52:12.844853 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844834    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 21 16:52:12.844925 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844850    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 16:52:12.844982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844957    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 21 16:52:12.844982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.844968    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 21 16:52:12.845111 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.845063    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 16:52:12.863443 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.863354    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"]
May 21 16:52:12.863572 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.863551    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:12.866151 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.866127    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 21 16:52:12.866263 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.866170    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 21 16:52:12.866429 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.866410    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kwxnv\""
May 21 16:52:12.866689 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.866673    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 21 16:52:12.885526 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.885498    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vppgx"]
May 21 16:52:12.885696 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.885657    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:12.888108 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56bc23ef-0dbc-4546-a260-89b22add976f-serving-cert\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.888224 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-config\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.888224 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888138    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-trusted-ca\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.888224 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888224 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888417 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888417 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888417 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888552 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888552 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8phjj\" (UniqueName: \"kubernetes.io/projected/56bc23ef-0dbc-4546-a260-89b22add976f-kube-api-access-8phjj\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.888552 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.888686 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.888553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cdrn\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.889728 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.889440    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 16:52:12.889835 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.889753    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 16:52:12.889893 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.889841    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5cfsh\""
May 21 16:52:12.898849 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.898824    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 16:52:12.900350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.900327    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 16:52:12.903461 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.903442    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"]
May 21 16:52:12.903612 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.903595    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.907276 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.907253    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 16:52:12.907381 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.907253    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 16:52:12.907445 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.907263    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bm25h\""
May 21 16:52:12.907751 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.907731    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 21 16:52:12.908067 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.908051    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 21 16:52:12.920603 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.920579    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 21 16:52:12.925618 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.925592    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"]
May 21 16:52:12.925714 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.925673    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:12.929754 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.929734    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 16:52:12.929754 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.929748    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 16:52:12.929905 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.929787    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 16:52:12.929972 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.929958    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c4z4x\""
May 21 16:52:12.930110 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.930088    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 16:52:12.945668 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.945647    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"]
May 21 16:52:12.945825 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.945809    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"
May 21 16:52:12.948803 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.948785    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 16:52:12.949305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.949278    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vf8mh\""
May 21 16:52:12.949305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.949293    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 16:52:12.965852 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.965825    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"]
May 21 16:52:12.965983 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.965928    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:12.968538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.968515    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kx49r\""
May 21 16:52:12.968653 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.968543    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 16:52:12.968653 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.968581    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 16:52:12.968854 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.968831    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 16:52:12.968967 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.968858    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 16:52:12.980323 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.980293    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hh2fc"]
May 21 16:52:12.980529 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.980506    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:12.983059 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.982895    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 21 16:52:12.983059 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.982910    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hwrmn\""
May 21 16:52:12.983059 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.982921    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 21 16:52:12.983059 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.982933    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 21 16:52:12.983359 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.983253    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 21 16:52:12.989287 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989268    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.989396 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-stats-auth\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.989396 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989343    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.989504 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.989504 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.989437    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:12.989504 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.989452    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:12.989504 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-tmp\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989544    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:12.989557    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.489535845 +0000 UTC m=+34.556141368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1c30838-7772-4c96-8ea3-c66c6a5382a1-config\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989630    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8phjj\" (UniqueName: \"kubernetes.io/projected/56bc23ef-0dbc-4546-a260-89b22add976f-kube-api-access-8phjj\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989656    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.989699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-default-certificate\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989767    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cdrn\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xk6r\" (UniqueName: \"kubernetes.io/projected/db7d88ad-afed-4d0a-9b8f-591ddc953d97-kube-api-access-6xk6r\") pod \"volume-data-source-validator-5cf8c89d64-ffnfh\" (UID: \"db7d88ad-afed-4d0a-9b8f-591ddc953d97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn27m\" (UniqueName: \"kubernetes.io/projected/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-kube-api-access-gn27m\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-serving-cert\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.989965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989950    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56bc23ef-0dbc-4546-a260-89b22add976f-serving-cert\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.989980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twt6\" (UniqueName: \"kubernetes.io/projected/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-kube-api-access-2twt6\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-snapshots\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990056    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-kube-api-access-zbsxd\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990114    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-config\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990119    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990139    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-trusted-ca\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990165    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990195    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.990266 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:12.990744 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990308    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.990744 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mvm\" (UniqueName: \"kubernetes.io/projected/e1c30838-7772-4c96-8ea3-c66c6a5382a1-kube-api-access-26mvm\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:12.990744 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990370    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1c30838-7772-4c96-8ea3-c66c6a5382a1-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:12.990744 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990570    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.990903 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.990799    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-config\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.991140 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.991094    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56bc23ef-0dbc-4546-a260-89b22add976f-trusted-ca\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.991261 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.991237    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.994702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.994680    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56bc23ef-0dbc-4546-a260-89b22add976f-serving-cert\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.994798 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.994708    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.994798 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.994715    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.996066 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.996037    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:52:12.996201 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.996174    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:12.996292 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.996206    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"]
May 21 16:52:12.998305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.998274    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.998386 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.998375    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 16:52:12.999702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.998870    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cdrn\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:12.999702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.998924    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8phjj\" (UniqueName: \"kubernetes.io/projected/56bc23ef-0dbc-4546-a260-89b22add976f-kube-api-access-8phjj\") pod \"console-operator-76dff48d59-dzdsv\" (UID: \"56bc23ef-0dbc-4546-a260-89b22add976f\") " pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:12.999702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.999007    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 16:52:12.999702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.999111    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 16:52:12.999702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:12.999293    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d2hft\""
May 21 16:52:13.024864 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.024838    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"]
May 21 16:52:13.025043 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.025007    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.027452 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.027426    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 16:52:13.027562 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.027470    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 16:52:13.027562 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.027533    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-84gcb\""
May 21 16:52:13.045305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.045282    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"]
May 21 16:52:13.045438 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.045424    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.048094 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.048053    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 16:52:13.067187 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067162    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067193    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067206    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067217    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759f558cf8-g47cn"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067228    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067238    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067248    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067258    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hh2fc"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067268    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067279    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067280    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067293    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"]
May 21 16:52:13.067304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067303    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vppgx"]
May 21 16:52:13.067876 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067313    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"]
May 21 16:52:13.067876 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.067336    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvwvq"]
May 21 16:52:13.071165 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.071143    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 16:52:13.071476 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.071458    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 16:52:13.071555 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.071515    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 16:52:13.071674 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.071635    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 16:52:13.087295 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.087265    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvwvq"]
May 21 16:52:13.087455 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.087439    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.090737 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090712    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-snapshots\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.090845 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b395f33b-31b2-4389-8424-a86627a896eb-config\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.090845 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090814    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26mvm\" (UniqueName: \"kubernetes.io/projected/e1c30838-7772-4c96-8ea3-c66c6a5382a1-kube-api-access-26mvm\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.090951 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090844    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1c30838-7772-4c96-8ea3-c66c6a5382a1-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.090951 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpfws\" (UniqueName: \"kubernetes.io/projected/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-kube-api-access-gpfws\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.090951 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090911    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-stats-auth\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.091106 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.090960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.091106 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091001    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.091106 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6pcf\" (UniqueName: \"kubernetes.io/projected/b395f33b-31b2-4389-8424-a86627a896eb-kube-api-access-d6pcf\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.091106 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091061    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1c30838-7772-4c96-8ea3-c66c6a5382a1-config\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.091106 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091104    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-kube-api-access-zbsxd\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091138    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-default-certificate\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091174    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkv8m\" (UniqueName: \"kubernetes.io/projected/f1d8f23e-86c4-4758-a283-b2772d49087b-kube-api-access-hkv8m\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091222    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xk6r\" (UniqueName: \"kubernetes.io/projected/db7d88ad-afed-4d0a-9b8f-591ddc953d97-kube-api-access-6xk6r\") pod \"volume-data-source-validator-5cf8c89d64-ffnfh\" (UID: \"db7d88ad-afed-4d0a-9b8f-591ddc953d97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091258    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn27m\" (UniqueName: \"kubernetes.io/projected/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-kube-api-access-gn27m\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgslb\" (UniqueName: \"kubernetes.io/projected/fd6f0f68-8237-4e91-ba66-6751eb0781e6-kube-api-access-sgslb\") pod \"network-check-source-7f44b6dd87-7ptz7\" (UID: \"fd6f0f68-8237-4e91-ba66-6751eb0781e6\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"
May 21 16:52:13.091350 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091325    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.091623 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091357    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2twt6\" (UniqueName: \"kubernetes.io/projected/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-kube-api-access-2twt6\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:13.091623 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091389    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:13.091623 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.091623 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091460    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-snapshots\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.091623 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b395f33b-31b2-4389-8424-a86627a896eb-serving-cert\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.091867 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091706    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1c30838-7772-4c96-8ea3-c66c6a5382a1-config\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.091867 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.091775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t54bk\" (UniqueName: \"kubernetes.io/projected/f4de536e-269e-4768-a35e-a334709a0e63-kube-api-access-t54bk\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.091974 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.091872    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:13.092027 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.092020    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.59200123 +0000 UTC m=+34.658606731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092215    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.092256    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092312    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr4fs\""
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.092399    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.592380555 +0000 UTC m=+34.658986065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092436    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092455    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-tmp\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092505    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 16:52:13.092587 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092534    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1d8f23e-86c4-4758-a283-b2772d49087b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092608    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092667    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092683    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-tmp\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092730    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.092760    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-serving-cert\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.093046 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.092922    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.59290639 +0000 UTC m=+34.659511924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:13.093429 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.093186    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.093734 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.093712    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 16:52:13.093839 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.093783    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-stats-auth\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.094296 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.094266    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 16:52:13.094396 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.094348    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1c30838-7772-4c96-8ea3-c66c6a5382a1-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.095205 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.095184    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-serving-cert\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.095388 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.095374    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-default-certificate\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.117454 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.117420    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mvm\" (UniqueName: \"kubernetes.io/projected/e1c30838-7772-4c96-8ea3-c66c6a5382a1-kube-api-access-26mvm\") pod \"kube-storage-version-migrator-operator-565644f49-p2wmn\" (UID: \"e1c30838-7772-4c96-8ea3-c66c6a5382a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.120805 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.120767    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twt6\" (UniqueName: \"kubernetes.io/projected/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-kube-api-access-2twt6\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:13.121669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.121643    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn27m\" (UniqueName: \"kubernetes.io/projected/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-kube-api-access-gn27m\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.122346 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.122299    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbsxd\" (UniqueName: \"kubernetes.io/projected/ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826-kube-api-access-zbsxd\") pod \"insights-operator-78bdfb888c-vppgx\" (UID: \"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826\") " pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.124460 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.124439    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xk6r\" (UniqueName: \"kubernetes.io/projected/db7d88ad-afed-4d0a-9b8f-591ddc953d97-kube-api-access-6xk6r\") pod \"volume-data-source-validator-5cf8c89d64-ffnfh\" (UID: \"db7d88ad-afed-4d0a-9b8f-591ddc953d97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"
May 21 16:52:13.132305 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.132280    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"
May 21 16:52:13.193718 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff6cae9-27ab-41b1-905f-200b0d57f825-tmp-dir\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193732    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b395f33b-31b2-4389-8424-a86627a896eb-config\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63b02428-e2d1-4cd6-a30b-aad3451ed47e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193789    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193818    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpfws\" (UniqueName: \"kubernetes.io/projected/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-kube-api-access-gpfws\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.193896 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.193932    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.193973    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.194013    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:45.193994719 +0000 UTC m=+66.260600222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.194067    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194098    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6pcf\" (UniqueName: \"kubernetes.io/projected/b395f33b-31b2-4389-8424-a86627a896eb-kube-api-access-d6pcf\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.194152    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.69412611 +0000 UTC m=+34.760731610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194174    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkv8m\" (UniqueName: \"kubernetes.io/projected/f1d8f23e-86c4-4758-a283-b2772d49087b-kube-api-access-hkv8m\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.194209 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194248    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgslb\" (UniqueName: \"kubernetes.io/projected/fd6f0f68-8237-4e91-ba66-6751eb0781e6-kube-api-access-sgslb\") pod \"network-check-source-7f44b6dd87-7ptz7\" (UID: \"fd6f0f68-8237-4e91-ba66-6751eb0781e6\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-tmp\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2mpv\" (UniqueName: \"kubernetes.io/projected/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-kube-api-access-m2mpv\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194359    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b395f33b-31b2-4389-8424-a86627a896eb-config\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194362    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff6cae9-27ab-41b1-905f-200b0d57f825-config-volume\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194470    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194487    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b395f33b-31b2-4389-8424-a86627a896eb-serving-cert\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194511    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t54bk\" (UniqueName: \"kubernetes.io/projected/f4de536e-269e-4768-a35e-a334709a0e63-kube-api-access-t54bk\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194591    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1d8f23e-86c4-4758-a283-b2772d49087b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.194621 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxt2j\" (UniqueName: \"kubernetes.io/projected/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-kube-api-access-kxt2j\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194682    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbv2z\" (UniqueName: \"kubernetes.io/projected/6ff6cae9-27ab-41b1-905f-200b0d57f825-kube-api-access-pbv2z\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.194789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.194813    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:13.195131 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.194860    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.694846167 +0000 UTC m=+34.761451700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:13.195392 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.195164    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.197188 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.197166    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b395f33b-31b2-4389-8424-a86627a896eb-serving-cert\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.197581 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.197562    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1d8f23e-86c4-4758-a283-b2772d49087b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.200167 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.200137    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"
May 21 16:52:13.203732 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.203711    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gzzqt"]
May 21 16:52:13.213899 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.213882    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vppgx"
May 21 16:52:13.226502 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.226477    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.230595 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.230576    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t54bk\" (UniqueName: \"kubernetes.io/projected/f4de536e-269e-4768-a35e-a334709a0e63-kube-api-access-t54bk\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.234342 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.233871    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w4ctw\""
May 21 16:52:13.236726 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.236706    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpfws\" (UniqueName: \"kubernetes.io/projected/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-kube-api-access-gpfws\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.236870 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.236840    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgslb\" (UniqueName: \"kubernetes.io/projected/fd6f0f68-8237-4e91-ba66-6751eb0781e6-kube-api-access-sgslb\") pod \"network-check-source-7f44b6dd87-7ptz7\" (UID: \"fd6f0f68-8237-4e91-ba66-6751eb0781e6\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"
May 21 16:52:13.238210 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.238191    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6pcf\" (UniqueName: \"kubernetes.io/projected/b395f33b-31b2-4389-8424-a86627a896eb-kube-api-access-d6pcf\") pod \"service-ca-operator-57b5b68b8-x4ddj\" (UID: \"b395f33b-31b2-4389-8424-a86627a896eb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.241384 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.241365    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkv8m\" (UniqueName: \"kubernetes.io/projected/f1d8f23e-86c4-4758-a283-b2772d49087b-kube-api-access-hkv8m\") pod \"managed-serviceaccount-addon-agent-66858cbb58-k785h\" (UID: \"f1d8f23e-86c4-4758-a283-b2772d49087b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.254665 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.254632    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"
May 21 16:52:13.283539 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.283479    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"
May 21 16:52:13.292191 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.292170    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"
May 21 16:52:13.295983 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.295959    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-tmp\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.296102 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.295994    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2mpv\" (UniqueName: \"kubernetes.io/projected/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-kube-api-access-m2mpv\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.296102 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296014    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.296102 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296050    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff6cae9-27ab-41b1-905f-200b0d57f825-config-volume\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.296102 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296094    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:13.296308 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296134    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.296308 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296196    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.296308 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.296212    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:13.296308 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296231    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxt2j\" (UniqueName: \"kubernetes.io/projected/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-kube-api-access-kxt2j\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.296308 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.296270    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.796252416 +0000 UTC m=+34.862857929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:13.296538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296322    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbv2z\" (UniqueName: \"kubernetes.io/projected/6ff6cae9-27ab-41b1-905f-200b0d57f825-kube-api-access-pbv2z\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.296538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296355    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.296538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296390    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff6cae9-27ab-41b1-905f-200b0d57f825-tmp-dir\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.296538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296395    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-tmp\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.296538 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296534    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63b02428-e2d1-4cd6-a30b-aad3451ed47e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.296823 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296585    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.296823 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296614    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.296823 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296641    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff6cae9-27ab-41b1-905f-200b0d57f825-tmp-dir\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.296823 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296685    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.296823 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296745    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.297065 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.296934    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff6cae9-27ab-41b1-905f-200b0d57f825-config-volume\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.297065 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.297043    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:13.297192 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.297109    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.297192 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.297116    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:13.797098306 +0000 UTC m=+34.863703814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:13.297452 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.297407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63b02428-e2d1-4cd6-a30b-aad3451ed47e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.299469 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.299443    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.299570 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.299468    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.299570 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.299486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-ca\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.299570 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.299493    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.300116 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.299714    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.304687 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.304665    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbv2z\" (UniqueName: \"kubernetes.io/projected/6ff6cae9-27ab-41b1-905f-200b0d57f825-kube-api-access-pbv2z\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.304982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.304965    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2mpv\" (UniqueName: \"kubernetes.io/projected/36fa5ffd-e55d-477c-aa3d-73ef37b901e5-kube-api-access-m2mpv\") pod \"cluster-proxy-proxy-agent-568697446b-x77vb\" (UID: \"36fa5ffd-e55d-477c-aa3d-73ef37b901e5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.310982 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.310931    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxt2j\" (UniqueName: \"kubernetes.io/projected/ff9a2b8d-aeca-4032-8fe3-32e0a8170246-kube-api-access-kxt2j\") pod \"klusterlet-addon-workmgr-77c569bf9b-vc8cs\" (UID: \"ff9a2b8d-aeca-4032-8fe3-32e0a8170246\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.311732 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.311707    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjd99\" (UniqueName: \"kubernetes.io/projected/50e8aafd-06fc-4bcb-8c87-ec761edc7550-kube-api-access-pjd99\") pod \"network-check-target-nj9vt\" (UID: \"50e8aafd-06fc-4bcb-8c87-ec761edc7550\") " pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:13.355885 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.355853    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:13.376927 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.376888    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:52:13.398101 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.398012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh8wh\" (UniqueName: \"kubernetes.io/projected/f26e105d-3089-44b1-bc40-9b376927ee68-kube-api-access-wh8wh\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.398318 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.398292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f26e105d-3089-44b1-bc40-9b376927ee68-hosts-file\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.398448 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.398421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26e105d-3089-44b1-bc40-9b376927ee68-tmp-dir\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.499486 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.499451    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wh8wh\" (UniqueName: \"kubernetes.io/projected/f26e105d-3089-44b1-bc40-9b376927ee68-kube-api-access-wh8wh\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.499661 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.499607    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f26e105d-3089-44b1-bc40-9b376927ee68-hosts-file\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.499725 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.499665    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:13.499783 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.499759    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f26e105d-3089-44b1-bc40-9b376927ee68-hosts-file\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.499830 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.499796    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26e105d-3089-44b1-bc40-9b376927ee68-tmp-dir\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.499894 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.499880    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:13.499941 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.499896    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:13.499991 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.499964    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.499944828 +0000 UTC m=+35.566550333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:13.500201 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.500172    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26e105d-3089-44b1-bc40-9b376927ee68-tmp-dir\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.508010 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.507988    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh8wh\" (UniqueName: \"kubernetes.io/projected/f26e105d-3089-44b1-bc40-9b376927ee68-kube-api-access-wh8wh\") pod \"node-resolver-gzzqt\" (UID: \"f26e105d-3089-44b1-bc40-9b376927ee68\") " pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.537393 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.537321    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gzzqt"
May 21 16:52:13.601001 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.600967    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.601186 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.601034    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:13.601186 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.601104    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:13.601307 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.601189    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:13.601307 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.601228    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:13.601307 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.601232    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.601218381 +0000 UTC m=+35.667823879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:13.601453 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.601313    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.601294986 +0000 UTC m=+35.667900486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:13.601453 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.601332    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.601321874 +0000 UTC m=+35.667927375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:13.701746 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.701710    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:13.701900 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.701880    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:13.701975 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.701924    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:13.701975 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.701953    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.701931627 +0000 UTC m=+35.768537142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:13.702091 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.701996    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:13.702091 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.702047    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.702031837 +0000 UTC m=+35.768637336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:13.803211 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.803115    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:13.803387 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.803288    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:13.803387 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.803359    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.803340205 +0000 UTC m=+35.869945702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:13.803504 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:13.803410    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:13.803557 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.803543    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:13.803599 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:13.803593    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:14.803577928 +0000 UTC m=+35.870183434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:14.510460 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.510400    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:14.510636 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.510561    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:14.510636 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.510583    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:14.510730 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.510648    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.510627714 +0000 UTC m=+37.577233213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:14.523410 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.523377    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:14.523410 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.523390    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:14.523410 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.523377    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:14.527561 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.527538    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 16:52:14.527669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.527561    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6bk46\""
May 21 16:52:14.527669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.527605    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 16:52:14.527669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.527616    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5rwtr\""
May 21 16:52:14.535600 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.535572    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:14.611086 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.611040    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.611152    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.611198    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.611260    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.61124093 +0000 UTC m=+37.677846445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.611325    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.611304319 +0000 UTC m=+37.677909836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.611378    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:14.611496 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.611496    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:14.611727 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.611542    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.611529829 +0000 UTC m=+37.678135333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:14.712869 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.712835    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:14.713051 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.712991    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:14.713155 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.713063    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.713043188 +0000 UTC m=+37.779648698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:14.713155 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.713147    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:14.713343 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.713296    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:14.713343 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.713345    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.713332538 +0000 UTC m=+37.779938035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:14.814232 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.814161    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:14.814370 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:14.814285    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:14.814370 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.814313    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:14.814370 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.814371    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.814356472 +0000 UTC m=+37.880961974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:14.814483 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.814420    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:14.814483 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:14.814477    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:16.814461295 +0000 UTC m=+37.881066808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:15.212005 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.210825    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vppgx"]
May 21 16:52:15.213029 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.212873    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h"]
May 21 16:52:15.214699 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.214634    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dzdsv"]
May 21 16:52:15.246994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.246913    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nj9vt"]
May 21 16:52:15.254929 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.254324    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj"]
May 21 16:52:15.256669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.256644    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh"]
May 21 16:52:15.261656 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.261637    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7"]
May 21 16:52:15.264761 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.264739    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"]
May 21 16:52:15.271538 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:15.271502    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7d88ad_afed_4d0a_9b8f_591ddc953d97.slice/crio-51555867a21fded38664cef6ba5ff8c6ba60b7def4c39a1074e8ad046f447c9b WatchSource:0}: Error finding container 51555867a21fded38664cef6ba5ff8c6ba60b7def4c39a1074e8ad046f447c9b: Status 404 returned error can't find the container with id 51555867a21fded38664cef6ba5ff8c6ba60b7def4c39a1074e8ad046f447c9b
May 21 16:52:15.272248 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:15.272221    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6f0f68_8237_4e91_ba66_6751eb0781e6.slice/crio-fa98a160ac5becc2ca66dd750f294c9aa3349e821753feebc958953fc1895d3f WatchSource:0}: Error finding container fa98a160ac5becc2ca66dd750f294c9aa3349e821753feebc958953fc1895d3f: Status 404 returned error can't find the container with id fa98a160ac5becc2ca66dd750f294c9aa3349e821753feebc958953fc1895d3f
May 21 16:52:15.274331 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:15.273689    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36fa5ffd_e55d_477c_aa3d_73ef37b901e5.slice/crio-bc3420f8a6183da8cf1bbad2e96c2ccd9dd21d6a5232fc8c583c1d457a5ec439 WatchSource:0}: Error finding container bc3420f8a6183da8cf1bbad2e96c2ccd9dd21d6a5232fc8c583c1d457a5ec439: Status 404 returned error can't find the container with id bc3420f8a6183da8cf1bbad2e96c2ccd9dd21d6a5232fc8c583c1d457a5ec439
May 21 16:52:15.275355 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.275329    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn"]
May 21 16:52:15.279313 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:15.279286    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c30838_7772_4c96_8ea3_c66c6a5382a1.slice/crio-f0661c66376887711e0c8913700d69ca4dcfc6919a9fe15528f066ebeefef951 WatchSource:0}: Error finding container f0661c66376887711e0c8913700d69ca4dcfc6919a9fe15528f066ebeefef951: Status 404 returned error can't find the container with id f0661c66376887711e0c8913700d69ca4dcfc6919a9fe15528f066ebeefef951
May 21 16:52:15.281531 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.281509    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"]
May 21 16:52:15.284775 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:15.284746    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9a2b8d_aeca_4032_8fe3_32e0a8170246.slice/crio-e70767f01548bae3da430ebedbc662749e42dbe8c468b9fbd556eef960da7195 WatchSource:0}: Error finding container e70767f01548bae3da430ebedbc662749e42dbe8c468b9fbd556eef960da7195: Status 404 returned error can't find the container with id e70767f01548bae3da430ebedbc662749e42dbe8c468b9fbd556eef960da7195
May 21 16:52:15.682901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.682816    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerStarted","Data":"bc3420f8a6183da8cf1bbad2e96c2ccd9dd21d6a5232fc8c583c1d457a5ec439"}
May 21 16:52:15.683701 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.683680    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj" event={"ID":"b395f33b-31b2-4389-8424-a86627a896eb","Type":"ContainerStarted","Data":"527dcda3175d1c6a8c0b0183512bf1b4bf37046c7fb048b6f0bdf173e5bc2405"}
May 21 16:52:15.684569 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.684542    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7" event={"ID":"fd6f0f68-8237-4e91-ba66-6751eb0781e6","Type":"ContainerStarted","Data":"fa98a160ac5becc2ca66dd750f294c9aa3349e821753feebc958953fc1895d3f"}
May 21 16:52:15.685551 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.685528    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn" event={"ID":"e1c30838-7772-4c96-8ea3-c66c6a5382a1","Type":"ContainerStarted","Data":"f0661c66376887711e0c8913700d69ca4dcfc6919a9fe15528f066ebeefef951"}
May 21 16:52:15.686456 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.686436    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nj9vt" event={"ID":"50e8aafd-06fc-4bcb-8c87-ec761edc7550","Type":"ContainerStarted","Data":"7268bcb776cf05f0c2dd51704048bc23c18b72bd7c5572d186daa21ebb75ccf8"}
May 21 16:52:15.687341 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.687321    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh" event={"ID":"db7d88ad-afed-4d0a-9b8f-591ddc953d97","Type":"ContainerStarted","Data":"51555867a21fded38664cef6ba5ff8c6ba60b7def4c39a1074e8ad046f447c9b"}
May 21 16:52:15.688208 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.688186    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h" event={"ID":"f1d8f23e-86c4-4758-a283-b2772d49087b","Type":"ContainerStarted","Data":"7441a8241180935b19195ed43f74ba3bd73d2dc83621926a11743cfec294b71a"}
May 21 16:52:15.690604 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.690576    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="cd5f93a2e0566ad8b864877eda9d69b2e5b6f126a285ba51afbff22be70f097c" exitCode=0
May 21 16:52:15.690703 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.690653    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"cd5f93a2e0566ad8b864877eda9d69b2e5b6f126a285ba51afbff22be70f097c"}
May 21 16:52:15.691685 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.691658    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" event={"ID":"56bc23ef-0dbc-4546-a260-89b22add976f","Type":"ContainerStarted","Data":"1f87271074afb19719aac4f3007fcd14a57e0d07a8410fae476ecb8d948b0642"}
May 21 16:52:15.692522 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.692503    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs" event={"ID":"ff9a2b8d-aeca-4032-8fe3-32e0a8170246","Type":"ContainerStarted","Data":"e70767f01548bae3da430ebedbc662749e42dbe8c468b9fbd556eef960da7195"}
May 21 16:52:15.693653 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.693635    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gzzqt" event={"ID":"f26e105d-3089-44b1-bc40-9b376927ee68","Type":"ContainerStarted","Data":"2f09ff65b5e0265b8d356c04142538c38023759f9f638eb1cda807ba31a0bdfc"}
May 21 16:52:15.693727 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.693656    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gzzqt" event={"ID":"f26e105d-3089-44b1-bc40-9b376927ee68","Type":"ContainerStarted","Data":"cbc1bc4e84725970cd9324c5e12a7a6ba41a9f2be599bdf290fa561fc817a3bb"}
May 21 16:52:15.694590 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.694569    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vppgx" event={"ID":"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826","Type":"ContainerStarted","Data":"98ae7a645ff3dc71159b70adebccf2b33631cf8b4270dcfbb7799cc67628ef6d"}
May 21 16:52:15.734990 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:15.734936    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gzzqt" podStartSLOduration=2.734917014 podStartE2EDuration="2.734917014s" podCreationTimestamp="2026-05-21 16:52:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:52:15.733994129 +0000 UTC m=+36.800599650" watchObservedRunningTime="2026-05-21 16:52:15.734917014 +0000 UTC m=+36.801522535"
May 21 16:52:16.541053 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.541010    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:16.541882 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.541338    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:16.541882 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.541363    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:16.541882 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.541427    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.541408783 +0000 UTC m=+41.608014303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:16.642527 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.642486    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:16.642688 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.642571    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:16.642688 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.642636    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:16.642824 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.642809    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.642788807 +0000 UTC m=+41.709394317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:16.643156 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.643136    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:16.643260 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.643192    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.643177057 +0000 UTC m=+41.709782556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:16.643260 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.643251    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:16.643363 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.643287    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.643275699 +0000 UTC m=+41.709881211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:16.720343 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.719863    2570 generic.go:358] "Generic (PLEG): container finished" podID="d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db" containerID="5d1ad8536c893ca2dea46ce383fc849a5113fa94908412a218491e61f0913191" exitCode=0
May 21 16:52:16.720343 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.719929    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerDied","Data":"5d1ad8536c893ca2dea46ce383fc849a5113fa94908412a218491e61f0913191"}
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.743650    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.743771    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.743946    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.744008    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.743989117 +0000 UTC m=+41.810594637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.744298    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:16.744383 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.744346    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.744331882 +0000 UTC m=+41.810937396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.844884    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:16.845040    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.845582    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.845644    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.845624974 +0000 UTC m=+41.912230474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.846564    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:16.846932 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:16.846631    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:20.846596092 +0000 UTC m=+41.913201595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:17.765629 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:17.765589    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l26pl" event={"ID":"d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db","Type":"ContainerStarted","Data":"c7488825271a81592c2e34a6d6177d4f75e1c86c16c70098461ae44696543d72"}
May 21 16:52:19.554248 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:19.554193    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l26pl" podStartSLOduration=7.4129726510000005 podStartE2EDuration="40.554174636s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:51:42.043570269 +0000 UTC m=+3.110175772" lastFinishedPulling="2026-05-21 16:52:15.184772258 +0000 UTC m=+36.251377757" observedRunningTime="2026-05-21 16:52:17.792636391 +0000 UTC m=+38.859241926" watchObservedRunningTime="2026-05-21 16:52:19.554174636 +0000 UTC m=+40.620780155"
May 21 16:52:20.586321 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.586273    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:20.586771 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.586520    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:20.586771 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.586536    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:20.586771 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.586596    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.586578024 +0000 UTC m=+49.653183527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:20.687725 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.687680    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:20.687923 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.687791    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:20.687923 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.687833    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.687811066 +0000 UTC m=+49.754416586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:20.687923 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.687898    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:20.687923 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.687902    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:20.688160 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.687945    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.687931053 +0000 UTC m=+49.754536549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:20.688160 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.688018    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:20.688160 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.688059    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.688046872 +0000 UTC m=+49.754652394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:20.788503 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.788465    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:20.788645 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.788586    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:20.788645 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.788608    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:20.788729 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.788662    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.788647882 +0000 UTC m=+49.855253380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:20.788729 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.788706    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:20.788800 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.788758    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.788743128 +0000 UTC m=+49.855348638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:20.889809 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.889744    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:20.889908 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:20.889834    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:20.889908 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.889886    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:20.889971 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.889944    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:20.889971 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.889952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.889937192 +0000 UTC m=+49.956542690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:20.890034 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:20.889982    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:28.889971839 +0000 UTC m=+49.956577336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:26.541174 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:26.541128    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:26.545647 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:26.545617    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c487812-0c0e-4c3c-b284-4ba24545c6b2-original-pull-secret\") pod \"global-pull-secret-syncer-nr9ps\" (UID: \"8c487812-0c0e-4c3c-b284-4ba24545c6b2\") " pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:26.550420 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:26.550398    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr9ps"
May 21 16:52:28.661869 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.661831    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:28.662245 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.662008    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:52:28.662245 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.662026    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b48476d6-8g2dc: secret "image-registry-tls" not found
May 21 16:52:28.662245 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.662099    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls podName:9ede28a5-556c-46bc-8073-ef0dc219cb0a nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.662066493 +0000 UTC m=+65.728671997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls") pod "image-registry-7b48476d6-8g2dc" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a") : secret "image-registry-tls" not found
May 21 16:52:28.763331 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.763297    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:28.763521 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.763369    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:28.763521 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.763443    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 16:52:28.763521 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.763462    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:28.763521 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.763503    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls podName:d788d44b-42ee-4a8b-aa59-01b52dc6ac39 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.763489075 +0000 UTC m=+65.830094573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls") pod "cluster-samples-operator-697587599-bfwbd" (UID: "d788d44b-42ee-4a8b-aa59-01b52dc6ac39") : secret "samples-operator-tls" not found
May 21 16:52:28.763714 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.763525    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.763510871 +0000 UTC m=+65.830116368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : configmap references non-existent config key: service-ca.crt
May 21 16:52:28.763714 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.763572    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 16:52:28.763714 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.763636    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs podName:f0b9a1b3-46f9-499e-8df8-0e172600f3d8 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.763620528 +0000 UTC m=+65.830226043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs") pod "router-default-759f558cf8-g47cn" (UID: "f0b9a1b3-46f9-499e-8df8-0e172600f3d8") : secret "router-metrics-certs-default" not found
May 21 16:52:28.864740 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.864697    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:28.864885 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.864797    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:28.864885 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.864843    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:52:28.864951 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.864908    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:28.864951 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.864917    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert podName:f4de536e-269e-4768-a35e-a334709a0e63 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.864902352 +0000 UTC m=+65.931507848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert") pod "ingress-canary-hh2fc" (UID: "f4de536e-269e-4768-a35e-a334709a0e63") : secret "canary-serving-cert" not found
May 21 16:52:28.864951 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.864947    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.864936046 +0000 UTC m=+65.931541543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:28.965591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.965524    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:28.965715 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.965660    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:28.965759 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.965721    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:52:28.965759 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:28.965664    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:28.965759 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.965723    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.965707595 +0000 UTC m=+66.032313098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:28.965872 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:28.965770    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls podName:6ff6cae9-27ab-41b1-905f-200b0d57f825 nodeName:}" failed. No retries permitted until 2026-05-21 16:52:44.965759587 +0000 UTC m=+66.032365084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls") pod "dns-default-hvwvq" (UID: "6ff6cae9-27ab-41b1-905f-200b0d57f825") : secret "dns-default-metrics-tls" not found
May 21 16:52:29.250202 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.250176    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr9ps"]
May 21 16:52:29.252592 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:29.252568    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c487812_0c0e_4c3c_b284_4ba24545c6b2.slice/crio-556b205ddc99231300f2ff1835ac39bd71b5b4a37e71c382b949e6ad30a1ab87 WatchSource:0}: Error finding container 556b205ddc99231300f2ff1835ac39bd71b5b4a37e71c382b949e6ad30a1ab87: Status 404 returned error can't find the container with id 556b205ddc99231300f2ff1835ac39bd71b5b4a37e71c382b949e6ad30a1ab87
May 21 16:52:29.802761 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.802674    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nj9vt" event={"ID":"50e8aafd-06fc-4bcb-8c87-ec761edc7550","Type":"ContainerStarted","Data":"4c04e332b4ba5d0b5de5f38027bc046ebc9ba0f6e1513cd82af2fa66308535a2"}
May 21 16:52:29.803288 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.803266    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:52:29.808277 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.808251    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh" event={"ID":"db7d88ad-afed-4d0a-9b8f-591ddc953d97","Type":"ContainerStarted","Data":"b7e448fa5b64a00c64630bb754b5ebed668974c005112fdaee651d175e22f177"}
May 21 16:52:29.809910 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.809882    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h" event={"ID":"f1d8f23e-86c4-4758-a283-b2772d49087b","Type":"ContainerStarted","Data":"4588e96a4166aa3e19da96ad6f78c4659457a8ad5753c95e54d268b6963db59c"}
May 21 16:52:29.811116 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.811090    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr9ps" event={"ID":"8c487812-0c0e-4c3c-b284-4ba24545c6b2","Type":"ContainerStarted","Data":"556b205ddc99231300f2ff1835ac39bd71b5b4a37e71c382b949e6ad30a1ab87"}
May 21 16:52:29.812485 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.812469    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/0.log"
May 21 16:52:29.812572 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.812504    2570 generic.go:358] "Generic (PLEG): container finished" podID="56bc23ef-0dbc-4546-a260-89b22add976f" containerID="adefde8d5f36cce4352f19b7b4ace2bb264afc0499444cbdccd166b2c4e1ca61" exitCode=255
May 21 16:52:29.812685 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.812571    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" event={"ID":"56bc23ef-0dbc-4546-a260-89b22add976f","Type":"ContainerDied","Data":"adefde8d5f36cce4352f19b7b4ace2bb264afc0499444cbdccd166b2c4e1ca61"}
May 21 16:52:29.812768 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.812751    2570 scope.go:117] "RemoveContainer" containerID="adefde8d5f36cce4352f19b7b4ace2bb264afc0499444cbdccd166b2c4e1ca61"
May 21 16:52:29.814002 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.813982    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs" event={"ID":"ff9a2b8d-aeca-4032-8fe3-32e0a8170246","Type":"ContainerStarted","Data":"bf365d76bb2d5e36bc8a9edf1ad836dc222b18b98aca5c459a3c4e3534a2eb9a"}
May 21 16:52:29.814578 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.814561    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:29.816397 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.816380    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs"
May 21 16:52:29.816844 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.816820    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vppgx" event={"ID":"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826","Type":"ContainerStarted","Data":"7db985d5c2544d98aece81168f3d0f34f4982602dcdbdb875c0b3774e6dac28b"}
May 21 16:52:29.818313 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.818290    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerStarted","Data":"e6a46d9e8d62955b9210e9ca7ebd3cee27f0ee4c8bad65aee6bc431fd42ab16a"}
May 21 16:52:29.819570 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.819550    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj" event={"ID":"b395f33b-31b2-4389-8424-a86627a896eb","Type":"ContainerStarted","Data":"2524a96899cfcdbf251c684a2a5e0e76c2f63e85178c6a1f2dc2165465f2456f"}
May 21 16:52:29.820965 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.820947    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7" event={"ID":"fd6f0f68-8237-4e91-ba66-6751eb0781e6","Type":"ContainerStarted","Data":"a36201b2c97ebdbe23c3e88ce16b510fda9800b24fd36c6a11baa29d95e42d43"}
May 21 16:52:29.823934 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.823915    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn" event={"ID":"e1c30838-7772-4c96-8ea3-c66c6a5382a1","Type":"ContainerStarted","Data":"aa02082cf62286c23d0eeaa2b9dab47ceaf069ab1544e355e4d9a83f7145cfc1"}
May 21 16:52:29.845894 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.845849    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nj9vt" podStartSLOduration=36.979080983 podStartE2EDuration="50.845834713s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.257011517 +0000 UTC m=+36.323617031" lastFinishedPulling="2026-05-21 16:52:29.123765246 +0000 UTC m=+50.190370761" observedRunningTime="2026-05-21 16:52:29.823004834 +0000 UTC m=+50.889610354" watchObservedRunningTime="2026-05-21 16:52:29.845834713 +0000 UTC m=+50.912440233"
May 21 16:52:29.846680 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.846648    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c569bf9b-vc8cs" podStartSLOduration=17.011466651 podStartE2EDuration="30.846638133s" podCreationTimestamp="2026-05-21 16:51:59 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.286840453 +0000 UTC m=+36.353445968" lastFinishedPulling="2026-05-21 16:52:29.122011952 +0000 UTC m=+50.188617450" observedRunningTime="2026-05-21 16:52:29.845973059 +0000 UTC m=+50.912578561" watchObservedRunningTime="2026-05-21 16:52:29.846638133 +0000 UTC m=+50.913243654"
May 21 16:52:29.903024 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.902960    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858cbb58-k785h" podStartSLOduration=17.005739121 podStartE2EDuration="30.902945532s" podCreationTimestamp="2026-05-21 16:51:59 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.234704068 +0000 UTC m=+36.301309578" lastFinishedPulling="2026-05-21 16:52:29.131910492 +0000 UTC m=+50.198515989" observedRunningTime="2026-05-21 16:52:29.902195729 +0000 UTC m=+50.968801252" watchObservedRunningTime="2026-05-21 16:52:29.902945532 +0000 UTC m=+50.969551050"
May 21 16:52:29.952175 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.951781    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj" podStartSLOduration=22.178266024 podStartE2EDuration="35.951759938s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.258852264 +0000 UTC m=+36.325457761" lastFinishedPulling="2026-05-21 16:52:29.032346168 +0000 UTC m=+50.098951675" observedRunningTime="2026-05-21 16:52:29.934309941 +0000 UTC m=+51.000915461" watchObservedRunningTime="2026-05-21 16:52:29.951759938 +0000 UTC m=+51.018365462"
May 21 16:52:29.953102 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.953043    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7ptz7" podStartSLOduration=20.105696503 podStartE2EDuration="33.953030009s" podCreationTimestamp="2026-05-21 16:51:56 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.275672924 +0000 UTC m=+36.342278436" lastFinishedPulling="2026-05-21 16:52:29.123006443 +0000 UTC m=+50.189611942" observedRunningTime="2026-05-21 16:52:29.952326305 +0000 UTC m=+51.018931827" watchObservedRunningTime="2026-05-21 16:52:29.953030009 +0000 UTC m=+51.019635529"
May 21 16:52:29.973966 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.973483    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-vppgx" podStartSLOduration=22.1763434 podStartE2EDuration="35.973465927s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.235300938 +0000 UTC m=+36.301906435" lastFinishedPulling="2026-05-21 16:52:29.032423459 +0000 UTC m=+50.099028962" observedRunningTime="2026-05-21 16:52:29.97185905 +0000 UTC m=+51.038464568" watchObservedRunningTime="2026-05-21 16:52:29.973465927 +0000 UTC m=+51.040071447"
May 21 16:52:29.989469 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:29.988489    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ffnfh" podStartSLOduration=22.230616271 podStartE2EDuration="35.988470572s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.274480226 +0000 UTC m=+36.341085727" lastFinishedPulling="2026-05-21 16:52:29.03233452 +0000 UTC m=+50.098940028" observedRunningTime="2026-05-21 16:52:29.987351127 +0000 UTC m=+51.053956646" watchObservedRunningTime="2026-05-21 16:52:29.988470572 +0000 UTC m=+51.055076092"
May 21 16:52:30.010754 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.010709    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn" podStartSLOduration=22.195035292 podStartE2EDuration="36.010693497s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.281489155 +0000 UTC m=+36.348094658" lastFinishedPulling="2026-05-21 16:52:29.097147361 +0000 UTC m=+50.163752863" observedRunningTime="2026-05-21 16:52:30.010483176 +0000 UTC m=+51.077088715" watchObservedRunningTime="2026-05-21 16:52:30.010693497 +0000 UTC m=+51.077299017"
May 21 16:52:30.831479 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.831398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 16:52:30.831942 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.831887    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/0.log"
May 21 16:52:30.831942 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.831920    2570 generic.go:358] "Generic (PLEG): container finished" podID="56bc23ef-0dbc-4546-a260-89b22add976f" containerID="2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c" exitCode=255
May 21 16:52:30.833523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.832144    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" event={"ID":"56bc23ef-0dbc-4546-a260-89b22add976f","Type":"ContainerDied","Data":"2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c"}
May 21 16:52:30.833523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.832196    2570 scope.go:117] "RemoveContainer" containerID="adefde8d5f36cce4352f19b7b4ace2bb264afc0499444cbdccd166b2c4e1ca61"
May 21 16:52:30.833523 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:30.832800    2570 scope.go:117] "RemoveContainer" containerID="2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c"
May 21 16:52:30.833523 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:30.832966    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dzdsv_openshift-console-operator(56bc23ef-0dbc-4546-a260-89b22add976f)\"" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" podUID="56bc23ef-0dbc-4546-a260-89b22add976f"
May 21 16:52:31.838040 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:31.838008    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 16:52:31.838713 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:31.838607    2570 scope.go:117] "RemoveContainer" containerID="2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c"
May 21 16:52:31.838837 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:31.838816    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dzdsv_openshift-console-operator(56bc23ef-0dbc-4546-a260-89b22add976f)\"" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" podUID="56bc23ef-0dbc-4546-a260-89b22add976f"
May 21 16:52:32.092866 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:32.092843    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gzzqt_f26e105d-3089-44b1-bc40-9b376927ee68/dns-node-resolver/0.log"
May 21 16:52:32.844057 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:32.843998    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerStarted","Data":"e582d7a5572d1cd46523c0fbf1d69fb39927b3fd9a21bc9e51da8702b232c119"}
May 21 16:52:32.844057 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:32.844046    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerStarted","Data":"f009d026033835ee79ef48094d9a0b4a19212aca77bfab0f62227d5ab8d242aa"}
May 21 16:52:32.867001 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:32.866941    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" podStartSLOduration=17.103679458 podStartE2EDuration="33.866923608s" podCreationTimestamp="2026-05-21 16:51:59 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.27542381 +0000 UTC m=+36.342029309" lastFinishedPulling="2026-05-21 16:52:32.038667949 +0000 UTC m=+53.105273459" observedRunningTime="2026-05-21 16:52:32.865323304 +0000 UTC m=+53.931928846" watchObservedRunningTime="2026-05-21 16:52:32.866923608 +0000 UTC m=+53.933529129"
May 21 16:52:33.093181 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:33.093147    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:33.093181 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:33.093187    2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:33.093604 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:33.093588    2570 scope.go:117] "RemoveContainer" containerID="2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c"
May 21 16:52:33.093826 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:33.093802    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dzdsv_openshift-console-operator(56bc23ef-0dbc-4546-a260-89b22add976f)\"" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" podUID="56bc23ef-0dbc-4546-a260-89b22add976f"
May 21 16:52:33.492727 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:33.492693    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8mgq_a8a068b4-42bd-49d9-985d-b66ac1394fd1/node-ca/0.log"
May 21 16:52:34.854994 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:34.854958    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr9ps" event={"ID":"8c487812-0c0e-4c3c-b284-4ba24545c6b2","Type":"ContainerStarted","Data":"6117b59000b3972569d8ecee6726cb7004ce4b5c5df22893f376e0f53d472fc3"}
May 21 16:52:34.874748 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:34.874703    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nr9ps" podStartSLOduration=35.933481056 podStartE2EDuration="40.874690336s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:29.254687053 +0000 UTC m=+50.321292550" lastFinishedPulling="2026-05-21 16:52:34.195896319 +0000 UTC m=+55.262501830" observedRunningTime="2026-05-21 16:52:34.873223621 +0000 UTC m=+55.939829141" watchObservedRunningTime="2026-05-21 16:52:34.874690336 +0000 UTC m=+55.941295903"
May 21 16:52:38.681089 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:38.681049    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9nfr2"
May 21 16:52:44.523213 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.523180    2570 scope.go:117] "RemoveContainer" containerID="2afcbe659a828f2b5b964c9d7e97cde08730d4a72bc0d5029f1a97631f9af40c"
May 21 16:52:44.718629 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.718586    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:44.720901 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.720877    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"image-registry-7b48476d6-8g2dc\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") " pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:44.820254 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.820157    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:44.820394 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.820252    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:44.820394 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.820311    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:44.820968 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.820942    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-service-ca-bundle\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:44.822508 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.822477    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0b9a1b3-46f9-499e-8df8-0e172600f3d8-metrics-certs\") pod \"router-default-759f558cf8-g47cn\" (UID: \"f0b9a1b3-46f9-499e-8df8-0e172600f3d8\") " pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:44.822652 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.822629    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d788d44b-42ee-4a8b-aa59-01b52dc6ac39-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bfwbd\" (UID: \"d788d44b-42ee-4a8b-aa59-01b52dc6ac39\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:44.881227 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.881197    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 16:52:44.881377 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.881290    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" event={"ID":"56bc23ef-0dbc-4546-a260-89b22add976f","Type":"ContainerStarted","Data":"f5b55e49e4b41015abe694af984571a0d458ff012e31c5c7c374bb8c7327d370"}
May 21 16:52:44.881634 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.881610    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:44.900988 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.900936    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" podStartSLOduration=37.103708466 podStartE2EDuration="50.900922664s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:15.23514145 +0000 UTC m=+36.301746960" lastFinishedPulling="2026-05-21 16:52:29.032355651 +0000 UTC m=+50.098961158" observedRunningTime="2026-05-21 16:52:44.899915774 +0000 UTC m=+65.966521295" watchObservedRunningTime="2026-05-21 16:52:44.900922664 +0000 UTC m=+65.967528186"
May 21 16:52:44.913778 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.913754    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jq5vp\""
May 21 16:52:44.921328 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.921306    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:44.921397 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.921339    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:44.921397 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.921364    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:52:44.921500 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:44.921479    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 16:52:44.921617 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:44.921539    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls podName:1b80bd91-e87c-4d96-86d8-34b1b4ac2b08 nodeName:}" failed. No retries permitted until 2026-05-21 16:53:16.921524051 +0000 UTC m=+97.988129568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-54zlq" (UID: "1b80bd91-e87c-4d96-86d8-34b1b4ac2b08") : secret "cluster-monitoring-operator-tls" not found
May 21 16:52:44.923942 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.923923    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4de536e-269e-4768-a35e-a334709a0e63-cert\") pod \"ingress-canary-hh2fc\" (UID: \"f4de536e-269e-4768-a35e-a334709a0e63\") " pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:44.955392 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.955364    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kpcvk\""
May 21 16:52:44.963713 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.963679    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:44.977712 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.977358    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kwxnv\""
May 21 16:52:44.985724 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:44.984884    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"
May 21 16:52:45.023750 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.022775    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:52:45.023750 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.022903    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:45.023750 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:45.023162    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:52:45.023750 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:45.023232    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert podName:63b02428-e2d1-4cd6-a30b-aad3451ed47e nodeName:}" failed. No retries permitted until 2026-05-21 16:53:17.023209935 +0000 UTC m=+98.089815435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-q66qj" (UID: "63b02428-e2d1-4cd6-a30b-aad3451ed47e") : secret "networking-console-plugin-cert" not found
May 21 16:52:45.027287 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.027193    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ff6cae9-27ab-41b1-905f-200b0d57f825-metrics-tls\") pod \"dns-default-hvwvq\" (UID: \"6ff6cae9-27ab-41b1-905f-200b0d57f825\") " pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:45.070492 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.070215    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:52:45.074319 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:45.074267    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ede28a5_556c_46bc_8073_ef0dc219cb0a.slice/crio-d14d001286d3c8f1f9f8189cd7a6ddf47dba2982d873681504e22cd39ec7a893 WatchSource:0}: Error finding container d14d001286d3c8f1f9f8189cd7a6ddf47dba2982d873681504e22cd39ec7a893: Status 404 returned error can't find the container with id d14d001286d3c8f1f9f8189cd7a6ddf47dba2982d873681504e22cd39ec7a893
May 21 16:52:45.119858 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.119830    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d2hft\""
May 21 16:52:45.125957 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.125920    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759f558cf8-g47cn"]
May 21 16:52:45.127517 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.127501    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hh2fc"
May 21 16:52:45.130267 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:45.130236    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b9a1b3_46f9_499e_8df8_0e172600f3d8.slice/crio-4562fa24381808d061f17008320551c2af962fdb80c1b3b872d9aedbc8d38704 WatchSource:0}: Error finding container 4562fa24381808d061f17008320551c2af962fdb80c1b3b872d9aedbc8d38704: Status 404 returned error can't find the container with id 4562fa24381808d061f17008320551c2af962fdb80c1b3b872d9aedbc8d38704
May 21 16:52:45.137935 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.137910    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd"]
May 21 16:52:45.216168 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.216055    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr4fs\""
May 21 16:52:45.224158 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.224138    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:45.224366 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.224346    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:52:45.226666 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.226646    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 16:52:45.235522 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:45.235419    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:52:45.235522 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:52:45.235490    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs podName:49c4e0d0-2a0c-4bc2-ba8b-884b0c472870 nodeName:}" failed. No retries permitted until 2026-05-21 16:53:49.235468656 +0000 UTC m=+130.302074174 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs") pod "network-metrics-daemon-fvlmp" (UID: "49c4e0d0-2a0c-4bc2-ba8b-884b0c472870") : secret "metrics-daemon-secret" not found
May 21 16:52:45.297672 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.297617    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hh2fc"]
May 21 16:52:45.302098 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:45.302015    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4de536e_269e_4768_a35e_a334709a0e63.slice/crio-7333b17bb380c5d376ca7aa906db7896f0549dfd8b447139a8717e25b44fe6e2 WatchSource:0}: Error finding container 7333b17bb380c5d376ca7aa906db7896f0549dfd8b447139a8717e25b44fe6e2: Status 404 returned error can't find the container with id 7333b17bb380c5d376ca7aa906db7896f0549dfd8b447139a8717e25b44fe6e2
May 21 16:52:45.373726 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.373685    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvwvq"]
May 21 16:52:45.376946 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:45.376918    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff6cae9_27ab_41b1_905f_200b0d57f825.slice/crio-c0006f81ec830995702381784507cf07a396b920c8e99e021535dd3e6b2aedac WatchSource:0}: Error finding container c0006f81ec830995702381784507cf07a396b920c8e99e021535dd3e6b2aedac: Status 404 returned error can't find the container with id c0006f81ec830995702381784507cf07a396b920c8e99e021535dd3e6b2aedac
May 21 16:52:45.881664 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.881615    2570 patch_prober.go:28] interesting pod/console-operator-76dff48d59-dzdsv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.6:8443/readyz\": context deadline exceeded" start-of-body=
May 21 16:52:45.882164 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.881691    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv" podUID="56bc23ef-0dbc-4546-a260-89b22add976f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.6:8443/readyz\": context deadline exceeded"
May 21 16:52:45.886716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.886458    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759f558cf8-g47cn" event={"ID":"f0b9a1b3-46f9-499e-8df8-0e172600f3d8","Type":"ContainerStarted","Data":"b188adbcbb1d820afc7a96a1ffcf7ed38322ea19bb1316fb9e15f6cedae2d65b"}
May 21 16:52:45.886716 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.886495    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759f558cf8-g47cn" event={"ID":"f0b9a1b3-46f9-499e-8df8-0e172600f3d8","Type":"ContainerStarted","Data":"4562fa24381808d061f17008320551c2af962fdb80c1b3b872d9aedbc8d38704"}
May 21 16:52:45.889383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.889335    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd" event={"ID":"d788d44b-42ee-4a8b-aa59-01b52dc6ac39","Type":"ContainerStarted","Data":"f44ac2d93331b8ea68509d0a5d60a7c66392089835dd63e6a8bb65da4bf3ba87"}
May 21 16:52:45.891064 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.891033    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvq" event={"ID":"6ff6cae9-27ab-41b1-905f-200b0d57f825","Type":"ContainerStarted","Data":"c0006f81ec830995702381784507cf07a396b920c8e99e021535dd3e6b2aedac"}
May 21 16:52:45.892320 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.892281    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hh2fc" event={"ID":"f4de536e-269e-4768-a35e-a334709a0e63","Type":"ContainerStarted","Data":"7333b17bb380c5d376ca7aa906db7896f0549dfd8b447139a8717e25b44fe6e2"}
May 21 16:52:45.894561 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.894534    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" event={"ID":"9ede28a5-556c-46bc-8073-ef0dc219cb0a","Type":"ContainerStarted","Data":"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"}
May 21 16:52:45.894654 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.894570    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" event={"ID":"9ede28a5-556c-46bc-8073-ef0dc219cb0a","Type":"ContainerStarted","Data":"d14d001286d3c8f1f9f8189cd7a6ddf47dba2982d873681504e22cd39ec7a893"}
May 21 16:52:45.894721 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.894707    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:52:45.907577 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.907528    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-759f558cf8-g47cn" podStartSLOduration=51.907511815 podStartE2EDuration="51.907511815s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:52:45.905840717 +0000 UTC m=+66.972446238" watchObservedRunningTime="2026-05-21 16:52:45.907511815 +0000 UTC m=+66.974117336"
May 21 16:52:45.926513 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.926384    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" podStartSLOduration=65.92635999 podStartE2EDuration="1m5.92635999s" podCreationTimestamp="2026-05-21 16:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:52:45.924923711 +0000 UTC m=+66.991529236" watchObservedRunningTime="2026-05-21 16:52:45.92635999 +0000 UTC m=+66.992965506"
May 21 16:52:45.964880 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.964843    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:45.967779 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.967730    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:45.978988 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:45.978962    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-dzdsv"
May 21 16:52:46.898527 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:46.898482    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:46.899666 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:46.899639    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-759f558cf8-g47cn"
May 21 16:52:48.904949 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.904913    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd" event={"ID":"d788d44b-42ee-4a8b-aa59-01b52dc6ac39","Type":"ContainerStarted","Data":"8797086451bfa11f2733399143644fad3e1dfa6ab15a3cca381a53f505e5918a"}
May 21 16:52:48.905396 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.904953    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd" event={"ID":"d788d44b-42ee-4a8b-aa59-01b52dc6ac39","Type":"ContainerStarted","Data":"305f30a2de0252fd4da9547173966e47a2abfaa78b194f21cf1b5474555b4755"}
May 21 16:52:48.906462 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.906438    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvq" event={"ID":"6ff6cae9-27ab-41b1-905f-200b0d57f825","Type":"ContainerStarted","Data":"61b0ffaa8a5dfb3f950a894f66b062f0e63d34eed610eed4e473b5da4d89cc95"}
May 21 16:52:48.906573 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.906466    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvq" event={"ID":"6ff6cae9-27ab-41b1-905f-200b0d57f825","Type":"ContainerStarted","Data":"c6988521c2bf6ecd88aa7a1b8c7a087119dd46844ec7fc83e64f9f259b6aa4cc"}
May 21 16:52:48.906627 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.906582    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:48.907692 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.907672    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hh2fc" event={"ID":"f4de536e-269e-4768-a35e-a334709a0e63","Type":"ContainerStarted","Data":"e1950f6a38c58b7991711a93db841c13d755181671eab076fe9af4102798d411"}
May 21 16:52:48.927658 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.927619    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bfwbd" podStartSLOduration=51.65344677 podStartE2EDuration="54.927607739s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:45.228640734 +0000 UTC m=+66.295246235" lastFinishedPulling="2026-05-21 16:52:48.502801702 +0000 UTC m=+69.569407204" observedRunningTime="2026-05-21 16:52:48.926532324 +0000 UTC m=+69.993137845" watchObservedRunningTime="2026-05-21 16:52:48.927607739 +0000 UTC m=+69.994213257"
May 21 16:52:48.943325 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.943286    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hvwvq" podStartSLOduration=33.820235871 podStartE2EDuration="36.943274322s" podCreationTimestamp="2026-05-21 16:52:12 +0000 UTC" firstStartedPulling="2026-05-21 16:52:45.379835202 +0000 UTC m=+66.446440713" lastFinishedPulling="2026-05-21 16:52:48.502873653 +0000 UTC m=+69.569479164" observedRunningTime="2026-05-21 16:52:48.942710163 +0000 UTC m=+70.009315699" watchObservedRunningTime="2026-05-21 16:52:48.943274322 +0000 UTC m=+70.009879841"
May 21 16:52:48.958550 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:48.958511    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hh2fc" podStartSLOduration=33.754921951 podStartE2EDuration="36.958500474s" podCreationTimestamp="2026-05-21 16:52:12 +0000 UTC" firstStartedPulling="2026-05-21 16:52:45.303944217 +0000 UTC m=+66.370549721" lastFinishedPulling="2026-05-21 16:52:48.507522748 +0000 UTC m=+69.574128244" observedRunningTime="2026-05-21 16:52:48.958262625 +0000 UTC m=+70.024868156" watchObservedRunningTime="2026-05-21 16:52:48.958500474 +0000 UTC m=+70.025105993"
May 21 16:52:54.624120 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.624085    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zsv5k"]
May 21 16:52:54.653458 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.653426    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zsv5k"]
May 21 16:52:54.653730 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.653652    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.659668 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.659642    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 16:52:54.659830 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.659690    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 16:52:54.659830 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.659642    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ndzlk\""
May 21 16:52:54.810258 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.810176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhwk\" (UniqueName: \"kubernetes.io/projected/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-api-access-9nhwk\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.810402 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.810284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.810402 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.810351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76eb6649-c40f-4d4b-8116-1361f39e5661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.810402 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.810385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76eb6649-c40f-4d4b-8116-1361f39e5661-data-volume\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.810501 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.810462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76eb6649-c40f-4d4b-8116-1361f39e5661-crio-socket\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.910902 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.910868    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.910928    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76eb6649-c40f-4d4b-8116-1361f39e5661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.910959    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76eb6649-c40f-4d4b-8116-1361f39e5661-data-volume\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.910980    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76eb6649-c40f-4d4b-8116-1361f39e5661-crio-socket\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.911006    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhwk\" (UniqueName: \"kubernetes.io/projected/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-api-access-9nhwk\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.911105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76eb6649-c40f-4d4b-8116-1361f39e5661-crio-socket\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911383 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.911365    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76eb6649-c40f-4d4b-8116-1361f39e5661-data-volume\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.911553 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.911536    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.913385 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.913364    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76eb6649-c40f-4d4b-8116-1361f39e5661-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.938060 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.938023    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhwk\" (UniqueName: \"kubernetes.io/projected/76eb6649-c40f-4d4b-8116-1361f39e5661-kube-api-access-9nhwk\") pod \"insights-runtime-extractor-zsv5k\" (UID: \"76eb6649-c40f-4d4b-8116-1361f39e5661\") " pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:54.963213 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:54.963179    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zsv5k"
May 21 16:52:55.177227 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:55.177192    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zsv5k"]
May 21 16:52:55.181873 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:52:55.181842    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76eb6649_c40f_4d4b_8116_1361f39e5661.slice/crio-7353675e7bb2d309ae0de23dd18139697d928110fbb303c39f1e0f33d7213d9f WatchSource:0}: Error finding container 7353675e7bb2d309ae0de23dd18139697d928110fbb303c39f1e0f33d7213d9f: Status 404 returned error can't find the container with id 7353675e7bb2d309ae0de23dd18139697d928110fbb303c39f1e0f33d7213d9f
May 21 16:52:55.928264 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:55.928236    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsv5k" event={"ID":"76eb6649-c40f-4d4b-8116-1361f39e5661","Type":"ContainerStarted","Data":"00ec63e5c7a24587c440ef8173449a4bd38a8c875a56f037a01a76c031c74643"}
May 21 16:52:55.928264 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:55.928268    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsv5k" event={"ID":"76eb6649-c40f-4d4b-8116-1361f39e5661","Type":"ContainerStarted","Data":"7353675e7bb2d309ae0de23dd18139697d928110fbb303c39f1e0f33d7213d9f"}
May 21 16:52:56.932036 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:56.931999    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsv5k" event={"ID":"76eb6649-c40f-4d4b-8116-1361f39e5661","Type":"ContainerStarted","Data":"099898fa44503c46f9f09bc60bbf6823f5a43a5f85d9f9e09f93b2c5810a1969"}
May 21 16:52:58.912732 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:58.912700    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvwvq"
May 21 16:52:58.953476 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:58.953443    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zsv5k" event={"ID":"76eb6649-c40f-4d4b-8116-1361f39e5661","Type":"ContainerStarted","Data":"b85f23bda388a6cf1ed0bb7779ed3779a52d4c614577ccb4f8227290aa707413"}
May 21 16:52:59.008702 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:52:59.008567    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zsv5k" podStartSLOduration=2.283403231 podStartE2EDuration="5.008551944s" podCreationTimestamp="2026-05-21 16:52:54 +0000 UTC" firstStartedPulling="2026-05-21 16:52:55.312500574 +0000 UTC m=+76.379106072" lastFinishedPulling="2026-05-21 16:52:58.037649288 +0000 UTC m=+79.104254785" observedRunningTime="2026-05-21 16:52:59.007632185 +0000 UTC m=+80.074237703" watchObservedRunningTime="2026-05-21 16:52:59.008551944 +0000 UTC m=+80.075157515"
May 21 16:53:00.835708 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:00.835671    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nj9vt"
May 21 16:53:04.925917 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:04.925879    2570 patch_prober.go:28] interesting pod/image-registry-7b48476d6-8g2dc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 16:53:04.926297 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:04.925931    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:53:06.903409 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:06.903382    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:53:16.751242 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:16.751211    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:53:16.993353 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:16.993316    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:53:16.995934 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:16.995895    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b80bd91-e87c-4d96-86d8-34b1b4ac2b08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-54zlq\" (UID: \"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:53:17.094670 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.094622    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:53:17.097289 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.097265    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63b02428-e2d1-4cd6-a30b-aad3451ed47e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q66qj\" (UID: \"63b02428-e2d1-4cd6-a30b-aad3451ed47e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:53:17.137775 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.137748    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c4z4x\""
May 21 16:53:17.145226 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.145204    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"
May 21 16:53:17.237117 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.237088    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-84gcb\""
May 21 16:53:17.244530 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.244450    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"
May 21 16:53:17.284278 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.284245    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq"]
May 21 16:53:17.289046 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:53:17.289010    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b80bd91_e87c_4d96_86d8_34b1b4ac2b08.slice/crio-5ff9aaba2480c81709a1d5e72a0b610c46d244541e0e451219adbc33ad958cf2 WatchSource:0}: Error finding container 5ff9aaba2480c81709a1d5e72a0b610c46d244541e0e451219adbc33ad958cf2: Status 404 returned error can't find the container with id 5ff9aaba2480c81709a1d5e72a0b610c46d244541e0e451219adbc33ad958cf2
May 21 16:53:17.384804 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:17.384772    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj"]
May 21 16:53:17.388026 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:53:17.387996    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b02428_e2d1_4cd6_a30b_aad3451ed47e.slice/crio-94a3108ff42bced633d2e0dbcd7bc1a465ca178eb4a3a5f2703e319d389f21d5 WatchSource:0}: Error finding container 94a3108ff42bced633d2e0dbcd7bc1a465ca178eb4a3a5f2703e319d389f21d5: Status 404 returned error can't find the container with id 94a3108ff42bced633d2e0dbcd7bc1a465ca178eb4a3a5f2703e319d389f21d5
May 21 16:53:18.006297 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:18.006253    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj" event={"ID":"63b02428-e2d1-4cd6-a30b-aad3451ed47e","Type":"ContainerStarted","Data":"94a3108ff42bced633d2e0dbcd7bc1a465ca178eb4a3a5f2703e319d389f21d5"}
May 21 16:53:18.007477 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:18.007445    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq" event={"ID":"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08","Type":"ContainerStarted","Data":"5ff9aaba2480c81709a1d5e72a0b610c46d244541e0e451219adbc33ad958cf2"}
May 21 16:53:19.012463 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:19.012374    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj" event={"ID":"63b02428-e2d1-4cd6-a30b-aad3451ed47e","Type":"ContainerStarted","Data":"a016e56666bd31d5def439689d8ba7d6a5cb6cb65bc5604bbdd02db9a0a06f42"}
May 21 16:53:19.032189 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:19.032143    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q66qj" podStartSLOduration=76.762007964 podStartE2EDuration="1m18.032124114s" podCreationTimestamp="2026-05-21 16:52:01 +0000 UTC" firstStartedPulling="2026-05-21 16:53:17.390024919 +0000 UTC m=+98.456630417" lastFinishedPulling="2026-05-21 16:53:18.660141056 +0000 UTC m=+99.726746567" observedRunningTime="2026-05-21 16:53:19.031128645 +0000 UTC m=+100.097734165" watchObservedRunningTime="2026-05-21 16:53:19.032124114 +0000 UTC m=+100.098729632"
May 21 16:53:20.017558 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:20.017512    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq" event={"ID":"1b80bd91-e87c-4d96-86d8-34b1b4ac2b08","Type":"ContainerStarted","Data":"f89a938faba78014fb3fcaada23b5ee39308c6ead75f84b5266a62114590f55d"}
May 21 16:53:20.040496 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:20.040449    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-54zlq" podStartSLOduration=84.144003405 podStartE2EDuration="1m26.040433678s" podCreationTimestamp="2026-05-21 16:51:54 +0000 UTC" firstStartedPulling="2026-05-21 16:53:17.291113712 +0000 UTC m=+98.357719211" lastFinishedPulling="2026-05-21 16:53:19.187543983 +0000 UTC m=+100.254149484" observedRunningTime="2026-05-21 16:53:20.039944942 +0000 UTC m=+101.106550488" watchObservedRunningTime="2026-05-21 16:53:20.040433678 +0000 UTC m=+101.107039196"
May 21 16:53:27.289876 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.289842    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-76gzt"]
May 21 16:53:27.293715 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.293697    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.297737 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.297715    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 16:53:27.298007 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.297992    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 16:53:27.298249 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.298231    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 16:53:27.298373 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.298357    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbth8\""
May 21 16:53:27.299317 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.299299    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 16:53:27.389153 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-root\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389153 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389344 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-sys\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389344 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-wtmp\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389344 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-tls\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389344 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-accelerators-collector-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389479 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwd9\" (UniqueName: \"kubernetes.io/projected/9798d03b-7123-47b4-83dc-8dad466ae662-kube-api-access-9gwd9\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389479 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-metrics-client-ca\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.389479 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.389427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-textfile\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490113 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490061    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwd9\" (UniqueName: \"kubernetes.io/projected/9798d03b-7123-47b4-83dc-8dad466ae662-kube-api-access-9gwd9\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490140    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-metrics-client-ca\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490174    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-textfile\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490227    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-root\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490261    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490304 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490293    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-sys\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490326    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-wtmp\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490343    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-root\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490359    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-tls\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490370    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-sys\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490385    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-accelerators-collector-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490559 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490496    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-wtmp\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490852 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490754    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-textfile\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490852 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490776    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-metrics-client-ca\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.490997 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.490981    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-accelerators-collector-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.492603 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.492579    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.492749 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.492727    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9798d03b-7123-47b4-83dc-8dad466ae662-node-exporter-tls\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.498566 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.498543    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwd9\" (UniqueName: \"kubernetes.io/projected/9798d03b-7123-47b4-83dc-8dad466ae662-kube-api-access-9gwd9\") pod \"node-exporter-76gzt\" (UID: \"9798d03b-7123-47b4-83dc-8dad466ae662\") " pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.603038 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:27.602949    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76gzt"
May 21 16:53:27.611428 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:53:27.611393    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9798d03b_7123_47b4_83dc_8dad466ae662.slice/crio-b142a97a770aee32cc9005aad3c8686783b457967f52a9d7e24965aa29afb057 WatchSource:0}: Error finding container b142a97a770aee32cc9005aad3c8686783b457967f52a9d7e24965aa29afb057: Status 404 returned error can't find the container with id b142a97a770aee32cc9005aad3c8686783b457967f52a9d7e24965aa29afb057
May 21 16:53:28.039874 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:28.039838    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76gzt" event={"ID":"9798d03b-7123-47b4-83dc-8dad466ae662","Type":"ContainerStarted","Data":"b142a97a770aee32cc9005aad3c8686783b457967f52a9d7e24965aa29afb057"}
May 21 16:53:29.043848 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:29.043815    2570 generic.go:358] "Generic (PLEG): container finished" podID="9798d03b-7123-47b4-83dc-8dad466ae662" containerID="4649d24683b693912fb2efbd0157ef0d750f6483448c167c0e0d7ebb84e82e3d" exitCode=0
May 21 16:53:29.044233 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:29.043911    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76gzt" event={"ID":"9798d03b-7123-47b4-83dc-8dad466ae662","Type":"ContainerDied","Data":"4649d24683b693912fb2efbd0157ef0d750f6483448c167c0e0d7ebb84e82e3d"}
May 21 16:53:30.048346 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:30.048310    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76gzt" event={"ID":"9798d03b-7123-47b4-83dc-8dad466ae662","Type":"ContainerStarted","Data":"53899a0e56fd3d47c4930fe6a1e278f9761a8edc08862d63d947dbc615ac3fb6"}
May 21 16:53:30.048346 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:30.048347    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76gzt" event={"ID":"9798d03b-7123-47b4-83dc-8dad466ae662","Type":"ContainerStarted","Data":"8a959c57eb9695aa7c175da3ffd9f46a5dc67b0ea2df6105385d362d72b37523"}
May 21 16:53:30.071595 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:30.071543    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-76gzt" podStartSLOduration=2.083762077 podStartE2EDuration="3.071528954s" podCreationTimestamp="2026-05-21 16:53:27 +0000 UTC" firstStartedPulling="2026-05-21 16:53:27.612838367 +0000 UTC m=+108.679443863" lastFinishedPulling="2026-05-21 16:53:28.600605239 +0000 UTC m=+109.667210740" observedRunningTime="2026-05-21 16:53:30.069545393 +0000 UTC m=+111.136150925" watchObservedRunningTime="2026-05-21 16:53:30.071528954 +0000 UTC m=+111.138134473"
May 21 16:53:41.081997 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.081962    2570 generic.go:358] "Generic (PLEG): container finished" podID="ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826" containerID="7db985d5c2544d98aece81168f3d0f34f4982602dcdbdb875c0b3774e6dac28b" exitCode=0
May 21 16:53:41.082455 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.082038    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vppgx" event={"ID":"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826","Type":"ContainerDied","Data":"7db985d5c2544d98aece81168f3d0f34f4982602dcdbdb875c0b3774e6dac28b"}
May 21 16:53:41.082455 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.082432    2570 scope.go:117] "RemoveContainer" containerID="7db985d5c2544d98aece81168f3d0f34f4982602dcdbdb875c0b3774e6dac28b"
May 21 16:53:41.773437 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.773364    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerName="registry" containerID="cri-o://e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd" gracePeriod=30
May 21 16:53:41.783355 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.783329    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759f558cf8-g47cn_f0b9a1b3-46f9-499e-8df8-0e172600f3d8/router/0.log"
May 21 16:53:41.798466 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:41.798444    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hh2fc_f4de536e-269e-4768-a35e-a334709a0e63/serve-healthcheck-canary/0.log"
May 21 16:53:42.053062 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.053037    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:53:42.086642 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.086610    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vppgx" event={"ID":"ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826","Type":"ContainerStarted","Data":"6382b9ccfede53ec8c6afc9ca04c4c4ec5592e2453939527d4110bffd7dca4af"}
May 21 16:53:42.087767 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.087744    2570 generic.go:358] "Generic (PLEG): container finished" podID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerID="e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd" exitCode=0
May 21 16:53:42.087862 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.087799    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc"
May 21 16:53:42.087898 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.087794    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" event={"ID":"9ede28a5-556c-46bc-8073-ef0dc219cb0a","Type":"ContainerDied","Data":"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"}
May 21 16:53:42.087928 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.087902    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b48476d6-8g2dc" event={"ID":"9ede28a5-556c-46bc-8073-ef0dc219cb0a","Type":"ContainerDied","Data":"d14d001286d3c8f1f9f8189cd7a6ddf47dba2982d873681504e22cd39ec7a893"}
May 21 16:53:42.087928 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.087917    2570 scope.go:117] "RemoveContainer" containerID="e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"
May 21 16:53:42.099066 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.099038    2570 scope.go:117] "RemoveContainer" containerID="e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"
May 21 16:53:42.099538 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:53:42.099496    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd\": container with ID starting with e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd not found: ID does not exist" containerID="e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"
May 21 16:53:42.099612 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.099540    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd"} err="failed to get container status \"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd\": rpc error: code = NotFound desc = could not find container \"e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd\": container with ID starting with e33a92db6933253266853bfc1e5ca9c3b76d3f457f26bb5fab4a9d935c7c5ffd not found: ID does not exist"
May 21 16:53:42.125958 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.125927    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.126146 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.125965    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.126146 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.125989    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.126146 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.126021    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.126146 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.126053    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.126685 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.126494    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:53:42.126685 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.126535    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:53:42.128910 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.128883    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:53:42.129012 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.128961    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:53:42.134268 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.134243    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 16:53:42.227275 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227236    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cdrn\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.227472 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227326    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.227472 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227345    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") pod \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\" (UID: \"9ede28a5-556c-46bc-8073-ef0dc219cb0a\") "
May 21 16:53:42.227591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227480    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-image-registry-private-configuration\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.227591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227497    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ede28a5-556c-46bc-8073-ef0dc219cb0a-installation-pull-secrets\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.227591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227511    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ede28a5-556c-46bc-8073-ef0dc219cb0a-ca-trust-extracted\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.227591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227525    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-certificates\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.227591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.227540    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ede28a5-556c-46bc-8073-ef0dc219cb0a-trusted-ca\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.229474 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.229432    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn" (OuterVolumeSpecName: "kube-api-access-9cdrn") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "kube-api-access-9cdrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:53:42.229591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.229483    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:53:42.229591 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.229512    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ede28a5-556c-46bc-8073-ef0dc219cb0a" (UID: "9ede28a5-556c-46bc-8073-ef0dc219cb0a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:53:42.327995 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.327892    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cdrn\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-kube-api-access-9cdrn\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.327995 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.327937    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-bound-sa-token\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.327995 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.327947    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ede28a5-556c-46bc-8073-ef0dc219cb0a-registry-tls\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:53:42.410212 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.410183    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:53:42.413574 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:42.413548    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b48476d6-8g2dc"]
May 21 16:53:43.527395 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:43.527356    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" path="/var/lib/kubelet/pods/9ede28a5-556c-46bc-8073-ef0dc219cb0a/volumes"
May 21 16:53:45.098668 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:45.098637    2570 generic.go:358] "Generic (PLEG): container finished" podID="e1c30838-7772-4c96-8ea3-c66c6a5382a1" containerID="aa02082cf62286c23d0eeaa2b9dab47ceaf069ab1544e355e4d9a83f7145cfc1" exitCode=0
May 21 16:53:45.099011 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:45.098714    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn" event={"ID":"e1c30838-7772-4c96-8ea3-c66c6a5382a1","Type":"ContainerDied","Data":"aa02082cf62286c23d0eeaa2b9dab47ceaf069ab1544e355e4d9a83f7145cfc1"}
May 21 16:53:45.099051 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:45.099016    2570 scope.go:117] "RemoveContainer" containerID="aa02082cf62286c23d0eeaa2b9dab47ceaf069ab1544e355e4d9a83f7145cfc1"
May 21 16:53:46.103034 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:46.103000    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-p2wmn" event={"ID":"e1c30838-7772-4c96-8ea3-c66c6a5382a1","Type":"ContainerStarted","Data":"bf57ab4f6bb8f85c10661f0f2a0a77035ecf59b9bd140fd84a485e4afc6e8439"}
May 21 16:53:49.285710 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:49.285672    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:53:49.287960 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:49.287939    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49c4e0d0-2a0c-4bc2-ba8b-884b0c472870-metrics-certs\") pod \"network-metrics-daemon-fvlmp\" (UID: \"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870\") " pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:53:49.346399 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:49.346369    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6bk46\""
May 21 16:53:49.353768 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:49.353749    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvlmp"
May 21 16:53:49.485787 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:49.485753    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvlmp"]
May 21 16:53:49.488798 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:53:49.488766    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c4e0d0_2a0c_4bc2_ba8b_884b0c472870.slice/crio-9ab5211e8812047aa77ad912c79bc157c555a9cda67a84f66ae2919743bda8e1 WatchSource:0}: Error finding container 9ab5211e8812047aa77ad912c79bc157c555a9cda67a84f66ae2919743bda8e1: Status 404 returned error can't find the container with id 9ab5211e8812047aa77ad912c79bc157c555a9cda67a84f66ae2919743bda8e1
May 21 16:53:50.115051 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:50.115003    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvlmp" event={"ID":"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870","Type":"ContainerStarted","Data":"9ab5211e8812047aa77ad912c79bc157c555a9cda67a84f66ae2919743bda8e1"}
May 21 16:53:51.119148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:51.119110    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvlmp" event={"ID":"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870","Type":"ContainerStarted","Data":"7b56d9320d552db34197b2b10a092c17221039c9c2e969996939942e1734e6c2"}
May 21 16:53:51.119148 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:51.119150    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvlmp" event={"ID":"49c4e0d0-2a0c-4bc2-ba8b-884b0c472870","Type":"ContainerStarted","Data":"6746bea8fbf1cf09dbad105c25bd72583bce24c37e62f76c2e57f4e3a111f0c9"}
May 21 16:53:51.136978 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:51.136930    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fvlmp" podStartSLOduration=131.102805805 podStartE2EDuration="2m12.136916122s" podCreationTimestamp="2026-05-21 16:51:39 +0000 UTC" firstStartedPulling="2026-05-21 16:53:49.490708282 +0000 UTC m=+130.557313790" lastFinishedPulling="2026-05-21 16:53:50.52481861 +0000 UTC m=+131.591424107" observedRunningTime="2026-05-21 16:53:51.135009276 +0000 UTC m=+132.201614794" watchObservedRunningTime="2026-05-21 16:53:51.136916122 +0000 UTC m=+132.203521641"
May 21 16:53:55.135974 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:55.135922    2570 generic.go:358] "Generic (PLEG): container finished" podID="b395f33b-31b2-4389-8424-a86627a896eb" containerID="2524a96899cfcdbf251c684a2a5e0e76c2f63e85178c6a1f2dc2165465f2456f" exitCode=0
May 21 16:53:55.136412 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:55.136092    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj" event={"ID":"b395f33b-31b2-4389-8424-a86627a896eb","Type":"ContainerDied","Data":"2524a96899cfcdbf251c684a2a5e0e76c2f63e85178c6a1f2dc2165465f2456f"}
May 21 16:53:55.136516 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:55.136493    2570 scope.go:117] "RemoveContainer" containerID="2524a96899cfcdbf251c684a2a5e0e76c2f63e85178c6a1f2dc2165465f2456f"
May 21 16:53:56.141295 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:53:56.141260    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-x4ddj" event={"ID":"b395f33b-31b2-4389-8424-a86627a896eb","Type":"ContainerStarted","Data":"ab269e68306f52f085167a141d1c99351a8ba80cdd4e26ccd7074f8bc8207807"}
May 21 16:54:03.378176 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:03.378133    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" podUID="36fa5ffd-e55d-477c-aa3d-73ef37b901e5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:54:13.378610 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:13.378569    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" podUID="36fa5ffd-e55d-477c-aa3d-73ef37b901e5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:54:23.377959 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:23.377922    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" podUID="36fa5ffd-e55d-477c-aa3d-73ef37b901e5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:54:23.378351 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:23.377987    2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb"
May 21 16:54:23.378464 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:23.378438    2570 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e582d7a5572d1cd46523c0fbf1d69fb39927b3fd9a21bc9e51da8702b232c119"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 16:54:23.378509 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:23.378483    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" podUID="36fa5ffd-e55d-477c-aa3d-73ef37b901e5" containerName="service-proxy" containerID="cri-o://e582d7a5572d1cd46523c0fbf1d69fb39927b3fd9a21bc9e51da8702b232c119" gracePeriod=30
May 21 16:54:24.219996 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:24.219963    2570 generic.go:358] "Generic (PLEG): container finished" podID="36fa5ffd-e55d-477c-aa3d-73ef37b901e5" containerID="e582d7a5572d1cd46523c0fbf1d69fb39927b3fd9a21bc9e51da8702b232c119" exitCode=2
May 21 16:54:24.220174 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:24.220016    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerDied","Data":"e582d7a5572d1cd46523c0fbf1d69fb39927b3fd9a21bc9e51da8702b232c119"}
May 21 16:54:24.220174 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:54:24.220045    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-568697446b-x77vb" event={"ID":"36fa5ffd-e55d-477c-aa3d-73ef37b901e5","Type":"ContainerStarted","Data":"13111118bccafdd1c77f04df38e70b70b6fc3e496221c52d7054ea7c0587cda9"}
May 21 16:56:39.441877 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:39.441841    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 16:56:39.442666 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:39.442649    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 16:56:39.450432 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:39.450411    2570 kubelet.go:1628] "Image garbage collection succeeded"
May 21 16:56:47.202775 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.202740    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"]
May 21 16:56:47.205254 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.203156    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerName="registry"
May 21 16:56:47.205254 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.203172    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerName="registry"
May 21 16:56:47.205254 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.203220    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ede28a5-556c-46bc-8073-ef0dc219cb0a" containerName="registry"
May 21 16:56:47.206124 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.206109    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.209937 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.209914    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 16:56:47.210364 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.210339    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rns4v\""
May 21 16:56:47.210772 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.210752    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 16:56:47.211142 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.211123    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 16:56:47.211770 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.211751    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 16:56:47.212693 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.212540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxsk\" (UniqueName: \"kubernetes.io/projected/43fb05f1-7276-49bb-8d89-1fac3f58baa4-kube-api-access-vtxsk\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.212693 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.212608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.212693 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.212646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.225546 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.225522    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"]
May 21 16:56:47.313256 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.313219    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxsk\" (UniqueName: \"kubernetes.io/projected/43fb05f1-7276-49bb-8d89-1fac3f58baa4-kube-api-access-vtxsk\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.313518 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.313272    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.313518 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.313304    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.315678 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.315654    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.315781 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.315691    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43fb05f1-7276-49bb-8d89-1fac3f58baa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.321044 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.321025    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxsk\" (UniqueName: \"kubernetes.io/projected/43fb05f1-7276-49bb-8d89-1fac3f58baa4-kube-api-access-vtxsk\") pod \"opendatahub-operator-controller-manager-5dd8cc67f-2bn8x\" (UID: \"43fb05f1-7276-49bb-8d89-1fac3f58baa4\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.516225 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.516121    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:47.645841 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.645808    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"]
May 21 16:56:47.650414 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:56:47.650384    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fb05f1_7276_49bb_8d89_1fac3f58baa4.slice/crio-72bcf1dc33558beb7b425170823c24018e2e213f0bc5996920f6152ef23aa52c WatchSource:0}: Error finding container 72bcf1dc33558beb7b425170823c24018e2e213f0bc5996920f6152ef23aa52c: Status 404 returned error can't find the container with id 72bcf1dc33558beb7b425170823c24018e2e213f0bc5996920f6152ef23aa52c
May 21 16:56:47.651947 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:47.651930    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:56:48.627374 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:48.627328    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x" event={"ID":"43fb05f1-7276-49bb-8d89-1fac3f58baa4","Type":"ContainerStarted","Data":"72bcf1dc33558beb7b425170823c24018e2e213f0bc5996920f6152ef23aa52c"}
May 21 16:56:50.640783 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:50.640747    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x" event={"ID":"43fb05f1-7276-49bb-8d89-1fac3f58baa4","Type":"ContainerStarted","Data":"19c99d6a47e4f958f26b1a064fa385b2fa858f853fbe0efbfa7843d611e27f0e"}
May 21 16:56:50.641256 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:50.640945    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:56:50.680002 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:56:50.679950    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x" podStartSLOduration=1.305786123 podStartE2EDuration="3.679933832s" podCreationTimestamp="2026-05-21 16:56:47 +0000 UTC" firstStartedPulling="2026-05-21 16:56:47.652055538 +0000 UTC m=+308.718661036" lastFinishedPulling="2026-05-21 16:56:50.026203249 +0000 UTC m=+311.092808745" observedRunningTime="2026-05-21 16:56:50.673282658 +0000 UTC m=+311.739888177" watchObservedRunningTime="2026-05-21 16:56:50.679933832 +0000 UTC m=+311.746539358"
May 21 16:57:01.645880 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:01.645846    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd8cc67f-2bn8x"
May 21 16:57:07.504257 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.504219    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vs6cp"]
May 21 16:57:07.507397 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.507380    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:07.509968 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.509944    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-khfmg\""
May 21 16:57:07.510059 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.509953    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 16:57:07.515748 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.515727    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vs6cp"]
May 21 16:57:07.573845 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.573808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:07.574015 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.573860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw762\" (UniqueName: \"kubernetes.io/projected/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-kube-api-access-rw762\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:07.675417 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.675377    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:07.675588 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.675458    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw762\" (UniqueName: \"kubernetes.io/projected/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-kube-api-access-rw762\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:07.675588 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:07.675531    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 16:57:07.675663 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:07.675599    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert podName:5ae21397-ca24-4145-9fdc-1acf09dd7dc5 nodeName:}" failed. No retries permitted until 2026-05-21 16:57:08.175581997 +0000 UTC m=+329.242187499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert") pod "odh-model-controller-858dbf95b8-vs6cp" (UID: "5ae21397-ca24-4145-9fdc-1acf09dd7dc5") : secret "odh-model-controller-webhook-cert" not found
May 21 16:57:07.684191 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:07.684147    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw762\" (UniqueName: \"kubernetes.io/projected/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-kube-api-access-rw762\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:08.179443 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:08.179393    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:08.179671 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:08.179549    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 16:57:08.179671 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:08.179643    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert podName:5ae21397-ca24-4145-9fdc-1acf09dd7dc5 nodeName:}" failed. No retries permitted until 2026-05-21 16:57:09.17962156 +0000 UTC m=+330.246227058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert") pod "odh-model-controller-858dbf95b8-vs6cp" (UID: "5ae21397-ca24-4145-9fdc-1acf09dd7dc5") : secret "odh-model-controller-webhook-cert" not found
May 21 16:57:09.185530 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:09.185500    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:09.187880 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:09.187854    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ae21397-ca24-4145-9fdc-1acf09dd7dc5-cert\") pod \"odh-model-controller-858dbf95b8-vs6cp\" (UID: \"5ae21397-ca24-4145-9fdc-1acf09dd7dc5\") " pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:09.318250 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:09.318213    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:09.448362 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:09.448283    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vs6cp"]
May 21 16:57:09.452303 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:57:09.452277    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae21397_ca24_4145_9fdc_1acf09dd7dc5.slice/crio-1dee2a2606f6360cf34f1b7c96d9cc263ad483968941807472cf29413a51a4c4 WatchSource:0}: Error finding container 1dee2a2606f6360cf34f1b7c96d9cc263ad483968941807472cf29413a51a4c4: Status 404 returned error can't find the container with id 1dee2a2606f6360cf34f1b7c96d9cc263ad483968941807472cf29413a51a4c4
May 21 16:57:09.700131 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:09.700029    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp" event={"ID":"5ae21397-ca24-4145-9fdc-1acf09dd7dc5","Type":"ContainerStarted","Data":"1dee2a2606f6360cf34f1b7c96d9cc263ad483968941807472cf29413a51a4c4"}
May 21 16:57:10.172678 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.172645    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-764769945-bfvr6"]
May 21 16:57:10.175625 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.175605    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.178312 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.178062    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wjfjc\""
May 21 16:57:10.178312 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.178141    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 16:57:10.178312 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.178139    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 16:57:10.186544 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.186519    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764769945-bfvr6"]
May 21 16:57:10.294434 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.294395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tls-certs\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.294616 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.294444    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjtnd\" (UniqueName: \"kubernetes.io/projected/713eafc2-e3e6-4adc-9e90-f22a3adf6399-kube-api-access-pjtnd\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.294616 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.294531    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tmp\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.396603 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.396004    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tls-certs\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.396603 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.396062    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjtnd\" (UniqueName: \"kubernetes.io/projected/713eafc2-e3e6-4adc-9e90-f22a3adf6399-kube-api-access-pjtnd\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.396603 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.396122    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tmp\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.399007 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.398977    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tmp\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.399332 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.399308    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713eafc2-e3e6-4adc-9e90-f22a3adf6399-tls-certs\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.407461 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.407433    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjtnd\" (UniqueName: \"kubernetes.io/projected/713eafc2-e3e6-4adc-9e90-f22a3adf6399-kube-api-access-pjtnd\") pod \"kube-auth-proxy-764769945-bfvr6\" (UID: \"713eafc2-e3e6-4adc-9e90-f22a3adf6399\") " pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.488054 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.487976    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6"
May 21 16:57:10.654825 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.654594    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764769945-bfvr6"]
May 21 16:57:10.657613 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:57:10.657578    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713eafc2_e3e6_4adc_9e90_f22a3adf6399.slice/crio-74230bcf404cff840452599a26e46b358b2b37971e787272978ff03dee7e9543 WatchSource:0}: Error finding container 74230bcf404cff840452599a26e46b358b2b37971e787272978ff03dee7e9543: Status 404 returned error can't find the container with id 74230bcf404cff840452599a26e46b358b2b37971e787272978ff03dee7e9543
May 21 16:57:10.704889 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:10.704849    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6" event={"ID":"713eafc2-e3e6-4adc-9e90-f22a3adf6399","Type":"ContainerStarted","Data":"74230bcf404cff840452599a26e46b358b2b37971e787272978ff03dee7e9543"}
May 21 16:57:13.447648 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.447616    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-f4ck9"]
May 21 16:57:13.455568 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.455535    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:13.458040 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.458014    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rvllv\""
May 21 16:57:13.458040 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.458031    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 16:57:13.461765 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.461737    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-f4ck9"]
May 21 16:57:13.524599 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.524563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:13.524779 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.524624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5nb2\" (UniqueName: \"kubernetes.io/projected/101859cd-89d0-48a7-9f4c-73ff40b35502-kube-api-access-s5nb2\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:13.625373 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.625334    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:13.625560 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.625390    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5nb2\" (UniqueName: \"kubernetes.io/projected/101859cd-89d0-48a7-9f4c-73ff40b35502-kube-api-access-s5nb2\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:13.625560 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:13.625493    2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 16:57:13.625668 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:57:13.625597    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert podName:101859cd-89d0-48a7-9f4c-73ff40b35502 nodeName:}" failed. No retries permitted until 2026-05-21 16:57:14.125571484 +0000 UTC m=+335.192176984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert") pod "kserve-controller-manager-856948b99f-f4ck9" (UID: "101859cd-89d0-48a7-9f4c-73ff40b35502") : secret "kserve-webhook-server-cert" not found
May 21 16:57:13.635098 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:13.635054    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5nb2\" (UniqueName: \"kubernetes.io/projected/101859cd-89d0-48a7-9f4c-73ff40b35502-kube-api-access-s5nb2\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:14.128911 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.128875    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:14.131174 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.131150    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/101859cd-89d0-48a7-9f4c-73ff40b35502-cert\") pod \"kserve-controller-manager-856948b99f-f4ck9\" (UID: \"101859cd-89d0-48a7-9f4c-73ff40b35502\") " pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:14.368565 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.368532    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:14.508298 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.508250    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-f4ck9"]
May 21 16:57:14.510461 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:57:14.510430    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101859cd_89d0_48a7_9f4c_73ff40b35502.slice/crio-dcc766331a291f1c9959023ccbae7ba7c744cba7328dcd3245d121481dc02762 WatchSource:0}: Error finding container dcc766331a291f1c9959023ccbae7ba7c744cba7328dcd3245d121481dc02762: Status 404 returned error can't find the container with id dcc766331a291f1c9959023ccbae7ba7c744cba7328dcd3245d121481dc02762
May 21 16:57:14.720172 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.720050    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp" event={"ID":"5ae21397-ca24-4145-9fdc-1acf09dd7dc5","Type":"ContainerStarted","Data":"222247e611073fbeb552ed4d19d4d8b77b566a374cd58512b1984957e0eaee49"}
May 21 16:57:14.720348 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.720284    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:14.721416 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.721394    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6" event={"ID":"713eafc2-e3e6-4adc-9e90-f22a3adf6399","Type":"ContainerStarted","Data":"ae943b5aa7a11208dcc676cdc9f9afc727a3dfb44435d5d0ffa18074f6ee84be"}
May 21 16:57:14.722425 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.722405    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9" event={"ID":"101859cd-89d0-48a7-9f4c-73ff40b35502","Type":"ContainerStarted","Data":"dcc766331a291f1c9959023ccbae7ba7c744cba7328dcd3245d121481dc02762"}
May 21 16:57:14.741499 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.741451    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp" podStartSLOduration=3.04699391 podStartE2EDuration="7.741435277s" podCreationTimestamp="2026-05-21 16:57:07 +0000 UTC" firstStartedPulling="2026-05-21 16:57:09.453955596 +0000 UTC m=+330.520561106" lastFinishedPulling="2026-05-21 16:57:14.148396977 +0000 UTC m=+335.215002473" observedRunningTime="2026-05-21 16:57:14.739275866 +0000 UTC m=+335.805881387" watchObservedRunningTime="2026-05-21 16:57:14.741435277 +0000 UTC m=+335.808040798"
May 21 16:57:14.756975 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:14.756925    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-764769945-bfvr6" podStartSLOduration=1.220501045 podStartE2EDuration="4.756912384s" podCreationTimestamp="2026-05-21 16:57:10 +0000 UTC" firstStartedPulling="2026-05-21 16:57:10.660114783 +0000 UTC m=+331.726720283" lastFinishedPulling="2026-05-21 16:57:14.196526125 +0000 UTC m=+335.263131622" observedRunningTime="2026-05-21 16:57:14.755771251 +0000 UTC m=+335.822376769" watchObservedRunningTime="2026-05-21 16:57:14.756912384 +0000 UTC m=+335.823517902"
May 21 16:57:18.737315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:18.737274    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9" event={"ID":"101859cd-89d0-48a7-9f4c-73ff40b35502","Type":"ContainerStarted","Data":"54c038bb151167441fec7d334f105e6c9d670cdae8e90baa7ef11a7ba028a0cc"}
May 21 16:57:18.737858 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:18.737383    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:57:18.755206 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:18.755159    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9" podStartSLOduration=2.572508373 podStartE2EDuration="5.755147193s" podCreationTimestamp="2026-05-21 16:57:13 +0000 UTC" firstStartedPulling="2026-05-21 16:57:14.511641385 +0000 UTC m=+335.578246884" lastFinishedPulling="2026-05-21 16:57:17.694280195 +0000 UTC m=+338.760885704" observedRunningTime="2026-05-21 16:57:18.753016564 +0000 UTC m=+339.819622084" watchObservedRunningTime="2026-05-21 16:57:18.755147193 +0000 UTC m=+339.821752711"
May 21 16:57:25.012511 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.012476    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"]
May 21 16:57:25.018029 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.018014    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.021158 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.021139    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 16:57:25.021297 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.021279    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hqxsg\""
May 21 16:57:25.021590 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.021572    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 16:57:25.034411 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.034389    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"]
May 21 16:57:25.122941 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.122906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ae36dd2-026c-4bcd-8858-90e984f81c42-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.122941 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.122946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmhr\" (UniqueName: \"kubernetes.io/projected/0ae36dd2-026c-4bcd-8858-90e984f81c42-kube-api-access-zbmhr\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.224434 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.224397    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ae36dd2-026c-4bcd-8858-90e984f81c42-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.224620 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.224534    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmhr\" (UniqueName: \"kubernetes.io/projected/0ae36dd2-026c-4bcd-8858-90e984f81c42-kube-api-access-zbmhr\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.226944 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.226915    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ae36dd2-026c-4bcd-8858-90e984f81c42-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.235517 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.235495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmhr\" (UniqueName: \"kubernetes.io/projected/0ae36dd2-026c-4bcd-8858-90e984f81c42-kube-api-access-zbmhr\") pod \"servicemesh-operator3-55f49c5f94-82mxr\" (UID: \"0ae36dd2-026c-4bcd-8858-90e984f81c42\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.326669 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.326581    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:25.463724 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.463662    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"]
May 21 16:57:25.466669 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:57:25.466631    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae36dd2_026c_4bcd_8858_90e984f81c42.slice/crio-67cc44fb5fb54300691f134fb1183ea467d6fa39566c8082a36e12bd606cc822 WatchSource:0}: Error finding container 67cc44fb5fb54300691f134fb1183ea467d6fa39566c8082a36e12bd606cc822: Status 404 returned error can't find the container with id 67cc44fb5fb54300691f134fb1183ea467d6fa39566c8082a36e12bd606cc822
May 21 16:57:25.729117 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.729090    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-vs6cp"
May 21 16:57:25.759548 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:25.759513    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr" event={"ID":"0ae36dd2-026c-4bcd-8858-90e984f81c42","Type":"ContainerStarted","Data":"67cc44fb5fb54300691f134fb1183ea467d6fa39566c8082a36e12bd606cc822"}
May 21 16:57:28.772407 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:28.772356    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr" event={"ID":"0ae36dd2-026c-4bcd-8858-90e984f81c42","Type":"ContainerStarted","Data":"404e33991a66a26b29b0da427c182a42ffe0150fc409f841c496523e1aef9f66"}
May 21 16:57:28.772790 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:28.772537    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:28.794627 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:28.794568    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr" podStartSLOduration=1.911362993 podStartE2EDuration="4.794549405s" podCreationTimestamp="2026-05-21 16:57:24 +0000 UTC" firstStartedPulling="2026-05-21 16:57:25.469251263 +0000 UTC m=+346.535856764" lastFinishedPulling="2026-05-21 16:57:28.352437679 +0000 UTC m=+349.419043176" observedRunningTime="2026-05-21 16:57:28.791398189 +0000 UTC m=+349.858003709" watchObservedRunningTime="2026-05-21 16:57:28.794549405 +0000 UTC m=+349.861154927"
May 21 16:57:39.778792 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:39.778752    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mxr"
May 21 16:57:40.330190 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.330156    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"]
May 21 16:57:40.333456 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.333440    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.337870 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.337842    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 16:57:40.337997 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.337888    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dnjdq\""
May 21 16:57:40.338066 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.338002    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 16:57:40.338144 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.338111    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 16:57:40.338355 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.338337    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 16:57:40.383641 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.383605    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"]
May 21 16:57:40.457465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457425    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457625 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457625 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457625 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dm8f\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-kube-api-access-7dm8f\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457625 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2412c0-bca5-412e-9d01-6dce311f8ebd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457840 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.457840 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.457691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558360 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558316    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2412c0-bca5-412e-9d01-6dce311f8ebd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558360 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558358    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558387    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558466    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558499    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558528    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.558617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.558559    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dm8f\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-kube-api-access-7dm8f\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.559435 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.559409    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.561382 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.561331    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.561930 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.561531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2412c0-bca5-412e-9d01-6dce311f8ebd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.561930 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.561800    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.561930 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.561889    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d2412c0-bca5-412e-9d01-6dce311f8ebd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.573354 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.572893    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.573354 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.572998    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dm8f\" (UniqueName: \"kubernetes.io/projected/7d2412c0-bca5-412e-9d01-6dce311f8ebd-kube-api-access-7dm8f\") pod \"istiod-openshift-gateway-798958bb55-v8cht\" (UID: \"7d2412c0-bca5-412e-9d01-6dce311f8ebd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.645889 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.645795    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:40.802438 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.802397    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"]
May 21 16:57:40.805394 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:57:40.805360    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2412c0_bca5_412e_9d01_6dce311f8ebd.slice/crio-8d8cb80c58fbc6a391789460236fa5c59b94494acc1ec5e2252558658e61b904 WatchSource:0}: Error finding container 8d8cb80c58fbc6a391789460236fa5c59b94494acc1ec5e2252558658e61b904: Status 404 returned error can't find the container with id 8d8cb80c58fbc6a391789460236fa5c59b94494acc1ec5e2252558658e61b904
May 21 16:57:40.811413 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:40.811379    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht" event={"ID":"7d2412c0-bca5-412e-9d01-6dce311f8ebd","Type":"ContainerStarted","Data":"8d8cb80c58fbc6a391789460236fa5c59b94494acc1ec5e2252558658e61b904"}
May 21 16:57:43.528500 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:43.528455    2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 16:57:43.528781 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:43.528528    2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 16:57:43.822378 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:43.822286    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht" event={"ID":"7d2412c0-bca5-412e-9d01-6dce311f8ebd","Type":"ContainerStarted","Data":"892fbed1d1277083dc0858e2cab2ca31cb46ce5e97e450a29e64d1c35bf0654f"}
May 21 16:57:43.822516 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:43.822399    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:43.841544 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:43.841495    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht" podStartSLOduration=1.120550039 podStartE2EDuration="3.841482411s" podCreationTimestamp="2026-05-21 16:57:40 +0000 UTC" firstStartedPulling="2026-05-21 16:57:40.807302658 +0000 UTC m=+361.873908156" lastFinishedPulling="2026-05-21 16:57:43.528235014 +0000 UTC m=+364.594840528" observedRunningTime="2026-05-21 16:57:43.839581352 +0000 UTC m=+364.906186870" watchObservedRunningTime="2026-05-21 16:57:43.841482411 +0000 UTC m=+364.908087929"
May 21 16:57:44.827616 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:44.827585    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-v8cht"
May 21 16:57:49.746954 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:57:49.746923    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-f4ck9"
May 21 16:58:40.408269 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.408226    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"]
May 21 16:58:40.411620 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.411598    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:40.414980 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.414957    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 16:58:40.415111 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.415060    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 16:58:40.416162 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.416144    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n97vs\""
May 21 16:58:40.416542 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.416527    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 16:58:40.447032 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.447000    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"]
May 21 16:58:40.563386 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.563352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgvk\" (UniqueName: \"kubernetes.io/projected/f343dced-e7c4-49e5-a4fc-d49f7a37d2a9-kube-api-access-7fgvk\") pod \"dns-operator-controller-manager-648d5c98bc-jgk26\" (UID: \"f343dced-e7c4-49e5-a4fc-d49f7a37d2a9\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:40.664580 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.664484    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgvk\" (UniqueName: \"kubernetes.io/projected/f343dced-e7c4-49e5-a4fc-d49f7a37d2a9-kube-api-access-7fgvk\") pod \"dns-operator-controller-manager-648d5c98bc-jgk26\" (UID: \"f343dced-e7c4-49e5-a4fc-d49f7a37d2a9\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:40.672887 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.672855    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgvk\" (UniqueName: \"kubernetes.io/projected/f343dced-e7c4-49e5-a4fc-d49f7a37d2a9-kube-api-access-7fgvk\") pod \"dns-operator-controller-manager-648d5c98bc-jgk26\" (UID: \"f343dced-e7c4-49e5-a4fc-d49f7a37d2a9\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:40.722211 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.722176    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:40.856356 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:40.856332    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"]
May 21 16:58:40.858746 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:58:40.858715    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf343dced_e7c4_49e5_a4fc_d49f7a37d2a9.slice/crio-55c5f79ad350b91fb969b4b0782073ca4c7f97ae42fe20f86c03d1143bc93e50 WatchSource:0}: Error finding container 55c5f79ad350b91fb969b4b0782073ca4c7f97ae42fe20f86c03d1143bc93e50: Status 404 returned error can't find the container with id 55c5f79ad350b91fb969b4b0782073ca4c7f97ae42fe20f86c03d1143bc93e50
May 21 16:58:41.015755 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:41.015666    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26" event={"ID":"f343dced-e7c4-49e5-a4fc-d49f7a37d2a9","Type":"ContainerStarted","Data":"55c5f79ad350b91fb969b4b0782073ca4c7f97ae42fe20f86c03d1143bc93e50"}
May 21 16:58:43.023832 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:43.023795    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26" event={"ID":"f343dced-e7c4-49e5-a4fc-d49f7a37d2a9","Type":"ContainerStarted","Data":"2b030b6e220755ee3ce849d3f7f0837b6ea4c3dee8d25fdae4d42b77c5eadff8"}
May 21 16:58:43.024231 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:43.023921    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:58:43.039486 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:43.039432    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26" podStartSLOduration=1.063247763 podStartE2EDuration="3.03941536s" podCreationTimestamp="2026-05-21 16:58:40 +0000 UTC" firstStartedPulling="2026-05-21 16:58:40.860755889 +0000 UTC m=+421.927361387" lastFinishedPulling="2026-05-21 16:58:42.836923487 +0000 UTC m=+423.903528984" observedRunningTime="2026-05-21 16:58:43.038929056 +0000 UTC m=+424.105534578" watchObservedRunningTime="2026-05-21 16:58:43.03941536 +0000 UTC m=+424.106020881"
May 21 16:58:44.820805 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:44.820772    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"]
May 21 16:58:44.824119 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:44.824098    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:44.827164 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:44.827147    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-px8cd\""
May 21 16:58:44.836099 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:44.836062    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"]
May 21 16:58:45.007358 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.007324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.007519 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.007373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcj9b\" (UniqueName: \"kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.107926 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.107830    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.107926 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.107888    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcj9b\" (UniqueName: \"kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.108256 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.108234    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.116824 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.116799    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcj9b\" (UniqueName: \"kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.133750 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.133722    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:45.270449 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:45.270311    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"]
May 21 16:58:45.273429 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:58:45.273396    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6183c801_7603_47fa_9a5d_aea4b9b0245a.slice/crio-632daa1074247e9b8cb3c65e94adad4edc3d0956b017ebc0a31cd079f433c8fb WatchSource:0}: Error finding container 632daa1074247e9b8cb3c65e94adad4edc3d0956b017ebc0a31cd079f433c8fb: Status 404 returned error can't find the container with id 632daa1074247e9b8cb3c65e94adad4edc3d0956b017ebc0a31cd079f433c8fb
May 21 16:58:46.037099 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:46.037052    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" event={"ID":"6183c801-7603-47fa-9a5d-aea4b9b0245a","Type":"ContainerStarted","Data":"632daa1074247e9b8cb3c65e94adad4edc3d0956b017ebc0a31cd079f433c8fb"}
May 21 16:58:51.055977 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:51.055944    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" event={"ID":"6183c801-7603-47fa-9a5d-aea4b9b0245a","Type":"ContainerStarted","Data":"c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1"}
May 21 16:58:51.056347 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:51.056116    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:58:51.077037 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:51.076987    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" podStartSLOduration=1.3710608930000001 podStartE2EDuration="7.076972285s" podCreationTimestamp="2026-05-21 16:58:44 +0000 UTC" firstStartedPulling="2026-05-21 16:58:45.275724046 +0000 UTC m=+426.342329545" lastFinishedPulling="2026-05-21 16:58:50.981635426 +0000 UTC m=+432.048240937" observedRunningTime="2026-05-21 16:58:51.07452914 +0000 UTC m=+432.141134658" watchObservedRunningTime="2026-05-21 16:58:51.076972285 +0000 UTC m=+432.143577804"
May 21 16:58:54.029743 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:58:54.029708    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jgk26"
May 21 16:59:02.061743 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:02.061660    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:59:03.668117 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.668081    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"]
May 21 16:59:03.668585 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.668360    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" containerName="manager" containerID="cri-o://c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1" gracePeriod=2
May 21 16:59:03.674524 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.674488    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"]
May 21 16:59:03.690107 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.690066    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:03.690430 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.690417    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" containerName="manager"
May 21 16:59:03.690473 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.690431    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" containerName="manager"
May 21 16:59:03.690511 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.690491    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" containerName="manager"
May 21 16:59:03.693463 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.693442    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.695879 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.695845    2570 status_manager.go:895] "Failed to get status for pod" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object"
May 21 16:59:03.710934 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.710900    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:03.757014 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.756980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.757215 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.757045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fs2h\" (UniqueName: \"kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.857804 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.857768    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.857979 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.857900    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fs2h\" (UniqueName: \"kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.858210 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.858189    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.866366 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.866341    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fs2h\" (UniqueName: \"kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wdq9v\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:03.904710 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.904682    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:59:03.906961 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.906938    2570 status_manager.go:895] "Failed to get status for pod" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object"
May 21 16:59:03.958414 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.958339    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume\") pod \"6183c801-7603-47fa-9a5d-aea4b9b0245a\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") "
May 21 16:59:03.958414 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.958391    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcj9b\" (UniqueName: \"kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b\") pod \"6183c801-7603-47fa-9a5d-aea4b9b0245a\" (UID: \"6183c801-7603-47fa-9a5d-aea4b9b0245a\") "
May 21 16:59:03.958847 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.958820    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6183c801-7603-47fa-9a5d-aea4b9b0245a" (UID: "6183c801-7603-47fa-9a5d-aea4b9b0245a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 16:59:03.960528 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:03.960509    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b" (OuterVolumeSpecName: "kube-api-access-kcj9b") pod "6183c801-7603-47fa-9a5d-aea4b9b0245a" (UID: "6183c801-7603-47fa-9a5d-aea4b9b0245a"). InnerVolumeSpecName "kube-api-access-kcj9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:59:04.044689 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.044656    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:04.059670 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.059643    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6183c801-7603-47fa-9a5d-aea4b9b0245a-extensions-socket-volume\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:59:04.059670 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.059671    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcj9b\" (UniqueName: \"kubernetes.io/projected/6183c801-7603-47fa-9a5d-aea4b9b0245a-kube-api-access-kcj9b\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:59:04.107536 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.106434    2570 generic.go:358] "Generic (PLEG): container finished" podID="6183c801-7603-47fa-9a5d-aea4b9b0245a" containerID="c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1" exitCode=0
May 21 16:59:04.107536 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.106511    2570 scope.go:117] "RemoveContainer" containerID="c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1"
May 21 16:59:04.107536 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.106645    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7"
May 21 16:59:04.109491 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.109461    2570 status_manager.go:895] "Failed to get status for pod" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object"
May 21 16:59:04.115445 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.115425    2570 scope.go:117] "RemoveContainer" containerID="c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1"
May 21 16:59:04.115777 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:59:04.115753    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1\": container with ID starting with c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1 not found: ID does not exist" containerID="c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1"
May 21 16:59:04.115856 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.115792    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1"} err="failed to get container status \"c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1\": rpc error: code = NotFound desc = could not find container \"c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1\": container with ID starting with c6f8d061e08fbfcf32c1d811c23ce7b9c25533ab7f21a00df4d32ceba22531a1 not found: ID does not exist"
May 21 16:59:04.119208 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.119180    2570 status_manager.go:895] "Failed to get status for pod" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object"
May 21 16:59:04.188242 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:04.188215    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:04.190601 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:59:04.190575    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6d8db5_6ad0_4e02_89cf_e8c8668e9bf5.slice/crio-c0123eebb51668e7650aa714f632ae4beb5b6e6c728daeb0d1e9136e3e503be4 WatchSource:0}: Error finding container c0123eebb51668e7650aa714f632ae4beb5b6e6c728daeb0d1e9136e3e503be4: Status 404 returned error can't find the container with id c0123eebb51668e7650aa714f632ae4beb5b6e6c728daeb0d1e9136e3e503be4
May 21 16:59:05.111930 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.111893    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" event={"ID":"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5","Type":"ContainerStarted","Data":"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"}
May 21 16:59:05.111930 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.111933    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" event={"ID":"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5","Type":"ContainerStarted","Data":"c0123eebb51668e7650aa714f632ae4beb5b6e6c728daeb0d1e9136e3e503be4"}
May 21 16:59:05.112361 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.112024    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:05.114298 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.114269    2570 status_manager.go:895] "Failed to get status for pod" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8cxm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8cxm7\" is forbidden: User \"system:node:ip-10-0-135-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-101.ec2.internal' and this object"
May 21 16:59:05.136224 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.136174    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" podStartSLOduration=2.136159373 podStartE2EDuration="2.136159373s" podCreationTimestamp="2026-05-21 16:59:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:59:05.135000681 +0000 UTC m=+446.201606191" watchObservedRunningTime="2026-05-21 16:59:05.136159373 +0000 UTC m=+446.202764883"
May 21 16:59:05.528633 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:05.528602    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6183c801-7603-47fa-9a5d-aea4b9b0245a" path="/var/lib/kubelet/pods/6183c801-7603-47fa-9a5d-aea4b9b0245a/volumes"
May 21 16:59:16.117645 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:16.117614    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:18.850720 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:18.850687    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:18.851149 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:18.850900    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" podUID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" containerName="manager" containerID="cri-o://dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489" gracePeriod=10
May 21 16:59:19.109904 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.109844    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:19.137052 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.137014    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 16:59:19.137488 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.137463    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" containerName="manager"
May 21 16:59:19.137488 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.137483    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" containerName="manager"
May 21 16:59:19.137642 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.137551    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" containerName="manager"
May 21 16:59:19.140949 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.140926    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.152449 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.152424    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 16:59:19.161810 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.161783    2570 generic.go:358] "Generic (PLEG): container finished" podID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" containerID="dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489" exitCode=0
May 21 16:59:19.161918 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.161841    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"
May 21 16:59:19.161918 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.161872    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" event={"ID":"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5","Type":"ContainerDied","Data":"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"}
May 21 16:59:19.161918 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.161906    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v" event={"ID":"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5","Type":"ContainerDied","Data":"c0123eebb51668e7650aa714f632ae4beb5b6e6c728daeb0d1e9136e3e503be4"}
May 21 16:59:19.162019 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.161921    2570 scope.go:117] "RemoveContainer" containerID="dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"
May 21 16:59:19.172617 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.172596    2570 scope.go:117] "RemoveContainer" containerID="dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"
May 21 16:59:19.172909 ip-10-0-135-101 kubenswrapper[2570]: E0521 16:59:19.172884    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489\": container with ID starting with dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489 not found: ID does not exist" containerID="dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"
May 21 16:59:19.173008 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.172915    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489"} err="failed to get container status \"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489\": rpc error: code = NotFound desc = could not find container \"dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489\": container with ID starting with dcccb92dfaba81707d3e70b117b5db5ed230154c675934fc10273ec7bf3a6489 not found: ID does not exist"
May 21 16:59:19.193275 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.193253    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume\") pod \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") "
May 21 16:59:19.193374 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.193296    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fs2h\" (UniqueName: \"kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h\") pod \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\" (UID: \"8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5\") "
May 21 16:59:19.193435 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.193421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.193472 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.193448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgsd\" (UniqueName: \"kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.193633 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.193612    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" (UID: "8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 16:59:19.195384 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.195365    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h" (OuterVolumeSpecName: "kube-api-access-8fs2h") pod "8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" (UID: "8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5"). InnerVolumeSpecName "kube-api-access-8fs2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:59:19.294465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.294423    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.294465 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.294467    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgsd\" (UniqueName: \"kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.294679 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.294561    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fs2h\" (UniqueName: \"kubernetes.io/projected/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-kube-api-access-8fs2h\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:59:19.294679 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.294577    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5-extensions-socket-volume\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 16:59:19.294829 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.294808    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.305219 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.305187    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgsd\" (UniqueName: \"kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zws9l\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.452010 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.451971    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:19.490235 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.489376    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:19.493910 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.493882    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wdq9v"]
May 21 16:59:19.528863 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.528652    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5" path="/var/lib/kubelet/pods/8c6d8db5-6ad0-4e02-89cf-e8c8668e9bf5/volumes"
May 21 16:59:19.590051 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:19.589988    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 16:59:19.592544 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:59:19.592519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651fffea_66d3_4f56_acf5_524d7f4c1ed9.slice/crio-28d93669ee87f98fc88ccdef94b33e0e6a240464135d069ed8f9b37ff8b3b183 WatchSource:0}: Error finding container 28d93669ee87f98fc88ccdef94b33e0e6a240464135d069ed8f9b37ff8b3b183: Status 404 returned error can't find the container with id 28d93669ee87f98fc88ccdef94b33e0e6a240464135d069ed8f9b37ff8b3b183
May 21 16:59:20.167315 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:20.167274    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" event={"ID":"651fffea-66d3-4f56-acf5-524d7f4c1ed9","Type":"ContainerStarted","Data":"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"}
May 21 16:59:20.167752 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:20.167322    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:20.167752 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:20.167337    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" event={"ID":"651fffea-66d3-4f56-acf5-524d7f4c1ed9","Type":"ContainerStarted","Data":"28d93669ee87f98fc88ccdef94b33e0e6a240464135d069ed8f9b37ff8b3b183"}
May 21 16:59:20.195605 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:20.195554    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" podStartSLOduration=1.1955409399999999 podStartE2EDuration="1.19554094s" podCreationTimestamp="2026-05-21 16:59:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:59:20.193530201 +0000 UTC m=+461.260135742" watchObservedRunningTime="2026-05-21 16:59:20.19554094 +0000 UTC m=+461.262146459"
May 21 16:59:31.173926 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:31.173894    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 16:59:48.499849 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.499813    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 16:59:48.504393 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.504369    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.506903 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.506876    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 16:59:48.507018 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.506908    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bcjws\""
May 21 16:59:48.510047 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.510025    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 16:59:48.532051 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.532017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p2kq\" (UniqueName: \"kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.532212 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.532107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.600800 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.600766    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 16:59:48.632948 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.632911    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2kq\" (UniqueName: \"kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.633139 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.632963    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.633527 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.633508    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.649599 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.649562    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p2kq\" (UniqueName: \"kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq\") pod \"limitador-limitador-7d549b5b-wvxct\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.815582 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.815484    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:48.947945 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:48.947884    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 16:59:48.950298 ip-10-0-135-101 kubenswrapper[2570]: W0521 16:59:48.950267    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674a510e_e951_48cc_b45b_3d066df22b97.slice/crio-db399c3ba00e27f960edb627303779bb51a2c313e34ef76a7abde3093b0c31a5 WatchSource:0}: Error finding container db399c3ba00e27f960edb627303779bb51a2c313e34ef76a7abde3093b0c31a5: Status 404 returned error can't find the container with id db399c3ba00e27f960edb627303779bb51a2c313e34ef76a7abde3093b0c31a5
May 21 16:59:49.271298 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:49.271265    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" event={"ID":"674a510e-e951-48cc-b45b-3d066df22b97","Type":"ContainerStarted","Data":"db399c3ba00e27f960edb627303779bb51a2c313e34ef76a7abde3093b0c31a5"}
May 21 16:59:52.283367 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:52.283330    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" event={"ID":"674a510e-e951-48cc-b45b-3d066df22b97","Type":"ContainerStarted","Data":"5837fd26e6143adf541c035cb5f62d59f8f26f6a919d6b220779d7840e7d6ff0"}
May 21 16:59:52.283793 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:52.283391    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 16:59:52.299087 ip-10-0-135-101 kubenswrapper[2570]: I0521 16:59:52.299023    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" podStartSLOduration=1.599736508 podStartE2EDuration="4.299008547s" podCreationTimestamp="2026-05-21 16:59:48 +0000 UTC" firstStartedPulling="2026-05-21 16:59:48.951948739 +0000 UTC m=+490.018554235" lastFinishedPulling="2026-05-21 16:59:51.651220774 +0000 UTC m=+492.717826274" observedRunningTime="2026-05-21 16:59:52.298429912 +0000 UTC m=+493.365035431" watchObservedRunningTime="2026-05-21 16:59:52.299008547 +0000 UTC m=+493.365614096"
May 21 17:00:03.288986 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:03.288955    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 17:00:03.516847 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:03.516808    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 17:00:03.517130 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:03.517086    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" podUID="674a510e-e951-48cc-b45b-3d066df22b97" containerName="limitador" containerID="cri-o://5837fd26e6143adf541c035cb5f62d59f8f26f6a919d6b220779d7840e7d6ff0" gracePeriod=30
May 21 17:00:04.325860 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.325826    2570 generic.go:358] "Generic (PLEG): container finished" podID="674a510e-e951-48cc-b45b-3d066df22b97" containerID="5837fd26e6143adf541c035cb5f62d59f8f26f6a919d6b220779d7840e7d6ff0" exitCode=0
May 21 17:00:04.326252 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.325891    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" event={"ID":"674a510e-e951-48cc-b45b-3d066df22b97","Type":"ContainerDied","Data":"5837fd26e6143adf541c035cb5f62d59f8f26f6a919d6b220779d7840e7d6ff0"}
May 21 17:00:04.464654 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.464630    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 17:00:04.565315 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.565281    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file\") pod \"674a510e-e951-48cc-b45b-3d066df22b97\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") "
May 21 17:00:04.565477 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.565382    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p2kq\" (UniqueName: \"kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq\") pod \"674a510e-e951-48cc-b45b-3d066df22b97\" (UID: \"674a510e-e951-48cc-b45b-3d066df22b97\") "
May 21 17:00:04.565667 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.565636    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file" (OuterVolumeSpecName: "config-file") pod "674a510e-e951-48cc-b45b-3d066df22b97" (UID: "674a510e-e951-48cc-b45b-3d066df22b97"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:00:04.567425 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.567404    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq" (OuterVolumeSpecName: "kube-api-access-6p2kq") pod "674a510e-e951-48cc-b45b-3d066df22b97" (UID: "674a510e-e951-48cc-b45b-3d066df22b97"). InnerVolumeSpecName "kube-api-access-6p2kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:00:04.666767 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.666733    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p2kq\" (UniqueName: \"kubernetes.io/projected/674a510e-e951-48cc-b45b-3d066df22b97-kube-api-access-6p2kq\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:00:04.666767 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:04.666766    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a510e-e951-48cc-b45b-3d066df22b97-config-file\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:00:05.330866 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.330840    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct"
May 21 17:00:05.331291 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.330833    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wvxct" event={"ID":"674a510e-e951-48cc-b45b-3d066df22b97","Type":"ContainerDied","Data":"db399c3ba00e27f960edb627303779bb51a2c313e34ef76a7abde3093b0c31a5"}
May 21 17:00:05.331291 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.330952    2570 scope.go:117] "RemoveContainer" containerID="5837fd26e6143adf541c035cb5f62d59f8f26f6a919d6b220779d7840e7d6ff0"
May 21 17:00:05.352019 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.351979    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 17:00:05.353919 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.353896    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wvxct"]
May 21 17:00:05.466401 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.466355    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kqrbf"]
May 21 17:00:05.466864 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.466845    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674a510e-e951-48cc-b45b-3d066df22b97" containerName="limitador"
May 21 17:00:05.466906 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.466870    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="674a510e-e951-48cc-b45b-3d066df22b97" containerName="limitador"
May 21 17:00:05.466998 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.466987    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="674a510e-e951-48cc-b45b-3d066df22b97" containerName="limitador"
May 21 17:00:05.471389 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.471371    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.474466 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.474442    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 17:00:05.474621 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.474452    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-82v2g\""
May 21 17:00:05.476865 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.476835    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kqrbf"]
May 21 17:00:05.528258 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.528225    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674a510e-e951-48cc-b45b-3d066df22b97" path="/var/lib/kubelet/pods/674a510e-e951-48cc-b45b-3d066df22b97/volumes"
May 21 17:00:05.573158 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.573131    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fx82\" (UniqueName: \"kubernetes.io/projected/4abac351-a2ff-4d36-9f25-faf868029ad5-kube-api-access-8fx82\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.573318 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.573167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4abac351-a2ff-4d36-9f25-faf868029ad5-data\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.674687 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.674655    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fx82\" (UniqueName: \"kubernetes.io/projected/4abac351-a2ff-4d36-9f25-faf868029ad5-kube-api-access-8fx82\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.674851 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.674713    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4abac351-a2ff-4d36-9f25-faf868029ad5-data\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.675116 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.675098    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4abac351-a2ff-4d36-9f25-faf868029ad5-data\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.682643 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.682606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fx82\" (UniqueName: \"kubernetes.io/projected/4abac351-a2ff-4d36-9f25-faf868029ad5-kube-api-access-8fx82\") pod \"postgres-68c4fbbd6f-kqrbf\" (UID: \"4abac351-a2ff-4d36-9f25-faf868029ad5\") " pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.783942 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.783914    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:05.911174 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:05.911116    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kqrbf"]
May 21 17:00:05.913775 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:00:05.913746    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abac351_a2ff_4d36_9f25_faf868029ad5.slice/crio-84510d75772150f0a232d92d0921f0e73ca8ec835481e71f3b4256669bebc78f WatchSource:0}: Error finding container 84510d75772150f0a232d92d0921f0e73ca8ec835481e71f3b4256669bebc78f: Status 404 returned error can't find the container with id 84510d75772150f0a232d92d0921f0e73ca8ec835481e71f3b4256669bebc78f
May 21 17:00:06.335935 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:06.335903    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kqrbf" event={"ID":"4abac351-a2ff-4d36-9f25-faf868029ad5","Type":"ContainerStarted","Data":"84510d75772150f0a232d92d0921f0e73ca8ec835481e71f3b4256669bebc78f"}
May 21 17:00:12.358169 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:12.358134    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kqrbf" event={"ID":"4abac351-a2ff-4d36-9f25-faf868029ad5","Type":"ContainerStarted","Data":"66a61d86b922dc7b8248ed6e4b2dae12f412f2f57e534daa1d01601f02231d89"}
May 21 17:00:12.358549 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:12.358239    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:12.375102 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:12.375039    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-kqrbf" podStartSLOduration=1.8201345039999999 podStartE2EDuration="7.375023807s" podCreationTimestamp="2026-05-21 17:00:05 +0000 UTC" firstStartedPulling="2026-05-21 17:00:05.91506733 +0000 UTC m=+506.981672828" lastFinishedPulling="2026-05-21 17:00:11.469956631 +0000 UTC m=+512.536562131" observedRunningTime="2026-05-21 17:00:12.373324218 +0000 UTC m=+513.439929751" watchObservedRunningTime="2026-05-21 17:00:12.375023807 +0000 UTC m=+513.441629326"
May 21 17:00:18.391916 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:18.391883    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-kqrbf"
May 21 17:00:24.440655 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.440619    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b5b6cbb8-8gxz6"]
May 21 17:00:24.466422 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.466394    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b5b6cbb8-8gxz6"]
May 21 17:00:24.466567 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.466523    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:24.469054 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.469030    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 17:00:24.469054 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.469053    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tk6ht\""
May 21 17:00:24.534181 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.534151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7pc\" (UniqueName: \"kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc\") pod \"maas-controller-54b5b6cbb8-8gxz6\" (UID: \"ea3e5d79-4f55-45e6-bdeb-3f75145c4370\") " pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:24.586527 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.586494    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b5b6cbb8-8gxz6"]
May 21 17:00:24.586759 ip-10-0-135-101 kubenswrapper[2570]: E0521 17:00:24.586741    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tz7pc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6" podUID="ea3e5d79-4f55-45e6-bdeb-3f75145c4370"
May 21 17:00:24.635607 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.635568    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7pc\" (UniqueName: \"kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc\") pod \"maas-controller-54b5b6cbb8-8gxz6\" (UID: \"ea3e5d79-4f55-45e6-bdeb-3f75145c4370\") " pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:24.644543 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.644513    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:24.648210 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.648144    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:24.650533 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.650510    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7pc\" (UniqueName: \"kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc\") pod \"maas-controller-54b5b6cbb8-8gxz6\" (UID: \"ea3e5d79-4f55-45e6-bdeb-3f75145c4370\") " pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:24.661807 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.661783    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:24.736613 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.736533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpg2\" (UniqueName: \"kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2\") pod \"maas-controller-5f6dbf78cd-zzrnf\" (UID: \"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa\") " pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:24.837641 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.837604    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpg2\" (UniqueName: \"kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2\") pod \"maas-controller-5f6dbf78cd-zzrnf\" (UID: \"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa\") " pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:24.845950 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.845928    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpg2\" (UniqueName: \"kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2\") pod \"maas-controller-5f6dbf78cd-zzrnf\" (UID: \"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa\") " pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:24.967301 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:24.967271    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:25.097944 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.097908    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:25.101212 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:00:25.101187    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2afae7_0457_45aa_8d1c_87ad70cdc7aa.slice/crio-e7423bd695fdbd94523c71df9c3f10b77658285c44a55691f3939b85faf1263c WatchSource:0}: Error finding container e7423bd695fdbd94523c71df9c3f10b77658285c44a55691f3939b85faf1263c: Status 404 returned error can't find the container with id e7423bd695fdbd94523c71df9c3f10b77658285c44a55691f3939b85faf1263c
May 21 17:00:25.402824 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.402790    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" event={"ID":"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa","Type":"ContainerStarted","Data":"e7423bd695fdbd94523c71df9c3f10b77658285c44a55691f3939b85faf1263c"}
May 21 17:00:25.403017 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.402836    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:25.407548 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.407524    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:25.543817 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.543788    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz7pc\" (UniqueName: \"kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc\") pod \"ea3e5d79-4f55-45e6-bdeb-3f75145c4370\" (UID: \"ea3e5d79-4f55-45e6-bdeb-3f75145c4370\") "
May 21 17:00:25.545842 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.545818    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc" (OuterVolumeSpecName: "kube-api-access-tz7pc") pod "ea3e5d79-4f55-45e6-bdeb-3f75145c4370" (UID: "ea3e5d79-4f55-45e6-bdeb-3f75145c4370"). InnerVolumeSpecName "kube-api-access-tz7pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:00:25.644638 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:25.644599    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz7pc\" (UniqueName: \"kubernetes.io/projected/ea3e5d79-4f55-45e6-bdeb-3f75145c4370-kube-api-access-tz7pc\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:00:26.406987 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:26.406952    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b5b6cbb8-8gxz6"
May 21 17:00:26.439567 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:26.439520    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b5b6cbb8-8gxz6"]
May 21 17:00:26.442554 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:26.442516    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54b5b6cbb8-8gxz6"]
May 21 17:00:27.535945 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:27.535913    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3e5d79-4f55-45e6-bdeb-3f75145c4370" path="/var/lib/kubelet/pods/ea3e5d79-4f55-45e6-bdeb-3f75145c4370/volumes"
May 21 17:00:28.415491 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:28.415458    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" event={"ID":"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa","Type":"ContainerStarted","Data":"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"}
May 21 17:00:28.415644 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:28.415517    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:28.433379 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:28.433331    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" podStartSLOduration=2.080966101 podStartE2EDuration="4.433316685s" podCreationTimestamp="2026-05-21 17:00:24 +0000 UTC" firstStartedPulling="2026-05-21 17:00:25.102353287 +0000 UTC m=+526.168958785" lastFinishedPulling="2026-05-21 17:00:27.454703872 +0000 UTC m=+528.521309369" observedRunningTime="2026-05-21 17:00:28.4318865 +0000 UTC m=+529.498492019" watchObservedRunningTime="2026-05-21 17:00:28.433316685 +0000 UTC m=+529.499922205"
May 21 17:00:39.426366 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.426273    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:39.657930 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.657891    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:00:39.662539 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.662515    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:39.679685 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.679611    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:00:39.773647 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.773607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7t9q\" (UniqueName: \"kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q\") pod \"maas-controller-7677bbcfbb-ln4gk\" (UID: \"4914254a-8631-4aee-89ca-aa2a1bd391be\") " pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:39.874322 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.874280    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7t9q\" (UniqueName: \"kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q\") pod \"maas-controller-7677bbcfbb-ln4gk\" (UID: \"4914254a-8631-4aee-89ca-aa2a1bd391be\") " pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:39.884426 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.884393    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7t9q\" (UniqueName: \"kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q\") pod \"maas-controller-7677bbcfbb-ln4gk\" (UID: \"4914254a-8631-4aee-89ca-aa2a1bd391be\") " pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:39.976969 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:39.976881    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:40.107913 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:40.107885    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:00:40.109832 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:00:40.109796    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4914254a_8631_4aee_89ca_aa2a1bd391be.slice/crio-089e2dc28d5d565bc024f5a37edb88d09df79c31b8e81c55a82847525e2b16c5 WatchSource:0}: Error finding container 089e2dc28d5d565bc024f5a37edb88d09df79c31b8e81c55a82847525e2b16c5: Status 404 returned error can't find the container with id 089e2dc28d5d565bc024f5a37edb88d09df79c31b8e81c55a82847525e2b16c5
May 21 17:00:40.455593 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:40.455554    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" event={"ID":"4914254a-8631-4aee-89ca-aa2a1bd391be","Type":"ContainerStarted","Data":"089e2dc28d5d565bc024f5a37edb88d09df79c31b8e81c55a82847525e2b16c5"}
May 21 17:00:41.460439 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:41.460402    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" event={"ID":"4914254a-8631-4aee-89ca-aa2a1bd391be","Type":"ContainerStarted","Data":"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"}
May 21 17:00:41.460915 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:41.460523    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:41.477317 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:41.477271    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" podStartSLOduration=2.074574099 podStartE2EDuration="2.477257746s" podCreationTimestamp="2026-05-21 17:00:39 +0000 UTC" firstStartedPulling="2026-05-21 17:00:40.11118553 +0000 UTC m=+541.177791027" lastFinishedPulling="2026-05-21 17:00:40.513869174 +0000 UTC m=+541.580474674" observedRunningTime="2026-05-21 17:00:41.475832998 +0000 UTC m=+542.542438517" watchObservedRunningTime="2026-05-21 17:00:41.477257746 +0000 UTC m=+542.543863308"
May 21 17:00:52.469366 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.469336    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:00:52.509766 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.509722    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:52.510316 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.510276    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" podUID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" containerName="manager" containerID="cri-o://755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66" gracePeriod=30
May 21 17:00:52.761628 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.761603    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:52.781882 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.781854    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbpg2\" (UniqueName: \"kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2\") pod \"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa\" (UID: \"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa\") "
May 21 17:00:52.784047 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.784016    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2" (OuterVolumeSpecName: "kube-api-access-hbpg2") pod "8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" (UID: "8e2afae7-0457-45aa-8d1c-87ad70cdc7aa"). InnerVolumeSpecName "kube-api-access-hbpg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:00:52.882680 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:52.882637    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbpg2\" (UniqueName: \"kubernetes.io/projected/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa-kube-api-access-hbpg2\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:00:53.503098 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.503044    2570 generic.go:358] "Generic (PLEG): container finished" podID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" containerID="755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66" exitCode=0
May 21 17:00:53.503514 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.503119    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf"
May 21 17:00:53.503514 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.503132    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" event={"ID":"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa","Type":"ContainerDied","Data":"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"}
May 21 17:00:53.503514 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.503169    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6dbf78cd-zzrnf" event={"ID":"8e2afae7-0457-45aa-8d1c-87ad70cdc7aa","Type":"ContainerDied","Data":"e7423bd695fdbd94523c71df9c3f10b77658285c44a55691f3939b85faf1263c"}
May 21 17:00:53.503514 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.503186    2570 scope.go:117] "RemoveContainer" containerID="755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"
May 21 17:00:53.512135 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.511950    2570 scope.go:117] "RemoveContainer" containerID="755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"
May 21 17:00:53.512308 ip-10-0-135-101 kubenswrapper[2570]: E0521 17:00:53.512288    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66\": container with ID starting with 755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66 not found: ID does not exist" containerID="755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"
May 21 17:00:53.512348 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.512317    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66"} err="failed to get container status \"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66\": rpc error: code = NotFound desc = could not find container \"755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66\": container with ID starting with 755925275b171100f65a1f06ae7ce36c7a6f3eb3f1c9e2820b64e0775590ad66 not found: ID does not exist"
May 21 17:00:53.529595 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.529568    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:53.529595 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:53.529602    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f6dbf78cd-zzrnf"]
May 21 17:00:55.527865 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:55.527833    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" path="/var/lib/kubelet/pods/8e2afae7-0457-45aa-8d1c-87ad70cdc7aa/volumes"
May 21 17:00:58.153610 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.153562    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-896cd8bcf-lsz5d"]
May 21 17:00:58.154107 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.154086    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" containerName="manager"
May 21 17:00:58.154182 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.154111    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" containerName="manager"
May 21 17:00:58.154248 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.154234    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e2afae7-0457-45aa-8d1c-87ad70cdc7aa" containerName="manager"
May 21 17:00:58.158642 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.158619    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.161569 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.161547    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 17:00:58.170337 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.170309    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-896cd8bcf-lsz5d"]
May 21 17:00:58.228903 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.228869    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a64915e-533b-4ab8-9a33-72b468402b6c-maas-api-tls\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.229116 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.228926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8qf8\" (UniqueName: \"kubernetes.io/projected/2a64915e-533b-4ab8-9a33-72b468402b6c-kube-api-access-p8qf8\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.336217 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.330814    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8qf8\" (UniqueName: \"kubernetes.io/projected/2a64915e-533b-4ab8-9a33-72b468402b6c-kube-api-access-p8qf8\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.336217 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.330955    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a64915e-533b-4ab8-9a33-72b468402b6c-maas-api-tls\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.336217 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.334335    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a64915e-533b-4ab8-9a33-72b468402b6c-maas-api-tls\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.344454 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.344422    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8qf8\" (UniqueName: \"kubernetes.io/projected/2a64915e-533b-4ab8-9a33-72b468402b6c-kube-api-access-p8qf8\") pod \"maas-api-896cd8bcf-lsz5d\" (UID: \"2a64915e-533b-4ab8-9a33-72b468402b6c\") " pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.469541 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.469442    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:00:58.636869 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:58.636839    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-896cd8bcf-lsz5d"]
May 21 17:00:58.638957 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:00:58.638923    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a64915e_533b_4ab8_9a33_72b468402b6c.slice/crio-22d87d36630c7b8b2185ac93136d6a746d9fb1cf537e50d3afee2e6c73ccf90c WatchSource:0}: Error finding container 22d87d36630c7b8b2185ac93136d6a746d9fb1cf537e50d3afee2e6c73ccf90c: Status 404 returned error can't find the container with id 22d87d36630c7b8b2185ac93136d6a746d9fb1cf537e50d3afee2e6c73ccf90c
May 21 17:00:59.539238 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:00:59.539200    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-896cd8bcf-lsz5d" event={"ID":"2a64915e-533b-4ab8-9a33-72b468402b6c","Type":"ContainerStarted","Data":"22d87d36630c7b8b2185ac93136d6a746d9fb1cf537e50d3afee2e6c73ccf90c"}
May 21 17:01:00.544401 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:00.544359    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-896cd8bcf-lsz5d" event={"ID":"2a64915e-533b-4ab8-9a33-72b468402b6c","Type":"ContainerStarted","Data":"8185abf19a20a2b875649ec7d6e36c84cad26ab9dec978bd69364e773f59343a"}
May 21 17:01:00.544825 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:00.544408    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:01:00.562806 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:00.562755    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-896cd8bcf-lsz5d" podStartSLOduration=0.766387957 podStartE2EDuration="2.562738223s" podCreationTimestamp="2026-05-21 17:00:58 +0000 UTC" firstStartedPulling="2026-05-21 17:00:58.640180355 +0000 UTC m=+559.706785855" lastFinishedPulling="2026-05-21 17:01:00.436530622 +0000 UTC m=+561.503136121" observedRunningTime="2026-05-21 17:01:00.560394886 +0000 UTC m=+561.627000406" watchObservedRunningTime="2026-05-21 17:01:00.562738223 +0000 UTC m=+561.629343742"
May 21 17:01:06.553236 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:06.553205    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-896cd8bcf-lsz5d"
May 21 17:01:13.906117 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.906084    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"]
May 21 17:01:13.911263 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.911242    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.915103 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.915060    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 17:01:13.915103 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.915060    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 17:01:13.915276 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.915127    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wxhj\""
May 21 17:01:13.915276 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.915101    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 21 17:01:13.920224 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.920199    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"]
May 21 17:01:13.973669 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.973669 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.973858 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvr2\" (UniqueName: \"kubernetes.io/projected/484165f5-31ba-4414-ab46-305ab91fa0f6-kube-api-access-zvvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.973858 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.973858 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484165f5-31ba-4414-ab46-305ab91fa0f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:13.973958 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:13.973873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074662 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074609    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074846 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074668    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484165f5-31ba-4414-ab46-305ab91fa0f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074846 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074705    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074846 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074780    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074846 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074811    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.074846 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.074845    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvr2\" (UniqueName: \"kubernetes.io/projected/484165f5-31ba-4414-ab46-305ab91fa0f6-kube-api-access-zvvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.075371 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.075336    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.075520 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.075497    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.075799 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.075778    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.077302 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.077277    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/484165f5-31ba-4414-ab46-305ab91fa0f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.077403 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.077386    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484165f5-31ba-4414-ab46-305ab91fa0f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.089527 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.089500    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvr2\" (UniqueName: \"kubernetes.io/projected/484165f5-31ba-4414-ab46-305ab91fa0f6-kube-api-access-zvvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d\" (UID: \"484165f5-31ba-4414-ab46-305ab91fa0f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.222933 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.222844    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:14.368906 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.368873    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"]
May 21 17:01:14.372554 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:01:14.372519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484165f5_31ba_4414_ab46_305ab91fa0f6.slice/crio-710d181212bf7a8c5da58069d295e21f756fd616ac2c05f0a67f0cbb5624b350 WatchSource:0}: Error finding container 710d181212bf7a8c5da58069d295e21f756fd616ac2c05f0a67f0cbb5624b350: Status 404 returned error can't find the container with id 710d181212bf7a8c5da58069d295e21f756fd616ac2c05f0a67f0cbb5624b350
May 21 17:01:14.593568 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:14.593477    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d" event={"ID":"484165f5-31ba-4414-ab46-305ab91fa0f6","Type":"ContainerStarted","Data":"710d181212bf7a8c5da58069d295e21f756fd616ac2c05f0a67f0cbb5624b350"}
May 21 17:01:21.621825 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:21.621782    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d" event={"ID":"484165f5-31ba-4414-ab46-305ab91fa0f6","Type":"ContainerStarted","Data":"58868d578c826911b1f88e01552de0d56ec98f0c784e4b85e4317c5c081e3af6"}
May 21 17:01:27.645642 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:27.645602    2570 generic.go:358] "Generic (PLEG): container finished" podID="484165f5-31ba-4414-ab46-305ab91fa0f6" containerID="58868d578c826911b1f88e01552de0d56ec98f0c784e4b85e4317c5c081e3af6" exitCode=0
May 21 17:01:27.646105 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:27.645676    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d" event={"ID":"484165f5-31ba-4414-ab46-305ab91fa0f6","Type":"ContainerDied","Data":"58868d578c826911b1f88e01552de0d56ec98f0c784e4b85e4317c5c081e3af6"}
May 21 17:01:29.654375 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:29.654343    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d" event={"ID":"484165f5-31ba-4414-ab46-305ab91fa0f6","Type":"ContainerStarted","Data":"e69449707a8504004b31138475cca4e473833f8a6465529af0f1cdaac60741e1"}
May 21 17:01:29.654759 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:29.654557    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:29.672925 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:29.672873    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d" podStartSLOduration=1.976948143 podStartE2EDuration="16.672856268s" podCreationTimestamp="2026-05-21 17:01:13 +0000 UTC" firstStartedPulling="2026-05-21 17:01:14.374223289 +0000 UTC m=+575.440828789" lastFinishedPulling="2026-05-21 17:01:29.070131414 +0000 UTC m=+590.136736914" observedRunningTime="2026-05-21 17:01:29.671937431 +0000 UTC m=+590.738542951" watchObservedRunningTime="2026-05-21 17:01:29.672856268 +0000 UTC m=+590.739461786"
May 21 17:01:33.504911 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.504869    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"]
May 21 17:01:33.509714 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.509690    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.512260 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.512238    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 17:01:33.518982 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.518955    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"]
May 21 17:01:33.666215 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.666435 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666243    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.666435 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.666435 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666337    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.666435 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwzs\" (UniqueName: \"kubernetes.io/projected/f91e698a-be0b-4d2f-af65-a479b061cb7e-kube-api-access-8xwzs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.666643 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.666470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91e698a-be0b-4d2f-af65-a479b061cb7e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767346 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767242    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwzs\" (UniqueName: \"kubernetes.io/projected/f91e698a-be0b-4d2f-af65-a479b061cb7e-kube-api-access-8xwzs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767346 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767306    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91e698a-be0b-4d2f-af65-a479b061cb7e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767583 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767388    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767583 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767473    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767583 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767505    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.767583 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.767543    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.768064 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.768029    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.768186 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.768090    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.768404 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.768382    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.770119 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.770100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91e698a-be0b-4d2f-af65-a479b061cb7e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.770763 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.770740    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91e698a-be0b-4d2f-af65-a479b061cb7e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.774984 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.774957    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwzs\" (UniqueName: \"kubernetes.io/projected/f91e698a-be0b-4d2f-af65-a479b061cb7e-kube-api-access-8xwzs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv\" (UID: \"f91e698a-be0b-4d2f-af65-a479b061cb7e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.820862 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.820788    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:33.969837 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:33.969804    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"]
May 21 17:01:33.973271 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:01:33.973201    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91e698a_be0b_4d2f_af65_a479b061cb7e.slice/crio-490968c54af08c422409015293bebd1dbbc5295076c3c890d7162ceface5d68b WatchSource:0}: Error finding container 490968c54af08c422409015293bebd1dbbc5295076c3c890d7162ceface5d68b: Status 404 returned error can't find the container with id 490968c54af08c422409015293bebd1dbbc5295076c3c890d7162ceface5d68b
May 21 17:01:34.678843 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:34.678798    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv" event={"ID":"f91e698a-be0b-4d2f-af65-a479b061cb7e","Type":"ContainerStarted","Data":"67964a70d933596fe1483dc064222774574fafc3b0aefadf1dd723a486ca5d91"}
May 21 17:01:34.678843 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:34.678839    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv" event={"ID":"f91e698a-be0b-4d2f-af65-a479b061cb7e","Type":"ContainerStarted","Data":"490968c54af08c422409015293bebd1dbbc5295076c3c890d7162ceface5d68b"}
May 21 17:01:39.482174 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:39.482142    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:01:39.484245 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:39.484223    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:01:40.674145 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:40.674112    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d"
May 21 17:01:43.711733 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:43.711699    2570 generic.go:358] "Generic (PLEG): container finished" podID="f91e698a-be0b-4d2f-af65-a479b061cb7e" containerID="67964a70d933596fe1483dc064222774574fafc3b0aefadf1dd723a486ca5d91" exitCode=0
May 21 17:01:43.712137 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:43.711768    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv" event={"ID":"f91e698a-be0b-4d2f-af65-a479b061cb7e","Type":"ContainerDied","Data":"67964a70d933596fe1483dc064222774574fafc3b0aefadf1dd723a486ca5d91"}
May 21 17:01:44.717371 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:44.717334    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv" event={"ID":"f91e698a-be0b-4d2f-af65-a479b061cb7e","Type":"ContainerStarted","Data":"09e5f40f4f60fb7c5ed230928435b6919602861e5c8e00a6d99bb5871e30c597"}
May 21 17:01:44.717776 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:44.717526    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:44.736661 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:44.736612    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv" podStartSLOduration=11.344808364 podStartE2EDuration="11.736596528s" podCreationTimestamp="2026-05-21 17:01:33 +0000 UTC" firstStartedPulling="2026-05-21 17:01:43.712432393 +0000 UTC m=+604.779037890" lastFinishedPulling="2026-05-21 17:01:44.104220556 +0000 UTC m=+605.170826054" observedRunningTime="2026-05-21 17:01:44.733947364 +0000 UTC m=+605.800552899" watchObservedRunningTime="2026-05-21 17:01:44.736596528 +0000 UTC m=+605.803202047"
May 21 17:01:47.503774 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.503736    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"]
May 21 17:01:47.513036 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.513001    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.515477 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.515450    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"]
May 21 17:01:47.516030 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.516010    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 17:01:47.601155 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.601155 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.601389 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601269    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.601389 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqpc\" (UniqueName: \"kubernetes.io/projected/44378c20-b9c5-4e10-b158-53d349dedae5-kube-api-access-sqqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.601389 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.601506 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.601425    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44378c20-b9c5-4e10-b158-53d349dedae5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.702810 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702771    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703001 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702819    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703001 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702860    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703001 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702884    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqpc\" (UniqueName: \"kubernetes.io/projected/44378c20-b9c5-4e10-b158-53d349dedae5-kube-api-access-sqqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703001 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702923    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703001 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.702970    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44378c20-b9c5-4e10-b158-53d349dedae5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703334 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.703310    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703334 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.703327    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.703407 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.703394    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.705288 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.705264    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44378c20-b9c5-4e10-b158-53d349dedae5-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.705387 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.705339    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44378c20-b9c5-4e10-b158-53d349dedae5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.711053 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.711034    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqpc\" (UniqueName: \"kubernetes.io/projected/44378c20-b9c5-4e10-b158-53d349dedae5-kube-api-access-sqqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q\" (UID: \"44378c20-b9c5-4e10-b158-53d349dedae5\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.824976 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.824876    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:47.975737 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.975712    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"]
May 21 17:01:47.977928 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:01:47.977895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44378c20_b9c5_4e10_b158_53d349dedae5.slice/crio-d73d1bb31de710c799a78884a6a9772b9e863a635a7337940720679129cdaf2c WatchSource:0}: Error finding container d73d1bb31de710c799a78884a6a9772b9e863a635a7337940720679129cdaf2c: Status 404 returned error can't find the container with id d73d1bb31de710c799a78884a6a9772b9e863a635a7337940720679129cdaf2c
May 21 17:01:47.979755 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:47.979738    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:01:48.732620 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:48.732578    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q" event={"ID":"44378c20-b9c5-4e10-b158-53d349dedae5","Type":"ContainerStarted","Data":"5ca8233376088495b05aa79fd496eaf2f26c84943bece756b423ecde836fd174"}
May 21 17:01:48.732620 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:48.732620    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q" event={"ID":"44378c20-b9c5-4e10-b158-53d349dedae5","Type":"ContainerStarted","Data":"d73d1bb31de710c799a78884a6a9772b9e863a635a7337940720679129cdaf2c"}
May 21 17:01:54.757403 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:54.757366    2570 generic.go:358] "Generic (PLEG): container finished" podID="44378c20-b9c5-4e10-b158-53d349dedae5" containerID="5ca8233376088495b05aa79fd496eaf2f26c84943bece756b423ecde836fd174" exitCode=0
May 21 17:01:54.757781 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:54.757437    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q" event={"ID":"44378c20-b9c5-4e10-b158-53d349dedae5","Type":"ContainerDied","Data":"5ca8233376088495b05aa79fd496eaf2f26c84943bece756b423ecde836fd174"}
May 21 17:01:55.734747 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:55.734716    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv"
May 21 17:01:55.765164 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:55.765123    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q" event={"ID":"44378c20-b9c5-4e10-b158-53d349dedae5","Type":"ContainerStarted","Data":"b225783c7b7ffc0d77bccf15a0dbdaeac871558bf84770e8edd3cbaeb5d90e2d"}
May 21 17:01:55.765627 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:55.765494    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:01:55.788696 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:01:55.788632    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q" podStartSLOduration=8.151509262 podStartE2EDuration="8.788614369s" podCreationTimestamp="2026-05-21 17:01:47 +0000 UTC" firstStartedPulling="2026-05-21 17:01:54.758150812 +0000 UTC m=+615.824756315" lastFinishedPulling="2026-05-21 17:01:55.395255925 +0000 UTC m=+616.461861422" observedRunningTime="2026-05-21 17:01:55.786860212 +0000 UTC m=+616.853465731" watchObservedRunningTime="2026-05-21 17:01:55.788614369 +0000 UTC m=+616.855219889"
May 21 17:02:06.784281 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:02:06.784194    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q"
May 21 17:04:19.361435 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.361367    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:04:19.362168 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.361788    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" podUID="4914254a-8631-4aee-89ca-aa2a1bd391be" containerName="manager" containerID="cri-o://b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a" gracePeriod=30
May 21 17:04:19.625391 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.625318    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:04:19.674090 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.674039    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7t9q\" (UniqueName: \"kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q\") pod \"4914254a-8631-4aee-89ca-aa2a1bd391be\" (UID: \"4914254a-8631-4aee-89ca-aa2a1bd391be\") "
May 21 17:04:19.676399 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.676349    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q" (OuterVolumeSpecName: "kube-api-access-g7t9q") pod "4914254a-8631-4aee-89ca-aa2a1bd391be" (UID: "4914254a-8631-4aee-89ca-aa2a1bd391be"). InnerVolumeSpecName "kube-api-access-g7t9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:04:19.775684 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:19.775640    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7t9q\" (UniqueName: \"kubernetes.io/projected/4914254a-8631-4aee-89ca-aa2a1bd391be-kube-api-access-g7t9q\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:04:20.284375 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.284342    2570 generic.go:358] "Generic (PLEG): container finished" podID="4914254a-8631-4aee-89ca-aa2a1bd391be" containerID="b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a" exitCode=0
May 21 17:04:20.284569 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.284407    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk"
May 21 17:04:20.284569 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.284423    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" event={"ID":"4914254a-8631-4aee-89ca-aa2a1bd391be","Type":"ContainerDied","Data":"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"}
May 21 17:04:20.284569 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.284463    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-ln4gk" event={"ID":"4914254a-8631-4aee-89ca-aa2a1bd391be","Type":"ContainerDied","Data":"089e2dc28d5d565bc024f5a37edb88d09df79c31b8e81c55a82847525e2b16c5"}
May 21 17:04:20.284569 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.284479    2570 scope.go:117] "RemoveContainer" containerID="b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"
May 21 17:04:20.294873 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.294851    2570 scope.go:117] "RemoveContainer" containerID="b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"
May 21 17:04:20.295224 ip-10-0-135-101 kubenswrapper[2570]: E0521 17:04:20.295204    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a\": container with ID starting with b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a not found: ID does not exist" containerID="b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"
May 21 17:04:20.295294 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.295233    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a"} err="failed to get container status \"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a\": rpc error: code = NotFound desc = could not find container \"b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a\": container with ID starting with b2bc5694997377f2ec4030798111d626aab00d3615c86d2a0d35b44722bb984a not found: ID does not exist"
May 21 17:04:20.307919 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.307884    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:04:20.310249 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:20.310221    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-ln4gk"]
May 21 17:04:21.019804 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.019753    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-lqg8s"]
May 21 17:04:21.020426 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.020398    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4914254a-8631-4aee-89ca-aa2a1bd391be" containerName="manager"
May 21 17:04:21.020426 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.020418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4914254a-8631-4aee-89ca-aa2a1bd391be" containerName="manager"
May 21 17:04:21.020542 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.020503    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="4914254a-8631-4aee-89ca-aa2a1bd391be" containerName="manager"
May 21 17:04:21.024864 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.024843    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:21.027532 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.027512    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tk6ht\""
May 21 17:04:21.031985 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.031950    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-lqg8s"]
May 21 17:04:21.094210 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.094176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zvt\" (UniqueName: \"kubernetes.io/projected/16a2bb57-cd0f-481b-b329-d65f123282ce-kube-api-access-95zvt\") pod \"maas-controller-7677bbcfbb-lqg8s\" (UID: \"16a2bb57-cd0f-481b-b329-d65f123282ce\") " pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:21.195529 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.195480    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95zvt\" (UniqueName: \"kubernetes.io/projected/16a2bb57-cd0f-481b-b329-d65f123282ce-kube-api-access-95zvt\") pod \"maas-controller-7677bbcfbb-lqg8s\" (UID: \"16a2bb57-cd0f-481b-b329-d65f123282ce\") " pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:21.204361 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.204327    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zvt\" (UniqueName: \"kubernetes.io/projected/16a2bb57-cd0f-481b-b329-d65f123282ce-kube-api-access-95zvt\") pod \"maas-controller-7677bbcfbb-lqg8s\" (UID: \"16a2bb57-cd0f-481b-b329-d65f123282ce\") " pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:21.337921 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.337811    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:21.479901 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.479867    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7677bbcfbb-lqg8s"]
May 21 17:04:21.483913 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:04:21.483859    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a2bb57_cd0f_481b_b329_d65f123282ce.slice/crio-5a7d18e87e3b406eaadcfd606c80ec67255e87ac73a74c096600b03f7f778328 WatchSource:0}: Error finding container 5a7d18e87e3b406eaadcfd606c80ec67255e87ac73a74c096600b03f7f778328: Status 404 returned error can't find the container with id 5a7d18e87e3b406eaadcfd606c80ec67255e87ac73a74c096600b03f7f778328
May 21 17:04:21.529269 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:21.529226    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4914254a-8631-4aee-89ca-aa2a1bd391be" path="/var/lib/kubelet/pods/4914254a-8631-4aee-89ca-aa2a1bd391be/volumes"
May 21 17:04:22.294250 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:22.294209    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s" event={"ID":"16a2bb57-cd0f-481b-b329-d65f123282ce","Type":"ContainerStarted","Data":"db1df896bb4ae4703816878fe9fb4e02bffbf04185903e2ad74cbbab98e1e261"}
May 21 17:04:22.294250 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:22.294252    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s" event={"ID":"16a2bb57-cd0f-481b-b329-d65f123282ce","Type":"ContainerStarted","Data":"5a7d18e87e3b406eaadcfd606c80ec67255e87ac73a74c096600b03f7f778328"}
May 21 17:04:22.294723 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:22.294325    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:04:22.311925 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:22.311871    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s" podStartSLOduration=0.904986918 podStartE2EDuration="1.31185293s" podCreationTimestamp="2026-05-21 17:04:21 +0000 UTC" firstStartedPulling="2026-05-21 17:04:21.485243606 +0000 UTC m=+762.551849117" lastFinishedPulling="2026-05-21 17:04:21.892109591 +0000 UTC m=+762.958715129" observedRunningTime="2026-05-21 17:04:22.310036534 +0000 UTC m=+763.376642074" watchObservedRunningTime="2026-05-21 17:04:22.31185293 +0000 UTC m=+763.378458449"
May 21 17:04:33.303461 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:04:33.303422    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7677bbcfbb-lqg8s"
May 21 17:06:39.507726 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:06:39.507647    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:06:39.513925 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:06:39.513902    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:11:39.533788 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:11:39.533748    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:11:39.542631 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:11:39.542604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:14:36.618657 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:36.618616    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 17:14:36.621220 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:36.618978    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" podUID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" containerName="manager" containerID="cri-o://7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b" gracePeriod=10
May 21 17:14:36.962453 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:36.962424    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 17:14:37.039704 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.039668    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fgsd\" (UniqueName: \"kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd\") pod \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") "
May 21 17:14:37.039873 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.039723    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume\") pod \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\" (UID: \"651fffea-66d3-4f56-acf5-524d7f4c1ed9\") "
May 21 17:14:37.040064 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.040040    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "651fffea-66d3-4f56-acf5-524d7f4c1ed9" (UID: "651fffea-66d3-4f56-acf5-524d7f4c1ed9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:14:37.041767 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.041738    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd" (OuterVolumeSpecName: "kube-api-access-4fgsd") pod "651fffea-66d3-4f56-acf5-524d7f4c1ed9" (UID: "651fffea-66d3-4f56-acf5-524d7f4c1ed9"). InnerVolumeSpecName "kube-api-access-4fgsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:14:37.141300 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.141209    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fgsd\" (UniqueName: \"kubernetes.io/projected/651fffea-66d3-4f56-acf5-524d7f4c1ed9-kube-api-access-4fgsd\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:14:37.141300 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.141244    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/651fffea-66d3-4f56-acf5-524d7f4c1ed9-extensions-socket-volume\") on node \"ip-10-0-135-101.ec2.internal\" DevicePath \"\""
May 21 17:14:37.503825 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.503792    2570 generic.go:358] "Generic (PLEG): container finished" podID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" containerID="7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b" exitCode=0
May 21 17:14:37.503995 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.503857    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"
May 21 17:14:37.503995 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.503876    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" event={"ID":"651fffea-66d3-4f56-acf5-524d7f4c1ed9","Type":"ContainerDied","Data":"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"}
May 21 17:14:37.503995 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.503918    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l" event={"ID":"651fffea-66d3-4f56-acf5-524d7f4c1ed9","Type":"ContainerDied","Data":"28d93669ee87f98fc88ccdef94b33e0e6a240464135d069ed8f9b37ff8b3b183"}
May 21 17:14:37.503995 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.503937    2570 scope.go:117] "RemoveContainer" containerID="7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"
May 21 17:14:37.519586 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.519565    2570 scope.go:117] "RemoveContainer" containerID="7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"
May 21 17:14:37.519878 ip-10-0-135-101 kubenswrapper[2570]: E0521 17:14:37.519858    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b\": container with ID starting with 7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b not found: ID does not exist" containerID="7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"
May 21 17:14:37.519922 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.519889    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b"} err="failed to get container status \"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b\": rpc error: code = NotFound desc = could not find container \"7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b\": container with ID starting with 7ddd98745c250bdcb77c8e02e47307157c7bc415e2f031ca0a1bd0ce0bb45c4b not found: ID does not exist"
May 21 17:14:37.531306 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.531280    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 17:14:37.537050 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:37.537025    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zws9l"]
May 21 17:14:39.527980 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:14:39.527945    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" path="/var/lib/kubelet/pods/651fffea-66d3-4f56-acf5-524d7f4c1ed9/volumes"
May 21 17:15:42.721904 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.721818    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"]
May 21 17:15:42.722494 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.722464    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" containerName="manager"
May 21 17:15:42.722494 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.722486    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" containerName="manager"
May 21 17:15:42.722614 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.722591    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="651fffea-66d3-4f56-acf5-524d7f4c1ed9" containerName="manager"
May 21 17:15:42.725488 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.725464    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.728206 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.728186    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-px8cd\""
May 21 17:15:42.735048 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.735023    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"]
May 21 17:15:42.834473 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.834432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5vv9\" (UniqueName: \"kubernetes.io/projected/b47b1297-b13d-4006-891f-67461dd6a3a6-kube-api-access-x5vv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.834638 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.834488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47b1297-b13d-4006-891f-67461dd6a3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.936095 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.936038    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5vv9\" (UniqueName: \"kubernetes.io/projected/b47b1297-b13d-4006-891f-67461dd6a3a6-kube-api-access-x5vv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.936253 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.936140    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47b1297-b13d-4006-891f-67461dd6a3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.936535 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.936514    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47b1297-b13d-4006-891f-67461dd6a3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:42.944429 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:42.944408    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5vv9\" (UniqueName: \"kubernetes.io/projected/b47b1297-b13d-4006-891f-67461dd6a3a6-kube-api-access-x5vv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w9z6b\" (UID: \"b47b1297-b13d-4006-891f-67461dd6a3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:43.036897 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.036810    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:43.172269 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.172244    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"]
May 21 17:15:43.174455 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:15:43.174429    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47b1297_b13d_4006_891f_67461dd6a3a6.slice/crio-88b0fba30e48a5eeef526040ca4500f09a54ded7d0fb4ef29492d3ae05bde4d6 WatchSource:0}: Error finding container 88b0fba30e48a5eeef526040ca4500f09a54ded7d0fb4ef29492d3ae05bde4d6: Status 404 returned error can't find the container with id 88b0fba30e48a5eeef526040ca4500f09a54ded7d0fb4ef29492d3ae05bde4d6
May 21 17:15:43.176614 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.176599    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:15:43.743177 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.743134    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b" event={"ID":"b47b1297-b13d-4006-891f-67461dd6a3a6","Type":"ContainerStarted","Data":"532a61dcbe251fcbbb4f3b300a072e61afa73358ef0c2f8621122e6de64c54ad"}
May 21 17:15:43.743177 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.743184    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b" event={"ID":"b47b1297-b13d-4006-891f-67461dd6a3a6","Type":"ContainerStarted","Data":"88b0fba30e48a5eeef526040ca4500f09a54ded7d0fb4ef29492d3ae05bde4d6"}
May 21 17:15:43.743615 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.743282    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:15:43.765627 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:43.765577    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b" podStartSLOduration=1.765561116 podStartE2EDuration="1.765561116s" podCreationTimestamp="2026-05-21 17:15:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:15:43.763402989 +0000 UTC m=+1444.830008509" watchObservedRunningTime="2026-05-21 17:15:43.765561116 +0000 UTC m=+1444.832166635"
May 21 17:15:54.749323 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:15:54.749291    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w9z6b"
May 21 17:16:39.557585 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:16:39.557557    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:16:39.567154 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:16:39.567129    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:21:39.582270 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:21:39.582238    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:21:39.592599 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:21:39.592568    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:25:25.723251 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:25.723209    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-f4ck9_101859cd-89d0-48a7-9f4c-73ff40b35502/manager/0.log"
May 21 17:25:25.841277 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:25.841246    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-896cd8bcf-lsz5d_2a64915e-533b-4ab8-9a33-72b468402b6c/maas-api/0.log"
May 21 17:25:25.954927 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:25.954891    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7677bbcfbb-lqg8s_16a2bb57-cd0f-481b-b329-d65f123282ce/manager/0.log"
May 21 17:25:26.069213 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:26.069122    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vs6cp_5ae21397-ca24-4145-9fdc-1acf09dd7dc5/manager/0.log"
May 21 17:25:26.185756 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:26.185718    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd8cc67f-2bn8x_43fb05f1-7276-49bb-8d89-1fac3f58baa4/manager/0.log"
May 21 17:25:26.524676 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:26.524647    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kqrbf_4abac351-a2ff-4d36-9f25-faf868029ad5/postgres/0.log"
May 21 17:25:27.971604 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:27.971573    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jgk26_f343dced-e7c4-49e5-a4fc-d49f7a37d2a9/manager/0.log"
May 21 17:25:28.312677 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:28.312590    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-w9z6b_b47b1297-b13d-4006-891f-67461dd6a3a6/manager/0.log"
May 21 17:25:29.014261 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:29.014233    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-v8cht_7d2412c0-bca5-412e-9d01-6dce311f8ebd/discovery/0.log"
May 21 17:25:29.118016 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:29.117987    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764769945-bfvr6_713eafc2-e3e6-4adc-9e90-f22a3adf6399/kube-auth-proxy/0.log"
May 21 17:25:29.565675 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:29.565646    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759f558cf8-g47cn_f0b9a1b3-46f9-499e-8df8-0e172600f3d8/router/0.log"
May 21 17:25:30.014408 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.014367    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q_44378c20-b9c5-4e10-b158-53d349dedae5/storage-initializer/0.log"
May 21 17:25:30.020647 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.020626    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-57t5q_44378c20-b9c5-4e10-b158-53d349dedae5/main/0.log"
May 21 17:25:30.248603 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.248570    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d_484165f5-31ba-4414-ab46-305ab91fa0f6/storage-initializer/0.log"
May 21 17:25:30.255229 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.255206    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccfnm7d_484165f5-31ba-4414-ab46-305ab91fa0f6/main/0.log"
May 21 17:25:30.477978 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.477945    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv_f91e698a-be0b-4d2f-af65-a479b061cb7e/storage-initializer/0.log"
May 21 17:25:30.483845 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:30.483817    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-9jdnv_f91e698a-be0b-4d2f-af65-a479b061cb7e/main/0.log"
May 21 17:25:37.209491 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:37.209456    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nr9ps_8c487812-0c0e-4c3c-b284-4ba24545c6b2/global-pull-secret-syncer/0.log"
May 21 17:25:37.289494 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:37.289466    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jtfc_913e2e52-5686-4433-9e9b-f4a220b2b163/konnectivity-agent/0.log"
May 21 17:25:37.400174 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:37.400141    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-101.ec2.internal_7351469ed0e965f52e9a91736742ff82/haproxy/0.log"
May 21 17:25:41.696406 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:41.696373    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jgk26_f343dced-e7c4-49e5-a4fc-d49f7a37d2a9/manager/0.log"
May 21 17:25:41.861295 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:41.861253    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-w9z6b_b47b1297-b13d-4006-891f-67461dd6a3a6/manager/0.log"
May 21 17:25:43.591206 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:43.591128    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-54zlq_1b80bd91-e87c-4d96-86d8-34b1b4ac2b08/cluster-monitoring-operator/0.log"
May 21 17:25:43.737050 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:43.737020    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76gzt_9798d03b-7123-47b4-83dc-8dad466ae662/node-exporter/0.log"
May 21 17:25:43.751841 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:43.751812    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76gzt_9798d03b-7123-47b4-83dc-8dad466ae662/kube-rbac-proxy/0.log"
May 21 17:25:43.766637 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:43.766612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76gzt_9798d03b-7123-47b4-83dc-8dad466ae662/init-textfile/0.log"
May 21 17:25:45.424942 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:45.424912    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-q66qj_63b02428-e2d1-4cd6-a30b-aad3451ed47e/networking-console-plugin/0.log"
May 21 17:25:45.896568 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:45.896482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/1.log"
May 21 17:25:45.901396 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:45.901375    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dzdsv_56bc23ef-0dbc-4546-a260-89b22add976f/console-operator/2.log"
May 21 17:25:46.147906 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.147883    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"]
May 21 17:25:46.151368 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.151350    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.153881 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.153862    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9c6n\"/\"kube-root-ca.crt\""
May 21 17:25:46.153955 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.153895    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9c6n\"/\"openshift-service-ca.crt\""
May 21 17:25:46.155117 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.155047    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l9c6n\"/\"default-dockercfg-8b765\""
May 21 17:25:46.157360 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.157336    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"]
May 21 17:25:46.216844 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.216811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-podres\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.217036 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.216859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h8ww\" (UniqueName: \"kubernetes.io/projected/beb3c46a-20f7-4156-a1d7-65b39d1db44e-kube-api-access-4h8ww\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.217036 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.216973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-proc\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.217177 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.217033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-lib-modules\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.217177 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.217066    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-sys\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318242 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318197    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-podres\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318242 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318255    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h8ww\" (UniqueName: \"kubernetes.io/projected/beb3c46a-20f7-4156-a1d7-65b39d1db44e-kube-api-access-4h8ww\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318289    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-proc\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318310    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-lib-modules\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318331    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-sys\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318406    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-proc\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318420    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-sys\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318409    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-podres\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.318512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.318483    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beb3c46a-20f7-4156-a1d7-65b39d1db44e-lib-modules\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.326373 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.326344    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h8ww\" (UniqueName: \"kubernetes.io/projected/beb3c46a-20f7-4156-a1d7-65b39d1db44e-kube-api-access-4h8ww\") pod \"perf-node-gather-daemonset-zpm65\" (UID: \"beb3c46a-20f7-4156-a1d7-65b39d1db44e\") " pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.462514 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.462425    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.592955 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.592924    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"]
May 21 17:25:46.596217 ip-10-0-135-101 kubenswrapper[2570]: W0521 17:25:46.596188    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbeb3c46a_20f7_4156_a1d7_65b39d1db44e.slice/crio-33f6bfa497a8ed9c4822d8642a45dd2bcbfe97284b059f7b9b4237f23ec8c2a7 WatchSource:0}: Error finding container 33f6bfa497a8ed9c4822d8642a45dd2bcbfe97284b059f7b9b4237f23ec8c2a7: Status 404 returned error can't find the container with id 33f6bfa497a8ed9c4822d8642a45dd2bcbfe97284b059f7b9b4237f23ec8c2a7
May 21 17:25:46.597827 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.597810    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:25:46.872092 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.871976    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65" event={"ID":"beb3c46a-20f7-4156-a1d7-65b39d1db44e","Type":"ContainerStarted","Data":"fa28b5e0b655a2b7f8d4693ce2c4a4931b497a0bc40fa27cde1b8980d24dc500"}
May 21 17:25:46.872092 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.872014    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65" event={"ID":"beb3c46a-20f7-4156-a1d7-65b39d1db44e","Type":"ContainerStarted","Data":"33f6bfa497a8ed9c4822d8642a45dd2bcbfe97284b059f7b9b4237f23ec8c2a7"}
May 21 17:25:46.872300 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.872102    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:46.889782 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.889721    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65" podStartSLOduration=0.889704933 podStartE2EDuration="889.704933ms" podCreationTimestamp="2026-05-21 17:25:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:25:46.888307716 +0000 UTC m=+2047.954913236" watchObservedRunningTime="2026-05-21 17:25:46.889704933 +0000 UTC m=+2047.956310453"
May 21 17:25:46.911475 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:46.911442    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-ffnfh_db7d88ad-afed-4d0a-9b8f-591ddc953d97/volume-data-source-validator/0.log"
May 21 17:25:47.728663 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:47.728636    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvq_6ff6cae9-27ab-41b1-905f-200b0d57f825/dns/0.log"
May 21 17:25:47.743053 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:47.743029    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvq_6ff6cae9-27ab-41b1-905f-200b0d57f825/kube-rbac-proxy/0.log"
May 21 17:25:47.793585 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:47.793558    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gzzqt_f26e105d-3089-44b1-bc40-9b376927ee68/dns-node-resolver/0.log"
May 21 17:25:48.384566 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:48.384539    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8mgq_a8a068b4-42bd-49d9-985d-b66ac1394fd1/node-ca/0.log"
May 21 17:25:49.245537 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:49.245497    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-v8cht_7d2412c0-bca5-412e-9d01-6dce311f8ebd/discovery/0.log"
May 21 17:25:49.262911 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:49.262885    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764769945-bfvr6_713eafc2-e3e6-4adc-9e90-f22a3adf6399/kube-auth-proxy/0.log"
May 21 17:25:49.471546 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:49.471518    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759f558cf8-g47cn_f0b9a1b3-46f9-499e-8df8-0e172600f3d8/router/0.log"
May 21 17:25:49.993528 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:49.993487    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hh2fc_f4de536e-269e-4768-a35e-a334709a0e63/serve-healthcheck-canary/0.log"
May 21 17:25:50.426029 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:50.425998    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vppgx_ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826/insights-operator/0.log"
May 21 17:25:50.426525 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:50.426488    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vppgx_ce5ce1d1-2f1c-4997-9f43-4bb06fdfe826/insights-operator/1.log"
May 21 17:25:50.547120 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:50.547094    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsv5k_76eb6649-c40f-4d4b-8116-1361f39e5661/kube-rbac-proxy/0.log"
May 21 17:25:50.562633 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:50.562610    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsv5k_76eb6649-c40f-4d4b-8116-1361f39e5661/exporter/0.log"
May 21 17:25:50.579372 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:50.579347    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zsv5k_76eb6649-c40f-4d4b-8116-1361f39e5661/extractor/0.log"
May 21 17:25:52.479340 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.479306    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-f4ck9_101859cd-89d0-48a7-9f4c-73ff40b35502/manager/0.log"
May 21 17:25:52.505934 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.505897    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-896cd8bcf-lsz5d_2a64915e-533b-4ab8-9a33-72b468402b6c/maas-api/0.log"
May 21 17:25:52.570915 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.570868    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7677bbcfbb-lqg8s_16a2bb57-cd0f-481b-b329-d65f123282ce/manager/0.log"
May 21 17:25:52.599695 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.599666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vs6cp_5ae21397-ca24-4145-9fdc-1acf09dd7dc5/manager/0.log"
May 21 17:25:52.632935 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.632905    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd8cc67f-2bn8x_43fb05f1-7276-49bb-8d89-1fac3f58baa4/manager/0.log"
May 21 17:25:52.695282 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.695252    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kqrbf_4abac351-a2ff-4d36-9f25-faf868029ad5/postgres/0.log"
May 21 17:25:52.886562 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:52.886474    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l9c6n/perf-node-gather-daemonset-zpm65"
May 21 17:25:58.340347 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:58.340304    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-p2wmn_e1c30838-7772-4c96-8ea3-c66c6a5382a1/kube-storage-version-migrator-operator/1.log"
May 21 17:25:58.341180 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:58.341160    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-p2wmn_e1c30838-7772-4c96-8ea3-c66c6a5382a1/kube-storage-version-migrator-operator/0.log"
May 21 17:25:59.347181 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.347109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/kube-multus-additional-cni-plugins/0.log"
May 21 17:25:59.365961 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.365918    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/egress-router-binary-copy/0.log"
May 21 17:25:59.381867 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.381833    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/cni-plugins/0.log"
May 21 17:25:59.398167 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.398135    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/bond-cni-plugin/0.log"
May 21 17:25:59.414512 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.414482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/routeoverride-cni/0.log"
May 21 17:25:59.431790 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.431768    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/whereabouts-cni-bincopy/0.log"
May 21 17:25:59.448912 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.448892    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l26pl_d20f208c-64e4-4e6c-8cd1-6b09e2c8a7db/whereabouts-cni/0.log"
May 21 17:25:59.673018 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.672990    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tf4ng_b83ce725-bac4-47f2-8df4-8d1f79d7c0ff/kube-multus/0.log"
May 21 17:25:59.722259 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.722232    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvlmp_49c4e0d0-2a0c-4bc2-ba8b-884b0c472870/network-metrics-daemon/0.log"
May 21 17:25:59.736174 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:25:59.736151    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvlmp_49c4e0d0-2a0c-4bc2-ba8b-884b0c472870/kube-rbac-proxy/0.log"
May 21 17:26:01.166154 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.166119    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/ovn-controller/0.log"
May 21 17:26:01.187716 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.187681    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/ovn-acl-logging/0.log"
May 21 17:26:01.204597 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.204566    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/kube-rbac-proxy-node/0.log"
May 21 17:26:01.220158 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.220133    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/kube-rbac-proxy-ovn-metrics/0.log"
May 21 17:26:01.234421 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.234384    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/northd/0.log"
May 21 17:26:01.252391 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.252360    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/nbdb/0.log"
May 21 17:26:01.268969 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.268933    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/sbdb/0.log"
May 21 17:26:01.364688 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:01.364651    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9nfr2_a3605cf4-5414-4c99-8427-98dde62979c1/ovnkube-controller/0.log"
May 21 17:26:02.383400 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:02.383313    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-7ptz7_fd6f0f68-8237-4e91-ba66-6751eb0781e6/check-endpoints/0.log"
May 21 17:26:02.445006 ip-10-0-135-101 kubenswrapper[2570]: I0521 17:26:02.444973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nj9vt_50e8aafd-06fc-4bcb-8c87-ec761edc7550/network-check-target-container/0.log"