May 27 17:40:41.399300 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 27 17:40:41.399312 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 27 17:40:41.399321 ip-10-0-135-90 systemd[1]: kubelet.service: Failed with result 'resources'.
May 27 17:40:41.399541 ip-10-0-135-90 systemd[1]: Failed to start Kubernetes Kubelet.
May 27 17:40:51.482525 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 27 17:40:51.482542 ip-10-0-135-90 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8151147a7eac478f8c2cf6b8f5d97df9 --
May 27 17:43:09.263706 ip-10-0-135-90 systemd[1]: Starting Kubernetes Kubelet...
May 27 17:43:09.756022 ip-10-0-135-90 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:43:09.756022 ip-10-0-135-90 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 17:43:09.756022 ip-10-0-135-90 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:43:09.756022 ip-10-0-135-90 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 17:43:09.756022 ip-10-0-135-90 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:43:09.759737 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.759650    2549 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 17:43:09.763205 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763188    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:43:09.763205 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763202    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:43:09.763205 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763208    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763213    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763225    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763230    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763233    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763237    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763242    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763246    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763275    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763282    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763287    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763294    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763306    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763312    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763318    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763322    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763327    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763331    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763335    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763339    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:43:09.763393 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763344    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763348    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763352    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763356    2549 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763360    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763364    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763368    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763373    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763377    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763381    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763385    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763389    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763394    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763397    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763401    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763405    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763409    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763429    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763435    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763442    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:43:09.764211 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763447    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763452    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763456    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763460    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763464    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763468    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763472    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763476    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763480    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763485    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763489    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763493    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763497    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763501    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763507    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763511    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763515    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763520    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763524    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763528    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:43:09.764953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763532    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763537    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763541    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763545    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763550    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763554    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763558    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763562    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763567    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763571    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763575    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763579    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763584    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763588    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763592    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763598    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763603    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763607    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763612    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:43:09.765485 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763616    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763620    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763624    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763628    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.763632    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764230    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764241    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764246    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764251    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764255    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764259    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764264    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764268    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764272    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764276    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764281    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764287    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764291    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764295    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:43:09.765939 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764300    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764304    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764308    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764312    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764316    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764320    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764324    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764328    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764333    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764337    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764341    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764345    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764349    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764353    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764357    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764362    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764366    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764370    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764374    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:43:09.766512 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764378    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764383    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764387    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764391    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764395    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764399    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764404    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764410    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764431    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764436    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764445    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764452    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764458    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764463    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764467    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764472    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764476    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764480    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764484    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:43:09.767525 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764488    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764492    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764496    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764501    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764504    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764508    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764512    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764516    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764520    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764524    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764528    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764532    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764536    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764541    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764545    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764549    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764553    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764558    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764562    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764566    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:43:09.768086 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764570    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764575    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764579    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764585    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764589    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764593    2549 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764597    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764601    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764606    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764610    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764614    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764618    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764622    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.764626    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766279    2549 flags.go:64] FLAG: --address="0.0.0.0"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766303    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766312    2549 flags.go:64] FLAG: --anonymous-auth="true"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766320    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766326    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766332    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766340    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 17:43:09.768689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766348    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766353    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766358    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766364    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766370    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766375    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766380    2549 flags.go:64] FLAG: --cgroup-root=""
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766385    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766390    2549 flags.go:64] FLAG: --client-ca-file=""
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766395    2549 flags.go:64] FLAG: --cloud-config=""
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766399    2549 flags.go:64] FLAG: --cloud-provider="external"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766404    2549 flags.go:64] FLAG: --cluster-dns="[]"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766411    2549 flags.go:64] FLAG: --cluster-domain=""
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766432    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766437    2549 flags.go:64] FLAG: --config-dir=""
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766442    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766448    2549 flags.go:64] FLAG: --container-log-max-files="5"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766455    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766460    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766465    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766470    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766475    2549 flags.go:64] FLAG: --contention-profiling="false"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766479    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766484    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766489    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 17:43:09.769426 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766494    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766500    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766505    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766510    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766515    2549 flags.go:64] FLAG: --enable-load-reader="false"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766519    2549 flags.go:64] FLAG: --enable-server="true"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766524    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766530    2549 flags.go:64] FLAG: --event-burst="100"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766535    2549 flags.go:64] FLAG: --event-qps="50"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766540    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766545    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766550    2549 flags.go:64] FLAG: --eviction-hard=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766556    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766560    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766565    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766570    2549 flags.go:64] FLAG: --eviction-soft=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766574    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766579    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766584    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766589    2549 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766595    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766601    2549 flags.go:64] FLAG: --fail-swap-on="true"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766606    2549 flags.go:64] FLAG: --feature-gates=""
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766612    2549 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766617    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 17:43:09.770035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766622    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766627    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766632    2549 flags.go:64] FLAG: --healthz-port="10248"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766637    2549 flags.go:64] FLAG: --help="false"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766642    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-135-90.ec2.internal"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766647    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766653    2549 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766657    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766664    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766670    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766675    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766679    2549 flags.go:64] FLAG: --image-service-endpoint=""
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766684    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766689    2549 flags.go:64] FLAG: --kube-api-burst="100"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766694    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766699    2549 flags.go:64] FLAG: --kube-api-qps="50"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766704    2549 flags.go:64] FLAG: --kube-reserved=""
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766708    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766713    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766718    2549 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766723    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766728    2549 flags.go:64] FLAG: --lock-file=""
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766732    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766737    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 17:43:09.770745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766742    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766750    2549 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766754    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766759    2549 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766764    2549 flags.go:64] FLAG: --logging-format="text"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766768    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766773    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766778    2549 flags.go:64] FLAG: --manifest-url=""
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766784    2549 flags.go:64] FLAG: --manifest-url-header=""
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766791    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766796    2549 flags.go:64] FLAG: --max-open-files="1000000"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766807    2549 flags.go:64] FLAG: --max-pods="110"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766812    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766817    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766821    2549 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766826    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766830    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766835    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766840    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766852    2549 flags.go:64] FLAG: --node-status-max-images="50"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766857    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766861    2549 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766866    2549 flags.go:64] FLAG: --pod-cidr=""
May 27 17:43:09.771333 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766870    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766879    2549 flags.go:64] FLAG: --pod-manifest-path=""
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766884    2549 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766889    2549 flags.go:64] FLAG: --pods-per-core="0"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766894    2549 flags.go:64] FLAG: --port="10250"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766899    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766904    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078f8bd436d7c61a1"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766910    2549 flags.go:64] FLAG: --qos-reserved=""
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766914    2549 flags.go:64] FLAG: --read-only-port="10255"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766919    2549 flags.go:64] FLAG: --register-node="true"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766924    2549 flags.go:64] FLAG: --register-schedulable="true"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766928    2549 flags.go:64] FLAG: --register-with-taints=""
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766934    2549 flags.go:64] FLAG: --registry-burst="10"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766939    2549 flags.go:64] FLAG: --registry-qps="5"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766944    2549 flags.go:64] FLAG: --reserved-cpus=""
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766948    2549 flags.go:64] FLAG: --reserved-memory=""
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766954    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766959    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766965    2549 flags.go:64] FLAG: --rotate-certificates="false"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766969    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766974    2549 flags.go:64] FLAG: --runonce="false"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766979    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766984    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766989    2549 flags.go:64] FLAG: --seccomp-default="false"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766994    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.766999    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 17:43:09.771930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767004    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767009    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767013    2549 flags.go:64] FLAG: --storage-driver-password="root"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767018    2549 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767023    2549 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767027    2549 flags.go:64] FLAG: --storage-driver-user="root"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767032    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767037    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767042    2549 flags.go:64] FLAG: --system-cgroups=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767047    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767055    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767060    2549 flags.go:64] FLAG: --tls-cert-file=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767064    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767073    2549 flags.go:64] FLAG: --tls-min-version=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767078    2549 flags.go:64] FLAG: --tls-private-key-file=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767082    2549 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767087    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767091    2549 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767096    2549 flags.go:64] FLAG: --v="2"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767102    2549 flags.go:64] FLAG: --version="false"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767109    2549 flags.go:64] FLAG: --vmodule=""
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767115    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.767120    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767272    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767279    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:43:09.772596 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767284    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767288    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767293    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767297    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767300    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767304    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767308    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767315    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767318    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767322    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767326    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767330    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767334    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767341    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767345    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767349    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767353    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767358    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767361    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767365    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:43:09.773231 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767369    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767373    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767377    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767381    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767385    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767389    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767393    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767398    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767402    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767407    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767411    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767430    2549 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767434    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767439    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767444    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767447    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767451    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767456    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767460    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767469    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:43:09.773808 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767473    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767477    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767482    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767486    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767490    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767498    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767503    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767508    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767512    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767517    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767521    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767525    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767529    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767533    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767537    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767541    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767545    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767549    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767553    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767558    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:43:09.774444 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767562    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767566    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767571    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767575    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767580    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767584    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767589    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767593    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767597    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767602    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767606    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767612    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767617    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767621    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767625    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767630    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767634    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767640    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767644    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:43:09.775168 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767651    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:43:09.775852 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767657    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:43:09.775852 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767663    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:43:09.775852 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767668    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:43:09.775852 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.767673    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:43:09.775852 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.768226    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:43:09.776566 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.776547    2549 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 17:43:09.776608 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.776568    2549 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776616    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776621    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776625    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776628    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776631    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776634    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776637    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776640    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776642    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:43:09.776641 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776645    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776649    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776652    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776654    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776657    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776659    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776662    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776665    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776667    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776670    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776672    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776675    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776678    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776681    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776684    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776687    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776690    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776692    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776695    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776698    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:43:09.776888 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776700    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776703    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776705    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776708    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776711    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776714    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776716    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776719    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776722    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776724    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776727    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776730    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776732    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776735    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776738    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776741    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776744    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776746    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776749    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776752    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:43:09.777409 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776754    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776757    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776760    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776763    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776765    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776768    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776770    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776773    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776776    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776778    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776781    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776785    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776790    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776794    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776798    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776801    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776804    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776807    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776810    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:43:09.777932 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776813    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776815    2549 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776818    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776821    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776823    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776826    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776829    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776832    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776835    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776838    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776840    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776843    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776845    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776848    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776851    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776853    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776856    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:43:09.778403 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776859    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.776864    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776958    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776963    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776967    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776970    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776973    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776976    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776978    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776982    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776984    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776987    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776990    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776993    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776996    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:43:09.778897 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.776999    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777002    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777004    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777007    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777010    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777012    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777015    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777018    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777021    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777024    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777027    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777029    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777032    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777034    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777037    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777040    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777042    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777046    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777050    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:43:09.779270 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777053    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777056    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777059    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777062    2549 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777064    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777067    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777069    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777072    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777075    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777078    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777081    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777083    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777086    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777089    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777091    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777095    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777099    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777102    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777105    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:43:09.779838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777108    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777111    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777113    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777116    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777119    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777122    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777124    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777127    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777130    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777132    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777134    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777137    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777140    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777143    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777145    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777148    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777150    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777153    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777156    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777158    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:43:09.780303 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777161    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777164    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777166    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777169    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777172    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777174    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777177    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777180    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777182    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777185    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777187    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777190    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777192    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777195    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:09.777198    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:43:09.780845 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.777203    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:43:09.781260 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.778272    2549 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 17:43:09.781260 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.780866    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 17:43:09.781806 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.781795    2549 server.go:1019] "Starting client certificate rotation"
May 27 17:43:09.781909 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.781892    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:43:09.781957 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.781941    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:43:09.809537 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.809518    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:43:09.811363 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.811345    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:43:09.828216 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.828196    2549 log.go:25] "Validated CRI v1 runtime API"
May 27 17:43:09.834782 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.834768    2549 log.go:25] "Validated CRI v1 image API"
May 27 17:43:09.836026 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.836010    2549 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 17:43:09.838743 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.838704    2549 fs.go:135] Filesystem UUIDs: map[413678d4-6b59-4496-9da5-f140db628663:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 be861f35-8fd0-46ee-8b3e-d6236d5739fa:/dev/nvme0n1p4]
May 27 17:43:09.838837 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.838742    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 17:43:09.843939 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.843824    2549 manager.go:217] Machine: {Timestamp:2026-05-27 17:43:09.843296728 +0000 UTC m=+0.435144697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093133 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d6e50f2c48cae08c8d9b9b9c09a51 SystemUUID:ec2d6e50-f2c4-8cae-08c8-d9b9b9c09a51 BootID:8151147a-7eac-478f-8c2c-f6b8f5d97df9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:3a:e6:7d:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:3a:e6:7d:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:8c:6a:9e:38:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 17:43:09.844596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.844582    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 17:43:09.844710 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.844695    2549 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 17:43:09.845850 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.845820    2549 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 17:43:09.846009 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.845851    2549 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 17:43:09.846085 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.846023    2549 topology_manager.go:138] "Creating topology manager with none policy"
May 27 17:43:09.846085 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.846034    2549 container_manager_linux.go:306] "Creating device plugin manager"
May 27 17:43:09.846085 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.846044    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:43:09.846664 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.846652    2549 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:43:09.848720 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.848707    2549 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:43:09.848844 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.848833    2549 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 17:43:09.848911 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.848896    2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:43:09.851606 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.851593    2549 kubelet.go:491] "Attempting to sync node with API server"
May 27 17:43:09.851666 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.851611    2549 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 17:43:09.851666 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.851627    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 17:43:09.851666 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.851639    2549 kubelet.go:397] "Adding apiserver pod source"
May 27 17:43:09.851666 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.851651    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 17:43:09.852653 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.852641    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:43:09.852713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.852663    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:43:09.856113 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.856100    2549 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 17:43:09.857915 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.857902    2549 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 17:43:09.858806 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858794    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858813    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858832    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858837    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858846    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858851    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858857    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 17:43:09.858863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858862    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 17:43:09.859054 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858870    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 17:43:09.859054 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858876    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 17:43:09.859054 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.858893    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 17:43:09.859054 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.859049    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 17:43:09.859801 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.859790    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 17:43:09.859801 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.859801    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 17:43:09.863116 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.863102    2549 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 17:43:09.863195 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.863155    2549 server.go:1295] "Started kubelet"
May 27 17:43:09.863273 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.863221    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 17:43:09.863356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.863306    2549 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 17:43:09.863427 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.863402    2549 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 17:43:09.864149 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.864131    2549 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 17:43:09.864149 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.864123    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 17:43:09.864183 ip-10-0-135-90 systemd[1]: Started Kubernetes Kubelet.
May 27 17:43:09.864759 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.864317    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 17:43:09.865649 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.865636    2549 server.go:317] "Adding debug handlers to kubelet server"
May 27 17:43:09.866992 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.866976    2549 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 17:43:09.870209 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.870175    2549 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 17:43:09.871856 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.871828    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 17:43:09.872356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872331    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 17:43:09.872484 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872466    2549 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 17:43:09.872550 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872486    2549 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 17:43:09.872618 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872603    2549 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 17:43:09.872714 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872696    2549 reconstruct.go:97] "Volume reconstruction finished"
May 27 17:43:09.872714 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.872712    2549 reconciler.go:26] "Reconciler: start to sync state"
May 27 17:43:09.874014 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.873991    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:09.874863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.874845    2549 factory.go:55] Registering systemd factory
May 27 17:43:09.874863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.874866    2549 factory.go:223] Registration of the systemd container factory successfully
May 27 17:43:09.875320 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.875303    2549 factory.go:153] Registering CRI-O factory
May 27 17:43:09.875406 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.875322    2549 factory.go:223] Registration of the crio container factory successfully
May 27 17:43:09.875485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.875404    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 17:43:09.875485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.875462    2549 factory.go:103] Registering Raw factory
May 27 17:43:09.875485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.875481    2549 manager.go:1196] Started watching for new ooms in manager
May 27 17:43:09.876267 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.876090    2549 manager.go:319] Starting recovery of all containers
May 27 17:43:09.878381 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.875231    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-90.ec2.internal.18b37d11092995b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-90.ec2.internal,UID:ip-10-0-135-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-90.ec2.internal,},FirstTimestamp:2026-05-27 17:43:09.863114165 +0000 UTC m=+0.454962134,LastTimestamp:2026-05-27 17:43:09.863114165 +0000 UTC m=+0.454962134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-90.ec2.internal,}"
May 27 17:43:09.881152 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.881125    2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 17:43:09.881701 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.881670    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 17:43:09.881701 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.881682    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 17:43:09.887705 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.887690    2549 manager.go:324] Recovery completed
May 27 17:43:09.891881 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.891869    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:09.893671 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.893651    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:09.893735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.893683    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:09.893735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.893694    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:09.894148 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.894137    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 17:43:09.894148 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.894147    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 17:43:09.894238 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.894161    2549 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:43:09.896295 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.896282    2549 policy_none.go:49] "None policy: Start"
May 27 17:43:09.896332 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.896300    2549 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 17:43:09.896743 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.896732    2549 state_mem.go:35] "Initializing new in-memory state store"
May 27 17:43:09.896826 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.896715    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-90.ec2.internal.18b37d110afbd9d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-90.ec2.internal,UID:ip-10-0-135-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-90.ec2.internal,},FirstTimestamp:2026-05-27 17:43:09.893671376 +0000 UTC m=+0.485519346,LastTimestamp:2026-05-27 17:43:09.893671376 +0000 UTC m=+0.485519346,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-90.ec2.internal,}"
May 27 17:43:09.900713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.900694    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mt5st"
May 27 17:43:09.910109 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.910038    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-90.ec2.internal.18b37d110afc1b10  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-90.ec2.internal,UID:ip-10-0-135-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-90.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-90.ec2.internal,},FirstTimestamp:2026-05-27 17:43:09.89368808 +0000 UTC m=+0.485536049,LastTimestamp:2026-05-27 17:43:09.89368808 +0000 UTC m=+0.485536049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-90.ec2.internal,}"
May 27 17:43:09.911872 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.911855    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mt5st"
May 27 17:43:09.933982 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.933966    2549 manager.go:341] "Starting Device Plugin manager"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.934000    2549 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934016    2549 server.go:85] "Starting device plugin registration server"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934258    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934267    2549 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934361    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934451    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.934460    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.934983    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 17:43:09.939250 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.935032    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:09.970215 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.970196    2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 17:43:09.970290 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.970219    2549 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 17:43:09.970290 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.970239    2549 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 17:43:09.970290 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.970245    2549 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 17:43:09.970290 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:09.970280    2549 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 17:43:09.972972 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:09.972950    2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:43:10.035329 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.035296    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:10.036361 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.036344    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:10.036463 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.036374    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:10.036463 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.036385    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:10.036463 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.036407    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-90.ec2.internal"
May 27 17:43:10.044590 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.044576    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-90.ec2.internal"
May 27 17:43:10.044639 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.044597    2549 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-90.ec2.internal\": node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.063471 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.063451    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.070931 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.070908    2549 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"]
May 27 17:43:10.070981 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.070977    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:10.072883 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.072860    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.072949 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.072900    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.072949 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.072907    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:10.072949 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.072928    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:10.072949 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.072942    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:10.074031 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.074019    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:10.074237 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.074223    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.074273 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.074253    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:10.075477 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075461    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:10.075565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075462    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:10.075565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075518    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:10.075565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075537    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:10.075565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075491    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:10.075755 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.075582    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:10.076757 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.076742    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.076837 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.076771    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:43:10.077515 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.077499    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:43:10.077599 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.077522    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:43:10.077599 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.077533    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID"
May 27 17:43:10.097036 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.097017    2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-90.ec2.internal\" not found" node="ip-10-0-135-90.ec2.internal"
May 27 17:43:10.101450 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.101433    2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-90.ec2.internal\" not found" node="ip-10-0-135-90.ec2.internal"
May 27 17:43:10.163567 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.163547    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.173730 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.173709    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.173795 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.173734    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.173795 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.173775    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.173864 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.173799    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bff9bcbdeecc32a8720bc208e209958a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"bff9bcbdeecc32a8720bc208e209958a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.264475 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.264443    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.274700 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.274683    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f42337b4f9dd6ac7307e2a872828488-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"5f42337b4f9dd6ac7307e2a872828488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.365124 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.365073    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.375398 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.375380    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f42337b4f9dd6ac7307e2a872828488-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"5f42337b4f9dd6ac7307e2a872828488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.375464 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.375442    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f42337b4f9dd6ac7307e2a872828488-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"5f42337b4f9dd6ac7307e2a872828488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.399527 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.399511    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.404243 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.404219    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.466015 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.465985    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.566484 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.566454    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.666964 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.666898    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.767412 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.767385    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.782813 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.782793    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 17:43:10.782930 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.782913    2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 17:43:10.868081 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:10.868060    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found"
May 27 17:43:10.872355 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.872335    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 17:43:10.875929 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.875901    2549 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:43:10.885924 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.885902    2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:43:10.908033 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.908011    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t8dgr"
May 27 17:43:10.914129 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.914105    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 17:38:09 +0000 UTC" deadline="2028-02-28 21:50:32.306869088 +0000 UTC"
May 27 17:43:10.914187 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.914130    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15412h7m21.392741904s"
May 27 17:43:10.920639 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.920600    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t8dgr"
May 27 17:43:10.955447 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:10.955395    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f42337b4f9dd6ac7307e2a872828488.slice/crio-e86fa9ae0cdaebba5aace46145f29c9a7334968d9141ca31d134b09b4b8fc13b WatchSource:0}: Error finding container e86fa9ae0cdaebba5aace46145f29c9a7334968d9141ca31d134b09b4b8fc13b: Status 404 returned error can't find the container with id e86fa9ae0cdaebba5aace46145f29c9a7334968d9141ca31d134b09b4b8fc13b
May 27 17:43:10.955701 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:10.955682    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff9bcbdeecc32a8720bc208e209958a.slice/crio-c2a94aba0962d297e6dcc2c03994199ef5e48461c4e826514869ac746d4b498f WatchSource:0}: Error finding container c2a94aba0962d297e6dcc2c03994199ef5e48461c4e826514869ac746d4b498f: Status 404 returned error can't find the container with id c2a94aba0962d297e6dcc2c03994199ef5e48461c4e826514869ac746d4b498f
May 27 17:43:10.958770 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.958753    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:43:10.972666 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.972644    2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"
May 27 17:43:10.973699 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.973666    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"bff9bcbdeecc32a8720bc208e209958a","Type":"ContainerStarted","Data":"c2a94aba0962d297e6dcc2c03994199ef5e48461c4e826514869ac746d4b498f"}
May 27 17:43:10.974656 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.974634    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" event={"ID":"5f42337b4f9dd6ac7307e2a872828488","Type":"ContainerStarted","Data":"e86fa9ae0cdaebba5aace46145f29c9a7334968d9141ca31d134b09b4b8fc13b"}
May 27 17:43:10.982534 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.982520    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:43:10.987256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:10.987245    2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal"
May 27 17:43:11.001659 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.001641    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:43:11.067385 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.067361    2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:43:11.328739 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.328709    2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:43:11.853058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.853026    2549 apiserver.go:52] "Watching apiserver"
May 27 17:43:11.860302 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.860278    2549 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 17:43:11.862266 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.862238    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nmtgf","kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8","openshift-image-registry/node-ca-cql8g","openshift-multus/multus-px84d","openshift-multus/network-metrics-daemon-fbfqq","openshift-network-diagnostics/network-check-target-4xlkj","openshift-network-operator/iptables-alerter-9mwkx","openshift-cluster-node-tuning-operator/tuned-lpwvn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-p686w","openshift-ovn-kubernetes/ovnkube-node-pkcfp"]
May 27 17:43:11.863714 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.863693    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.864998 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.864947    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.865904 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.865876    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 17:43:11.866072 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.866058    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mbffp\""
May 27 17:43:11.866219 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.866206    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 17:43:11.867013 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.866989    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vmfqr\""
May 27 17:43:11.867249 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.867229    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 17:43:11.868222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.867397    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 17:43:11.868222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.867482    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 17:43:11.868222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.867715    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.868222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.867796    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-px84d"
May 27 17:43:11.869377 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.869126    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:11.869377 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.869232    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871540    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871641    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871800    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x62h\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871849    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npwsw\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871981    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.871641    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.872165    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.872104    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.872360    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 17:43:11.872623 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.872453    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:11.873070 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.872910    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 17:43:11.874315 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.874291    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.875786 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.875511    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.876288 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.876271    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 17:43:11.876907 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.876662    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:11.876907 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.876886    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 17:43:11.877183 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.877164    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c9xsd\""
May 27 17:43:11.877476 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.877454    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:11.877553 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.877515    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5dxbp\""
May 27 17:43:11.878140 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.878093    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.878411 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.878396    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.879250 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.879232    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 17:43:11.880293 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.880273    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 17:43:11.880293 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.880289    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 17:43:11.880576 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.880513    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 17:43:11.880650 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.880620    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 17:43:11.880709 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.880626    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 17:43:11.881502 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.881207    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 17:43:11.881502 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.881302    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tmnzv\""
May 27 17:43:11.881502 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.881457    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wcshr\""
May 27 17:43:11.881717 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.881530    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 17:43:11.881717 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.881633    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 17:43:11.882985 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.882965    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cni-binary-copy\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883000    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-system-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883038    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883063    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b08ec9b-ac4a-4b41-987d-9de70347f303-host\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.883089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883085    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883107    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qkz\" (UniqueName: \"kubernetes.io/projected/f05c9b09-c8be-44fd-8b40-b7b389f73d53-kube-api-access-g5qkz\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883141    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf66v\" (UniqueName: \"kubernetes.io/projected/0c8fe199-56b8-412d-8605-bacecf7343a0-kube-api-access-lf66v\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883166    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e23ed83-ee15-4908-8715-ce0068b9544a-konnectivity-ca\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883190    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e23ed83-ee15-4908-8715-ce0068b9544a-agent-certs\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883220    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tj2f\" (UniqueName: \"kubernetes.io/projected/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-kube-api-access-5tj2f\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883244    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjptn\" (UniqueName: \"kubernetes.io/projected/1b08ec9b-ac4a-4b41-987d-9de70347f303-kube-api-access-kjptn\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.883297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883268    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-socket-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883292    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-sys-fs\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883328    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwd4q\" (UniqueName: \"kubernetes.io/projected/c8d38727-185b-4cc6-8a8b-de4858de54cf-kube-api-access-mwd4q\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883364    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-socket-dir-parent\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883401    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-multus-certs\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883445    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b08ec9b-ac4a-4b41-987d-9de70347f303-serviceca\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883486    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-bin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883527    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-hostroot\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883555    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883581    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-registration-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883609    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883632    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-os-release\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.883651 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883655    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-k8s-cni-cncf-io\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883688    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-multus\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883715    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-daemon-config\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883740    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-iptables-alerter-script\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883761    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cnibin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883784    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-etc-kubernetes\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883824    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883866    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-host-slash\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883895    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-device-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883926    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-netns\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883952    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-kubelet\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.884191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.883975    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-conf-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.921873 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.921810    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:10 +0000 UTC" deadline="2028-01-31 01:07:13.574148998 +0000 UTC"
May 27 17:43:11.921873 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.921844    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14719h24m1.652308305s"
May 27 17:43:11.973733 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.973676    2549 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 17:43:11.984190 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984155    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-etc-kubernetes\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984198    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-host\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984229    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-etc-kubernetes\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984229    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-ovn\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984267    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-netd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984293    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-env-overrides\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.984321 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984319    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-device-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984343    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-netns\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984368    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysconfig\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984396    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnnql\" (UniqueName: \"kubernetes.io/projected/6825fa48-77ad-4e13-bd05-989ea3286425-kube-api-access-bnnql\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984410    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-device-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984438    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-systemd-units\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984465    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-log-socket\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984477    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-netns\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984483    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-kubernetes\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984499    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-run\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984515    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-sys\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984530    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-system-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984546    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984569    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b08ec9b-ac4a-4b41-987d-9de70347f303-host\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984590    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qkz\" (UniqueName: \"kubernetes.io/projected/f05c9b09-c8be-44fd-8b40-b7b389f73d53-kube-api-access-g5qkz\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984603    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-system-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984614    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf66v\" (UniqueName: \"kubernetes.io/projected/0c8fe199-56b8-412d-8605-bacecf7343a0-kube-api-access-lf66v\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:11.984638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984631    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984641    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b08ec9b-ac4a-4b41-987d-9de70347f303-host\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984694    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984718    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpv74\" (UniqueName: \"kubernetes.io/projected/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-kube-api-access-xpv74\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984747    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjptn\" (UniqueName: \"kubernetes.io/projected/1b08ec9b-ac4a-4b41-987d-9de70347f303-kube-api-access-kjptn\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984772    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-socket-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984795    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-sys-fs\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984819    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-socket-dir-parent\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984844    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-multus-certs\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984869    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56x2s\" (UniqueName: \"kubernetes.io/projected/8ada6d76-2c25-4d26-aa05-87478a3b433c-kube-api-access-56x2s\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984894    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984912    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-socket-dir-parent\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984918    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-slash\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984939    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-socket-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984969    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b08ec9b-ac4a-4b41-987d-9de70347f303-serviceca\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984977    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-multus-certs\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.985399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.984994    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-bin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985018    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-hostroot\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985032    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-sys-fs\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985042    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-systemd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985067    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-registration-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985088    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-hostroot\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985091    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985116    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-bin\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985128    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-registration-dir\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985144    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-k8s-cni-cncf-io\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985167    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8d38727-185b-4cc6-8a8b-de4858de54cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985169    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-multus\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985070    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-bin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985204    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-daemon-config\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985221    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cnibin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985258    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-run-k8s-cni-cncf-io\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985292    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:11.986256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985298    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-cni-multus\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985331    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cnibin\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985375    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-host-slash\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985443    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-host-slash\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985448    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b08ec9b-ac4a-4b41-987d-9de70347f303-serviceca\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985456    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-system-cni-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985525    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-cnibin\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985553    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-binary-copy\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985579    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-kubelet\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985595    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-conf-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985644    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-host-var-lib-kubelet\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985674    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-modprobe-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985682    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-conf-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985710    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-tuned\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985740    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cni-binary-copy\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985752    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-daemon-config\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.986920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985763    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985787    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e23ed83-ee15-4908-8715-ce0068b9544a-konnectivity-ca\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985814    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e23ed83-ee15-4908-8715-ce0068b9544a-agent-certs\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985834    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-multus-cni-dir\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985838    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tj2f\" (UniqueName: \"kubernetes.io/projected/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-kube-api-access-5tj2f\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985867    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-lib-modules\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985890    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-kubelet\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985915    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.985951    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd4q\" (UniqueName: \"kubernetes.io/projected/c8d38727-185b-4cc6-8a8b-de4858de54cf-kube-api-access-mwd4q\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986000    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-systemd\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986028    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-tmp\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986051    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-var-lib-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-script-lib\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986102    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986138    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-conf\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986178    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-os-release\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986177    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f05c9b09-c8be-44fd-8b40-b7b389f73d53-cni-binary-copy\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.987611 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.986206    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986211    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-var-lib-kubelet\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986230    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-netns\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986248    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-etc-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986251    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f05c9b09-c8be-44fd-8b40-b7b389f73d53-os-release\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.986289    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:12.486244493 +0000 UTC m=+3.078092470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986319    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e23ed83-ee15-4908-8715-ce0068b9544a-konnectivity-ca\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986372    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-node-log\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986401    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986446    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986478    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-iptables-alerter-script\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986514    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-os-release\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986565    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-config\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986566    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 17:43:11.988345 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.986934    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-iptables-alerter-script\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:11.990472 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.990451    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e23ed83-ee15-4908-8715-ce0068b9544a-agent-certs\") pod \"konnectivity-agent-nmtgf\" (UID: \"8e23ed83-ee15-4908-8715-ce0068b9544a\") " pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:11.997781 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.997762    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:11.997781 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.997784    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:11.997928 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.997797    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:11.997928 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:11.997851    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:12.49783422 +0000 UTC m=+3.089682202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:11.997928 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.997907    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd4q\" (UniqueName: \"kubernetes.io/projected/c8d38727-185b-4cc6-8a8b-de4858de54cf-kube-api-access-mwd4q\") pod \"aws-ebs-csi-driver-node-kntm8\" (UID: \"c8d38727-185b-4cc6-8a8b-de4858de54cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:11.999390 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:11.999368    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjptn\" (UniqueName: \"kubernetes.io/projected/1b08ec9b-ac4a-4b41-987d-9de70347f303-kube-api-access-kjptn\") pod \"node-ca-cql8g\" (UID: \"1b08ec9b-ac4a-4b41-987d-9de70347f303\") " pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:12.000125 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.000105    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tj2f\" (UniqueName: \"kubernetes.io/projected/fa921021-3e4d-4ad8-acb7-a0de9ba3924e-kube-api-access-5tj2f\") pod \"iptables-alerter-9mwkx\" (UID: \"fa921021-3e4d-4ad8-acb7-a0de9ba3924e\") " pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:12.000613 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.000590    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf66v\" (UniqueName: \"kubernetes.io/projected/0c8fe199-56b8-412d-8605-bacecf7343a0-kube-api-access-lf66v\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:12.000722 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.000703    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qkz\" (UniqueName: \"kubernetes.io/projected/f05c9b09-c8be-44fd-8b40-b7b389f73d53-kube-api-access-g5qkz\") pod \"multus-px84d\" (UID: \"f05c9b09-c8be-44fd-8b40-b7b389f73d53\") " pod="openshift-multus/multus-px84d"
May 27 17:43:12.053821 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.053781    2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:43:12.087276 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087245    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-lib-modules\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087292    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-kubelet\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087318    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087351    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-systemd\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087372    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-tmp\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087391    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-var-lib-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087431    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-script-lib\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087456    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-lib-modules\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087469    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-conf\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087497    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-var-lib-kubelet\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087515    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-kubelet\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087534    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-netns\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087562    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-etc-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087563    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087585    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-node-log\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087609    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087629    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-netns\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087645    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087679    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-conf\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087686    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-os-release\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087691    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-var-lib-kubelet\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087713    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.087752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087737    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-config\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087764    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-host\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087767    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-var-lib-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087774    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-etc-openvswitch\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087562    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-systemd\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087806    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-ovn\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087818    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087834    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-netd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087854    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-node-log\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087860    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-env-overrides\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087889    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysconfig\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087931    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnnql\" (UniqueName: \"kubernetes.io/projected/6825fa48-77ad-4e13-bd05-989ea3286425-kube-api-access-bnnql\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087959    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-systemd-units\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.087985    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-log-socket\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088012    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-kubernetes\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088038    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-run\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088056    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-os-release\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.088488 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088062    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-sys\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088104    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088114    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-sys\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088132    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088157    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-host\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088199    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-netd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088389    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-script-lib\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088440    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-log-socket\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088493    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-systemd-units\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088405    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088532    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088587    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-run\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088593    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088635    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-kubernetes\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088644    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-ovn\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088158    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpv74\" (UniqueName: \"kubernetes.io/projected/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-kube-api-access-xpv74\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088687    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56x2s\" (UniqueName: \"kubernetes.io/projected/8ada6d76-2c25-4d26-aa05-87478a3b433c-kube-api-access-56x2s\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088704    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysconfig\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088713    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088738    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-slash\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088766    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-systemd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088794    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-bin\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088836    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-system-cni-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088841    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088866    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-cnibin\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088887    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-run-systemd\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088892    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-binary-copy\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088919    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088927    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-system-cni-dir\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088930    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-slash\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088943    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-modprobe-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088966    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-tuned\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088969    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-host-cni-bin\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.088971    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6825fa48-77ad-4e13-bd05-989ea3286425-cnibin\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.089993 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.089099    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-sysctl-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.089103    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-modprobe-d\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.089583    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6825fa48-77ad-4e13-bd05-989ea3286425-cni-binary-copy\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.089597    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-env-overrides\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.089604    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovnkube-config\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.090778    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-tmp\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.090849 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.090824    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.091481 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.091461    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ada6d76-2c25-4d26-aa05-87478a3b433c-etc-tuned\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.104474 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.104407    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnnql\" (UniqueName: \"kubernetes.io/projected/6825fa48-77ad-4e13-bd05-989ea3286425-kube-api-access-bnnql\") pod \"multus-additional-cni-plugins-p686w\" (UID: \"6825fa48-77ad-4e13-bd05-989ea3286425\") " pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.105016 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.104999    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpv74\" (UniqueName: \"kubernetes.io/projected/aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c-kube-api-access-xpv74\") pod \"ovnkube-node-pkcfp\" (UID: \"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.107867 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.107842    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56x2s\" (UniqueName: \"kubernetes.io/projected/8ada6d76-2c25-4d26-aa05-87478a3b433c-kube-api-access-56x2s\") pod \"tuned-lpwvn\" (UID: \"8ada6d76-2c25-4d26-aa05-87478a3b433c\") " pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.177913 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.177878    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:12.185702 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.185680    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8"
May 27 17:43:12.194147 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.194127    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cql8g"
May 27 17:43:12.199757 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.199739    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-px84d"
May 27 17:43:12.207337 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.207319    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mwkx"
May 27 17:43:12.213927 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.213906    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lpwvn"
May 27 17:43:12.220001 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.219982    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:12.226512 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.226491    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p686w"
May 27 17:43:12.491884 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.491807    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:12.492027 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.491911    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:12.492027 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.491970    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:13.491952622 +0000 UTC m=+4.083800581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:12.592670 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.592640    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:12.592890 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.592868    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:12.592971 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.592896    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:12.592971 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.592910    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:12.593065 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:12.592975    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:13.592956497 +0000 UTC m=+4.184804455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:12.723199 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.723150    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6825fa48_77ad_4e13_bd05_989ea3286425.slice/crio-a770d633b9ed8d38a3b1f56def54b79e80814e1eb6279961245cc2d5b244b9a6 WatchSource:0}: Error finding container a770d633b9ed8d38a3b1f56def54b79e80814e1eb6279961245cc2d5b244b9a6: Status 404 returned error can't find the container with id a770d633b9ed8d38a3b1f56def54b79e80814e1eb6279961245cc2d5b244b9a6
May 27 17:43:12.724536 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.724481    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05c9b09_c8be_44fd_8b40_b7b389f73d53.slice/crio-275529c18384236e803a25447793244e8042b662a3b04a9f4786e4647d68e24a WatchSource:0}: Error finding container 275529c18384236e803a25447793244e8042b662a3b04a9f4786e4647d68e24a: Status 404 returned error can't find the container with id 275529c18384236e803a25447793244e8042b662a3b04a9f4786e4647d68e24a
May 27 17:43:12.725269 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.725232    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5c5c83_c41d_4e60_99e6_9a7ed0a2651c.slice/crio-a091fcefca9a1ae75e389f6f97d1635d6c5392330deeedc6f949947a4563a0ec WatchSource:0}: Error finding container a091fcefca9a1ae75e389f6f97d1635d6c5392330deeedc6f949947a4563a0ec: Status 404 returned error can't find the container with id a091fcefca9a1ae75e389f6f97d1635d6c5392330deeedc6f949947a4563a0ec
May 27 17:43:12.726734 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.726710    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ada6d76_2c25_4d26_aa05_87478a3b433c.slice/crio-744492283e569099123d3ca9a7d963bdb283eb56986b939960bd80cb17eead5e WatchSource:0}: Error finding container 744492283e569099123d3ca9a7d963bdb283eb56986b939960bd80cb17eead5e: Status 404 returned error can't find the container with id 744492283e569099123d3ca9a7d963bdb283eb56986b939960bd80cb17eead5e
May 27 17:43:12.728979 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.728954    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b08ec9b_ac4a_4b41_987d_9de70347f303.slice/crio-43647c65e8462a9981943b324523400b3d011988f3ef530843745e9db7f678ed WatchSource:0}: Error finding container 43647c65e8462a9981943b324523400b3d011988f3ef530843745e9db7f678ed: Status 404 returned error can't find the container with id 43647c65e8462a9981943b324523400b3d011988f3ef530843745e9db7f678ed
May 27 17:43:12.729813 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.729795    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d38727_185b_4cc6_8a8b_de4858de54cf.slice/crio-c5b0220f7f5f38bc434b43976278ccaebb46f42ef0fcf126fb5a8113d7c97237 WatchSource:0}: Error finding container c5b0220f7f5f38bc434b43976278ccaebb46f42ef0fcf126fb5a8113d7c97237: Status 404 returned error can't find the container with id c5b0220f7f5f38bc434b43976278ccaebb46f42ef0fcf126fb5a8113d7c97237
May 27 17:43:12.734874 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:12.734216    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e23ed83_ee15_4908_8715_ce0068b9544a.slice/crio-4db7835e6c417f11524acda94eddc3371e9da1611027d45a8a6d8592cdb94a2d WatchSource:0}: Error finding container 4db7835e6c417f11524acda94eddc3371e9da1611027d45a8a6d8592cdb94a2d: Status 404 returned error can't find the container with id 4db7835e6c417f11524acda94eddc3371e9da1611027d45a8a6d8592cdb94a2d
May 27 17:43:12.922257 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.922098    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:10 +0000 UTC" deadline="2028-02-04 05:13:42.71160608 +0000 UTC"
May 27 17:43:12.922257 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.922250    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14819h30m29.789358759s"
May 27 17:43:12.978478 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.978449    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8" event={"ID":"c8d38727-185b-4cc6-8a8b-de4858de54cf","Type":"ContainerStarted","Data":"c5b0220f7f5f38bc434b43976278ccaebb46f42ef0fcf126fb5a8113d7c97237"}
May 27 17:43:12.979403 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.979381    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cql8g" event={"ID":"1b08ec9b-ac4a-4b41-987d-9de70347f303","Type":"ContainerStarted","Data":"43647c65e8462a9981943b324523400b3d011988f3ef530843745e9db7f678ed"}
May 27 17:43:12.980399 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.980375    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lpwvn" event={"ID":"8ada6d76-2c25-4d26-aa05-87478a3b433c","Type":"ContainerStarted","Data":"744492283e569099123d3ca9a7d963bdb283eb56986b939960bd80cb17eead5e"}
May 27 17:43:12.981380 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.981351    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-px84d" event={"ID":"f05c9b09-c8be-44fd-8b40-b7b389f73d53","Type":"ContainerStarted","Data":"275529c18384236e803a25447793244e8042b662a3b04a9f4786e4647d68e24a"}
May 27 17:43:12.982703 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.982683    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" event={"ID":"5f42337b4f9dd6ac7307e2a872828488","Type":"ContainerStarted","Data":"a4ae84babbd6872fbac7567f046b9af83900a5b65e57be17b618f0d642883690"}
May 27 17:43:12.983580 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.983561    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"a091fcefca9a1ae75e389f6f97d1635d6c5392330deeedc6f949947a4563a0ec"}
May 27 17:43:12.984334 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.984315    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerStarted","Data":"a770d633b9ed8d38a3b1f56def54b79e80814e1eb6279961245cc2d5b244b9a6"}
May 27 17:43:12.985065 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.985048    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmtgf" event={"ID":"8e23ed83-ee15-4908-8715-ce0068b9544a","Type":"ContainerStarted","Data":"4db7835e6c417f11524acda94eddc3371e9da1611027d45a8a6d8592cdb94a2d"}
May 27 17:43:12.986781 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.986096    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mwkx" event={"ID":"fa921021-3e4d-4ad8-acb7-a0de9ba3924e","Type":"ContainerStarted","Data":"699893a360103bfc12993486e12d67145d8a457a10053ebfd37841fd46f14546"}
May 27 17:43:12.995756 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:12.995714    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" podStartSLOduration=2.9957014539999998 podStartE2EDuration="2.995701454s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:12.995612518 +0000 UTC m=+3.587460508" watchObservedRunningTime="2026-05-27 17:43:12.995701454 +0000 UTC m=+3.587549434"
May 27 17:43:13.501942 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:13.501832    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:13.502101 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.501974    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:13.502101 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.502041    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:15.502021371 +0000 UTC m=+6.093869330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:13.602497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:13.602461    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:13.602668 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.602620    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:13.602668 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.602639    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:13.602668 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.602651    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:13.602825 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.602711    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:15.602690703 +0000 UTC m=+6.194538664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:13.971938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:13.971170    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:13.971938 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.971305    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:13.971938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:13.971787    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:13.971938 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:13.971889    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:14.011864 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:14.011830    2549 generic.go:358] "Generic (PLEG): container finished" podID="bff9bcbdeecc32a8720bc208e209958a" containerID="52ca3e22d08f1af71290862f9f0075c3bc6cc957e4ac2da426e213783006b9d5" exitCode=0
May 27 17:43:14.012686 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:14.012661    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"bff9bcbdeecc32a8720bc208e209958a","Type":"ContainerDied","Data":"52ca3e22d08f1af71290862f9f0075c3bc6cc957e4ac2da426e213783006b9d5"}
May 27 17:43:15.023700 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:15.023662    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"bff9bcbdeecc32a8720bc208e209958a","Type":"ContainerStarted","Data":"ba33744cf8cdcf290c8e3135bc62a689409dac51d6707fdcb8214678568589f3"}
May 27 17:43:15.519372 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:15.519339    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:15.519540 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.519515    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:15.519604 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.519592    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:19.519570374 +0000 UTC m=+10.111418331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:15.619975 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:15.619938    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:15.620163 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.620147    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:15.620231 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.620173    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:15.620231 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.620186    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:15.620352 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.620239    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:19.620221964 +0000 UTC m=+10.212069919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:15.972147 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:15.971556    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:15.972147 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.971689    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:15.972147 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:15.971984    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:15.972147 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:15.972063    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:17.971294 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:17.971258    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:17.971782 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:17.971304    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:17.971782 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:17.971438    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:17.971782 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:17.971516    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:18.404703 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.404524    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" podStartSLOduration=8.404503267 podStartE2EDuration="8.404503267s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:15.038102533 +0000 UTC m=+5.629950511" watchObservedRunningTime="2026-05-27 17:43:18.404503267 +0000 UTC m=+8.996351246"
May 27 17:43:18.404985 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.404937    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k5c6d"]
May 27 17:43:18.417663 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.417635    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.417977 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:18.417803    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:18.545895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.545861    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-dbus\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.546074 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.546008    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-kubelet-config\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.546074 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.546059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.647255 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.647216    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.647446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.647282    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-dbus\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.647446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.647352    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-kubelet-config\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.647577 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.647466    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-kubelet-config\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:18.647577 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:18.647562    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:18.647652 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:18.647611    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:19.147595834 +0000 UTC m=+9.739443804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:18.647705 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:18.647658    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19d0e065-7aa7-489d-9a16-06da64ec6832-dbus\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:19.152182 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.152152    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:19.152703 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.152320    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:19.152703 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.152396    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:20.152375599 +0000 UTC m=+10.744223560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:19.556159 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.556121    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:19.556353 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.556288    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:19.556441 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.556365    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:27.556343168 +0000 UTC m=+18.148191138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:19.657281 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.657162    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:19.657456 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.657322    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:19.657456 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.657343    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:19.657456 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.657355    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:19.657456 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.657429    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:27.657397632 +0000 UTC m=+18.249245588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:19.974127 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.973501    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:19.974127 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.973602    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:19.974127 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.973951    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:19.974127 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.974036    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:19.974674 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:19.973406    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:19.974784 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:19.974761    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:20.163327 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:20.162774    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:20.163327 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:20.162924    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:20.163327 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:20.162985    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:22.162967463 +0000 UTC m=+12.754815437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:21.970684 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:21.970652    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:21.971193 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:21.970652    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:21.971193 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:21.970787    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:21.971193 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:21.970652    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:21.971193 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:21.970867    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:21.971193 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:21.970940    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:22.179381 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:22.179343    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:22.179570 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:22.179518    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:22.179643 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:22.179585    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:26.179570046 +0000 UTC m=+16.771418003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:23.971030 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:23.970996    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:23.971473 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:23.971105    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:23.971473 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:23.970996    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:23.971473 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:23.970996    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:23.971473 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:23.971206    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:23.971473 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:23.971304    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:25.971122 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:25.971086    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:25.971575 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:25.971100    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:25.971575 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:25.971233    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:25.971575 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:25.971105    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:25.971575 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:25.971292    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:25.971575 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:25.971383    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:26.209600 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:26.209571    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:26.209762 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:26.209723    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:26.209821 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:26.209798    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:34.209776515 +0000 UTC m=+24.801624488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:27.622050 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:27.622018    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:27.622548 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.622160    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:27.622548 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.622235    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:43.622214147 +0000 UTC m=+34.214062104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:27.722727 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:27.722682    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:27.722884 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.722818    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:27.722884 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.722834    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:27.722884 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.722843    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:27.723031 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.722897    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:43.72288117 +0000 UTC m=+34.314729146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:27.971259 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:27.971156    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:27.971259 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:27.971172    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:27.971499 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:27.971156    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:27.971499 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.971295    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:27.971499 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.971369    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:27.971499 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:27.971482    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:29.971526 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:29.971493    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:29.971957 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:29.971599    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:29.971957 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:29.971655    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:29.971957 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:29.971714    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:29.971957 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:29.971743    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:29.971957 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:29.971827    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:31.048987 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.048890    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:43:31.049497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.049260    2549 generic.go:358] "Generic (PLEG): container finished" podID="aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c" containerID="cefe9fcc50312a36276c7dede3b97de13d3b4f85df95d8469f20be216e506c32" exitCode=1
May 27 17:43:31.049497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.049328    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"04fb199cb78f010f484ed74fe3df5e027727355ef3c94582ce9e0de4d65e37f3"}
May 27 17:43:31.049497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.049363    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"b81c4b366066e30c378644da757973a06e87060941ada5482a277fe2ce173aca"}
May 27 17:43:31.049497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.049377    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerDied","Data":"cefe9fcc50312a36276c7dede3b97de13d3b4f85df95d8469f20be216e506c32"}
May 27 17:43:31.049497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.049392    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"5da72b5f72c62d25b1fa58066942abac7a79a4a0936c522dd6ad0fe581f29981"}
May 27 17:43:31.050760 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.050738    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="74691b7385a6f202f21c80b08a7f7c7ffee066ad553f07b05c10e1dc5ab984cd" exitCode=0
May 27 17:43:31.050851 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.050819    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"74691b7385a6f202f21c80b08a7f7c7ffee066ad553f07b05c10e1dc5ab984cd"}
May 27 17:43:31.052265 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.052215    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmtgf" event={"ID":"8e23ed83-ee15-4908-8715-ce0068b9544a","Type":"ContainerStarted","Data":"982da646b5d811e1052dc98c01d08d8b2af1f651deff7a6c6cfe3e26cec7be4b"}
May 27 17:43:31.053723 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.053571    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8" event={"ID":"c8d38727-185b-4cc6-8a8b-de4858de54cf","Type":"ContainerStarted","Data":"aebdda33bc97700883c41f4f9ffbaec5ea61ebef7e2956b593f8b4dd647e8d97"}
May 27 17:43:31.054939 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.054919    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cql8g" event={"ID":"1b08ec9b-ac4a-4b41-987d-9de70347f303","Type":"ContainerStarted","Data":"1ae8fc88ceb2fc8af8ada7674c5448fd9ae87ef9c443f4bc3e14a6049b24edfd"}
May 27 17:43:31.056191 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.056169    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lpwvn" event={"ID":"8ada6d76-2c25-4d26-aa05-87478a3b433c","Type":"ContainerStarted","Data":"b65511053d15c973d94aa9a867a817457872da8cd744142d4cbdcb20e0bd5697"}
May 27 17:43:31.057687 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.057628    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-px84d" event={"ID":"f05c9b09-c8be-44fd-8b40-b7b389f73d53","Type":"ContainerStarted","Data":"773468f11a7e677c2fd451776f5150887750a72d6b5bcd9c05987cc3cf643b4c"}
May 27 17:43:31.085123 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.085084    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-px84d" podStartSLOduration=3.329884199 podStartE2EDuration="21.085069799s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.726093115 +0000 UTC m=+3.317941071" lastFinishedPulling="2026-05-27 17:43:30.481278698 +0000 UTC m=+21.073126671" observedRunningTime="2026-05-27 17:43:31.085023195 +0000 UTC m=+21.676871172" watchObservedRunningTime="2026-05-27 17:43:31.085069799 +0000 UTC m=+21.676917780"
May 27 17:43:31.099711 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.099677    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lpwvn" podStartSLOduration=3.3502160610000002 podStartE2EDuration="21.099665416s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.728784329 +0000 UTC m=+3.320632291" lastFinishedPulling="2026-05-27 17:43:30.478233689 +0000 UTC m=+21.070081646" observedRunningTime="2026-05-27 17:43:31.099306379 +0000 UTC m=+21.691154372" watchObservedRunningTime="2026-05-27 17:43:31.099665416 +0000 UTC m=+21.691513394"
May 27 17:43:31.112544 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.112514    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nmtgf" podStartSLOduration=3.372005128 podStartE2EDuration="21.112502155s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.735984197 +0000 UTC m=+3.327832168" lastFinishedPulling="2026-05-27 17:43:30.476481231 +0000 UTC m=+21.068329195" observedRunningTime="2026-05-27 17:43:31.112327432 +0000 UTC m=+21.704175409" watchObservedRunningTime="2026-05-27 17:43:31.112502155 +0000 UTC m=+21.704350134"
May 27 17:43:31.122979 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.122946    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cql8g" podStartSLOduration=8.12342359 podStartE2EDuration="21.122936859s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.734621851 +0000 UTC m=+3.326469812" lastFinishedPulling="2026-05-27 17:43:25.73413511 +0000 UTC m=+16.325983081" observedRunningTime="2026-05-27 17:43:31.122570479 +0000 UTC m=+21.714418458" watchObservedRunningTime="2026-05-27 17:43:31.122936859 +0000 UTC m=+21.714784837"
May 27 17:43:31.970598 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.970519    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:31.970598 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.970551    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:31.970813 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:31.970635    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:31.970813 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:31.970646    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:31.970813 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:31.970756    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:31.970952 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:31.970840    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:32.061143 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.061096    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mwkx" event={"ID":"fa921021-3e4d-4ad8-acb7-a0de9ba3924e","Type":"ContainerStarted","Data":"c1cfcb43da721c63f5e55a74c436a4341747cd78b24b18f6ee70493302ebeb02"}
May 27 17:43:32.066899 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.066877    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:43:32.067336 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.067296    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"eb335e8376f8f171e4682d3b86485304f068069c554b12d3b100f47b8e5143b1"}
May 27 17:43:32.067336 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.067341    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"0f201a0a08489aaed4095f62c02083483cd74138092415af42d04ab90c24fbe8"}
May 27 17:43:32.102578 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.102535    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9mwkx" podStartSLOduration=4.413402824 podStartE2EDuration="22.102522074s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.734631312 +0000 UTC m=+3.326479282" lastFinishedPulling="2026-05-27 17:43:30.423750575 +0000 UTC m=+21.015598532" observedRunningTime="2026-05-27 17:43:32.102327837 +0000 UTC m=+22.694175821" watchObservedRunningTime="2026-05-27 17:43:32.102522074 +0000 UTC m=+22.694370052"
May 27 17:43:32.285924 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.285897    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 17:43:32.857769 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.857736    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:32.858388 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.858370    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:32.944768 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.944636    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:43:32.285918834Z","UUID":"fe2c45fd-cd91-4f69-9d4f-aa5000d856e0","Handler":null,"Name":"","Endpoint":""}
May 27 17:43:32.946717 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.946691    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 17:43:32.946717 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:32.946722    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 17:43:33.070972 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.070938    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8" event={"ID":"c8d38727-185b-4cc6-8a8b-de4858de54cf","Type":"ContainerStarted","Data":"c5f461951e6f95a30729ef2b88a0bace3f758684302f69eb10778937868bb0b7"}
May 27 17:43:33.071588 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.071435    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:33.071854 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.071839    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nmtgf"
May 27 17:43:33.970717 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.970639    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:33.970878 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.970651    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:33.970878 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:33.970729    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:33.970878 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:33.970651    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:33.970878 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:33.970816    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:33.971057 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:33.970910    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:34.074152 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:34.073957    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8" event={"ID":"c8d38727-185b-4cc6-8a8b-de4858de54cf","Type":"ContainerStarted","Data":"f230f637ebebe2386ee4d459f222ce1706f224bda117edfb8ebdefbbdfdef417"}
May 27 17:43:34.076514 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:34.076489    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:43:34.076817 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:34.076800    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"ed756e56e01324a136a219d795f5b5bf3373b45783ed76da1aae427c0628b52c"}
May 27 17:43:34.093900 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:34.093856    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kntm8" podStartSLOduration=3.236855975 podStartE2EDuration="24.093842723s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.734756977 +0000 UTC m=+3.326604948" lastFinishedPulling="2026-05-27 17:43:33.591743508 +0000 UTC m=+24.183591696" observedRunningTime="2026-05-27 17:43:34.092634835 +0000 UTC m=+24.684482812" watchObservedRunningTime="2026-05-27 17:43:34.093842723 +0000 UTC m=+24.685690702"
May 27 17:43:34.273776 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:34.273730    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:34.274091 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:34.273887    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:43:34.274091 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:34.273991    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret podName:19d0e065-7aa7-489d-9a16-06da64ec6832 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:50.273968863 +0000 UTC m=+40.865816822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret") pod "global-pull-secret-syncer-k5c6d" (UID: "19d0e065-7aa7-489d-9a16-06da64ec6832") : object "kube-system"/"original-pull-secret" not registered
May 27 17:43:35.971058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:35.971027    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:35.971431 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:35.971063    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:35.971431 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:35.971027    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:35.971431 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:35.971139    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:35.971431 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:35.971192    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:35.971431 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:35.971277    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:36.087915 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.086595    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:43:36.087915 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.087818    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"0f44fa86d347454757387d211946e310ba99b8bb0a2753b4e454ede09c09c402"}
May 27 17:43:36.088937 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.088211    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:36.088937 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.088240    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:36.088937 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.088377    2549 scope.go:117] "RemoveContainer" containerID="cefe9fcc50312a36276c7dede3b97de13d3b4f85df95d8469f20be216e506c32"
May 27 17:43:36.110053 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.109944    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:36.110551 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:36.110535    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:37.092023 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.091996    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:43:37.092751 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.092290    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" event={"ID":"aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c","Type":"ContainerStarted","Data":"17dc14ea2f87e07b1b7e8a9ee5268915d6d83439da8f84a50a2c14fca055e437"}
May 27 17:43:37.092751 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.092478    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 17:43:37.093842 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.093818    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="9004729b1da68dbf68d4936d8edc8e1a6cc48e88d28d4f5858e63a4f288eaae5" exitCode=0
May 27 17:43:37.093948 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.093872    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"9004729b1da68dbf68d4936d8edc8e1a6cc48e88d28d4f5858e63a4f288eaae5"}
May 27 17:43:37.126325 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.126284    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp" podStartSLOduration=9.331922486 podStartE2EDuration="27.126272565s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.727715515 +0000 UTC m=+3.319563474" lastFinishedPulling="2026-05-27 17:43:30.522065583 +0000 UTC m=+21.113913553" observedRunningTime="2026-05-27 17:43:37.125249349 +0000 UTC m=+27.717097340" watchObservedRunningTime="2026-05-27 17:43:37.126272565 +0000 UTC m=+27.718120543"
May 27 17:43:37.971025 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.970997    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:37.971176 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.970997    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:37.971176 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:37.971111    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:37.971297 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:37.971197    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:37.971297 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:37.970997    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:37.971379 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:37.971308    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:38.097293 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.097259    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="fa9e6d33775a6596222905e6cb838cb7d2de4f262a7ab5ceb98015bcb3e0f22c" exitCode=0
May 27 17:43:38.097760 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.097338    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"fa9e6d33775a6596222905e6cb838cb7d2de4f262a7ab5ceb98015bcb3e0f22c"}
May 27 17:43:38.097760 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.097444    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 17:43:38.175749 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.175717    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbfqq"]
May 27 17:43:38.175877 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.175817    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:38.175972 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:38.175935    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:38.176374 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.176353    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5c6d"]
May 27 17:43:38.176460 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.176442    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:38.176531 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:38.176514    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:38.191699 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.191668    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xlkj"]
May 27 17:43:38.191778 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.191749    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:38.191850 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:38.191831    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:38.750569 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:38.750543    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:43:39.101275 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:39.101241    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="e048466b6b58e9bd88937a24804a346eb5923121943ac164459949045dd239a5" exitCode=0
May 27 17:43:39.101708 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:39.101325    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"e048466b6b58e9bd88937a24804a346eb5923121943ac164459949045dd239a5"}
May 27 17:43:39.971675 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:39.971645    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:39.971843 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:39.971755    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:39.971843 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:39.971802    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:39.971975 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:39.971948    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:39.972073 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:39.972029    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:39.972210 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:39.972186    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:41.970485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:41.970450    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:41.970485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:41.970486    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:41.970942 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:41.970451    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:41.970942 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:41.970580    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xlkj" podUID="5dd25fb1-d4db-4e69-afa3-005cef443e60"
May 27 17:43:41.970942 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:41.970679    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfqq" podUID="0c8fe199-56b8-412d-8605-bacecf7343a0"
May 27 17:43:41.970942 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:41.970774    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c6d" podUID="19d0e065-7aa7-489d-9a16-06da64ec6832"
May 27 17:43:43.210003 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.209834    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeReady"
May 27 17:43:43.210459 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.210123    2549 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 17:43:43.248901 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.248872    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:43:43.253036 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.253009    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.253512 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.253491    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-794b58b6fb-4x6dp"]
May 27 17:43:43.255434 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.255397    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 17:43:43.255695 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.255653    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 17:43:43.256008 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.255989    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp774\""
May 27 17:43:43.256368 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.256349    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.257439 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.256667    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tslgf"]
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259312    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"]
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259389    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259457    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259472    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259394    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259641    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-67g4d\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259725    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 27 17:43:43.260058 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.259783    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.260370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.260136    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 17:43:43.261087 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.260850    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 17:43:43.262889 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.262867    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"]
May 27 17:43:43.263072 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.263052    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.264916 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.264691    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 27 17:43:43.265715 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.265411    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 17:43:43.266580 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.266083    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 27 17:43:43.267684 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.267268    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 17:43:43.267684 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.267300    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l5hqg\""
May 27 17:43:43.268485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.268464    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 17:43:43.269914 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.269879    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 17:43:43.270047 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.270024    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8h57\""
May 27 17:43:43.270305 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.270284    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"]
May 27 17:43:43.270454 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.270435    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 27 17:43:43.270565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.270549    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 27 17:43:43.270798 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.270776    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.273308 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.273257    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"]
May 27 17:43:43.274341 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.274319    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:43.274652 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.274627    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 17:43:43.274754 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.274710    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 27 17:43:43.274962 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.274933    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 27 17:43:43.275201 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.275182    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 27 17:43:43.276013 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.275993    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-l4676"]
May 27 17:43:43.276114 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.276095    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.279062 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.279042    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j8r9n\""
May 27 17:43:43.279167 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.279148    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.279228 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.279048    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"]
May 27 17:43:43.279276 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.279262    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.280302 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.280271    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:43.280517 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.280499    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 27 17:43:43.282352 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.282332    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"]
May 27 17:43:43.282464 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.282401    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 27 17:43:43.282716 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.282683    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:43.282943 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.282908    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 27 17:43:43.283045 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283035    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 27 17:43:43.283140 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.282706    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6wx46\""
May 27 17:43:43.283140 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283135    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 27 17:43:43.283235 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283204    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z86dx\""
May 27 17:43:43.283311 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283295    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:43.283846 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283696    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 27 17:43:43.283846 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.283784    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 27 17:43:43.284248 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.284226    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v75xx\""
May 27 17:43:43.287953 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.287936    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 27 17:43:43.290577 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.290554    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"]
May 27 17:43:43.292804 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.292059    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.294213 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.294196    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 27 17:43:43.296003 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.295983    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 27 17:43:43.296335 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.296316    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bx9wv\""
May 27 17:43:43.296451 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.296383    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 17:43:43.296451 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.296388    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 17:43:43.296561 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.296323    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 17:43:43.298056 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.298037    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 17:43:43.301254 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.301218    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"]
May 27 17:43:43.301885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.301867    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.305362 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.305344    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 27 17:43:43.306069 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.306052    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:43:43.306208 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.306196    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"]
May 27 17:43:43.306319 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.306308    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-794b58b6fb-4x6dp"]
May 27 17:43:43.306452 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.306441    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"]
May 27 17:43:43.306563 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.306553    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pz6k6"]
May 27 17:43:43.307070 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.307049    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.309542 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.309525    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 27 17:43:43.309657 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.309639    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 27 17:43:43.309810 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.309676    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 27 17:43:43.310003 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.309979    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 27 17:43:43.310595 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310566    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tslgf"]
May 27 17:43:43.310595 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310593    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310606    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-l4676"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310619    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310633    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310644    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310657    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310672    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz6k6"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310683    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"]
May 27 17:43:43.310734 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310693    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.311099 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.310771    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"
May 27 17:43:43.312852 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.312838    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 17:43:43.313048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313028    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 17:43:43.313259 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313240    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 27 17:43:43.313351 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313305    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 27 17:43:43.313351 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313252    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prtm9\""
May 27 17:43:43.313593 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313309    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tr7nj\""
May 27 17:43:43.313593 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.313269    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 17:43:43.366222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.366203    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zspcl"]
May 27 17:43:43.369327 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.369309    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.372298 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.372277    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 17:43:43.372572 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.372555    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv9xv\""
May 27 17:43:43.372572 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.372564    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 17:43:43.372755 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.372742    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 17:43:43.372923 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.372865    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 17:43:43.380913 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.380895    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zspcl"]
May 27 17:43:43.446644 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446609    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.446644 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446654    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5ksw\" (UniqueName: \"kubernetes.io/projected/7fc90da2-4813-4fcd-a33c-9ea72580b95f-kube-api-access-f5ksw\") pod \"volume-data-source-validator-5cf8c89d64-77fgf\" (UID: \"7fc90da2-4813-4fcd-a33c-9ea72580b95f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446687    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446714    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d993e5f-3828-446c-9d2b-a695684e2f13-config\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446744    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-default-certificate\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446772    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446819    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446857    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgs7d\" (UniqueName: \"kubernetes.io/projected/190ab032-7ef0-4a87-9650-1e9b19f43d07-kube-api-access-pgs7d\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.446895 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446892    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446918    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-serving-cert\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.446942    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-snapshots\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447014    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447046    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/746e29df-fb9f-414c-80a6-7df129a77159-klusterlet-config\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447073    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447103    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447138    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhjh\" (UniqueName: \"kubernetes.io/projected/1d993e5f-3828-446c-9d2b-a695684e2f13-kube-api-access-cmhjh\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447207    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwwfs\" (UniqueName: \"kubernetes.io/projected/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-kube-api-access-nwwfs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.447236 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447227    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-config\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447244    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52552f61-8016-4cfa-aa8b-f9316be383d9-serving-cert\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447264    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brzj\" (UniqueName: \"kubernetes.io/projected/746e29df-fb9f-414c-80a6-7df129a77159-kube-api-access-6brzj\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447287    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09c99d85-4c12-4338-b879-c2b1711f31ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447321    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-trusted-ca\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447337    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447356    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746e29df-fb9f-414c-80a6-7df129a77159-tmp\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447377    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b383fc96-f413-4d9d-88e5-157c7380da31-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447391    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslrd\" (UniqueName: \"kubernetes.io/projected/b383fc96-f413-4d9d-88e5-157c7380da31-kube-api-access-zslrd\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447406    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447444    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447474    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-stats-auth\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447494    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfdn\" (UniqueName: \"kubernetes.io/projected/52552f61-8016-4cfa-aa8b-f9316be383d9-kube-api-access-qwfdn\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.447568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svn9p\" (UniqueName: \"kubernetes.io/projected/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-kube-api-access-svn9p\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447578    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447602    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-tmp\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447626    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447655    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79h9\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447681    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6zq\" (UniqueName: \"kubernetes.io/projected/3ae7490f-da66-4c0b-8291-ff3b074fbf03-kube-api-access-7r6zq\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx8rx\" (UniqueName: \"kubernetes.io/projected/09c99d85-4c12-4338-b879-c2b1711f31ac-kube-api-access-mx8rx\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447725    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09c99d85-4c12-4338-b879-c2b1711f31ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447758    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d993e5f-3828-446c-9d2b-a695684e2f13-serving-cert\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447814    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbdq\" (UniqueName: \"kubernetes.io/projected/4c1cbc9c-4038-4654-849e-a30eb7a7e322-kube-api-access-5rbdq\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447863    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447887    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.447933    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggvhv\" (UniqueName: \"kubernetes.io/projected/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-kube-api-access-ggvhv\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.448163 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.448007    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.448784 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.448045    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.448784 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.448071    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c1cbc9c-4038-4654-849e-a30eb7a7e322-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.448784 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.448096    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.549204 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549121    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.549204 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549158    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/746e29df-fb9f-414c-80a6-7df129a77159-klusterlet-config\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.549204 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549188    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549212    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549229    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhjh\" (UniqueName: \"kubernetes.io/projected/1d993e5f-3828-446c-9d2b-a695684e2f13-kube-api-access-cmhjh\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549257    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wfjh\" (UniqueName: \"kubernetes.io/projected/0fc91952-c036-4b5e-b349-93456b3abdf8-kube-api-access-2wfjh\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549288    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwwfs\" (UniqueName: \"kubernetes.io/projected/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-kube-api-access-nwwfs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549317    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-config\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549341    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52552f61-8016-4cfa-aa8b-f9316be383d9-serving-cert\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549366    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6brzj\" (UniqueName: \"kubernetes.io/projected/746e29df-fb9f-414c-80a6-7df129a77159-kube-api-access-6brzj\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549396    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09c99d85-4c12-4338-b879-c2b1711f31ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549450    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc91952-c036-4b5e-b349-93456b3abdf8-tmp-dir\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549479    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-trusted-ca\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.549496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549496    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549513    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746e29df-fb9f-414c-80a6-7df129a77159-tmp\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549547    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b383fc96-f413-4d9d-88e5-157c7380da31-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549563    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zslrd\" (UniqueName: \"kubernetes.io/projected/b383fc96-f413-4d9d-88e5-157c7380da31-kube-api-access-zslrd\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549580    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549609    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549626    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-stats-auth\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549645    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfdn\" (UniqueName: \"kubernetes.io/projected/52552f61-8016-4cfa-aa8b-f9316be383d9-kube-api-access-qwfdn\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549661    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svn9p\" (UniqueName: \"kubernetes.io/projected/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-kube-api-access-svn9p\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549698    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549714    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-tmp\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549733    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549756    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r79h9\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549774    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6zq\" (UniqueName: \"kubernetes.io/projected/3ae7490f-da66-4c0b-8291-ff3b074fbf03-kube-api-access-7r6zq\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549792    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx8rx\" (UniqueName: \"kubernetes.io/projected/09c99d85-4c12-4338-b879-c2b1711f31ac-kube-api-access-mx8rx\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.550021 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549816    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09c99d85-4c12-4338-b879-c2b1711f31ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549838    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d993e5f-3828-446c-9d2b-a695684e2f13-serving-cert\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549863    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbdq\" (UniqueName: \"kubernetes.io/projected/4c1cbc9c-4038-4654-849e-a30eb7a7e322-kube-api-access-5rbdq\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549887    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549919    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549949    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.549978    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggvhv\" (UniqueName: \"kubernetes.io/projected/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-kube-api-access-ggvhv\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550002    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550041    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550067    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c1cbc9c-4038-4654-849e-a30eb7a7e322-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.549365    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550102    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550107    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-config\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550128    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc91952-c036-4b5e-b349-93456b3abdf8-config-volume\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.550168    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.050149488 +0000 UTC m=+34.641997471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:43.550731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550109    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550336    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550372    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5ksw\" (UniqueName: \"kubernetes.io/projected/7fc90da2-4813-4fcd-a33c-9ea72580b95f-kube-api-access-f5ksw\") pod \"volume-data-source-validator-5cf8c89d64-77fgf\" (UID: \"7fc90da2-4813-4fcd-a33c-9ea72580b95f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550407    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550443    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-trusted-ca\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550455    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d993e5f-3828-446c-9d2b-a695684e2f13-config\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.550488    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550501    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-default-certificate\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550529    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.550552    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.05053458 +0000 UTC m=+34.642382543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550587    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550622    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgs7d\" (UniqueName: \"kubernetes.io/projected/190ab032-7ef0-4a87-9650-1e9b19f43d07-kube-api-access-pgs7d\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550651    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550654    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b383fc96-f413-4d9d-88e5-157c7380da31-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550694    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550735    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-serving-cert\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.551461 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550764    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-snapshots\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550822    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09c99d85-4c12-4338-b879-c2b1711f31ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.550950    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d993e5f-3828-446c-9d2b-a695684e2f13-config\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.551330    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-snapshots\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.551699    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.550594    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.551041    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.551259    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.05124437 +0000 UTC m=+34.643092351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.552148    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.05213184 +0000 UTC m=+34.643979811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:43.552226 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.552164    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.052154557 +0000 UTC m=+34.644002521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:43.555130 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555102    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.555279 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555142    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746e29df-fb9f-414c-80a6-7df129a77159-tmp\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.555374 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555354    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52552f61-8016-4cfa-aa8b-f9316be383d9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.555448 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555360    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555572    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d993e5f-3828-446c-9d2b-a695684e2f13-serving-cert\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555698    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/746e29df-fb9f-414c-80a6-7df129a77159-klusterlet-config\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.555726    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.555810    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.555826    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.555896    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.055853326 +0000 UTC m=+34.647701286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:43.556183 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.556146    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52552f61-8016-4cfa-aa8b-f9316be383d9-tmp\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.556634 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.556217    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-stats-auth\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.556634 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.556487    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.557404 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.556892    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09c99d85-4c12-4338-b879-c2b1711f31ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.557404 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.557251    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52552f61-8016-4cfa-aa8b-f9316be383d9-serving-cert\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.557404 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.557369    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-default-certificate\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.560446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.559800    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-serving-cert\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.560446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.560129    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c1cbc9c-4038-4654-849e-a30eb7a7e322-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.560446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.560187    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.560634 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.560614    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.561105 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.560724    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.561105 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.561083    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx8rx\" (UniqueName: \"kubernetes.io/projected/09c99d85-4c12-4338-b879-c2b1711f31ac-kube-api-access-mx8rx\") pod \"kube-storage-version-migrator-operator-565644f49-sg8pr\" (UID: \"09c99d85-4c12-4338-b879-c2b1711f31ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.561105 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.561099    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-hub\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.561673 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.561449    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b383fc96-f413-4d9d-88e5-157c7380da31-ca\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.562351 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.562308    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6zq\" (UniqueName: \"kubernetes.io/projected/3ae7490f-da66-4c0b-8291-ff3b074fbf03-kube-api-access-7r6zq\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:43.562498 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.562474    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhjh\" (UniqueName: \"kubernetes.io/projected/1d993e5f-3828-446c-9d2b-a695684e2f13-kube-api-access-cmhjh\") pod \"service-ca-operator-57b5b68b8-r4pd6\" (UID: \"1d993e5f-3828-446c-9d2b-a695684e2f13\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.562628 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.562484    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brzj\" (UniqueName: \"kubernetes.io/projected/746e29df-fb9f-414c-80a6-7df129a77159-kube-api-access-6brzj\") pod \"klusterlet-addon-workmgr-696655d75c-f8p88\" (UID: \"746e29df-fb9f-414c-80a6-7df129a77159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.563792 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.563744    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwwfs\" (UniqueName: \"kubernetes.io/projected/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-kube-api-access-nwwfs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:43.563919 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.563901    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgs7d\" (UniqueName: \"kubernetes.io/projected/190ab032-7ef0-4a87-9650-1e9b19f43d07-kube-api-access-pgs7d\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:43.564083 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.564059    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5ksw\" (UniqueName: \"kubernetes.io/projected/7fc90da2-4813-4fcd-a33c-9ea72580b95f-kube-api-access-f5ksw\") pod \"volume-data-source-validator-5cf8c89d64-77fgf\" (UID: \"7fc90da2-4813-4fcd-a33c-9ea72580b95f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"
May 27 17:43:43.564356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.564337    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbdq\" (UniqueName: \"kubernetes.io/projected/4c1cbc9c-4038-4654-849e-a30eb7a7e322-kube-api-access-5rbdq\") pod \"managed-serviceaccount-addon-agent-6cdd89696-cwmvh\" (UID: \"4c1cbc9c-4038-4654-849e-a30eb7a7e322\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.564499 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.564359    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.567568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.567541    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79h9\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:43.568711 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.568639    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svn9p\" (UniqueName: \"kubernetes.io/projected/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-kube-api-access-svn9p\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:43.569150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.569107    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfdn\" (UniqueName: \"kubernetes.io/projected/52552f61-8016-4cfa-aa8b-f9316be383d9-kube-api-access-qwfdn\") pod \"insights-operator-78bdfb888c-tslgf\" (UID: \"52552f61-8016-4cfa-aa8b-f9316be383d9\") " pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.569275 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.569241    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggvhv\" (UniqueName: \"kubernetes.io/projected/f19c34b7-b593-44a5-b2bc-52cf747b7cb4-kube-api-access-ggvhv\") pod \"console-operator-76dff48d59-l4676\" (UID: \"f19c34b7-b593-44a5-b2bc-52cf747b7cb4\") " pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.571641 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.571620    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslrd\" (UniqueName: \"kubernetes.io/projected/b383fc96-f413-4d9d-88e5-157c7380da31-kube-api-access-zslrd\") pod \"cluster-proxy-proxy-agent-5c8488bbfb-zg7rf\" (UID: \"b383fc96-f413-4d9d-88e5-157c7380da31\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.589042 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.589023    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-tslgf"
May 27 17:43:43.618175 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.618144    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"
May 27 17:43:43.624808 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.624787    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:43.632312 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.632293    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"
May 27 17:43:43.645886 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.645869    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"
May 27 17:43:43.652120 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652102    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wfjh\" (UniqueName: \"kubernetes.io/projected/0fc91952-c036-4b5e-b349-93456b3abdf8-kube-api-access-2wfjh\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.652211 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652141    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc91952-c036-4b5e-b349-93456b3abdf8-tmp-dir\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.652211 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652172    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:43.652315 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652279    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc91952-c036-4b5e-b349-93456b3abdf8-config-volume\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.652367 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652342    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.652489 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.652474    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:43.652559 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652485    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc91952-c036-4b5e-b349-93456b3abdf8-tmp-dir\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.652559 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.652553    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:44.152534271 +0000 UTC m=+34.744382230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:43:43.652667 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.652578    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:43.652667 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.652637    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.652621082 +0000 UTC m=+66.244469057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:43:43.652931 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.652909    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc91952-c036-4b5e-b349-93456b3abdf8-config-volume\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.654037 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.654015    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:43:43.661745 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.661704    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:43:43.664320 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.664301    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wfjh\" (UniqueName: \"kubernetes.io/projected/0fc91952-c036-4b5e-b349-93456b3abdf8-kube-api-access-2wfjh\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:43.685378 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.685351    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"
May 27 17:43:43.701242 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.701218    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5g4bm"]
May 27 17:43:43.706074 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.706058    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.708351 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.708328    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nw96n\""
May 27 17:43:43.752808 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.752786    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xrv\" (UniqueName: \"kubernetes.io/projected/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-kube-api-access-69xrv\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.752916 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.752828    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-hosts-file\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.752992 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.752943    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:43.753048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.753017    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-tmp-dir\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.753124 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.753109    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:43:43.753192 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.753127    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:43:43.753192 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.753136    2549 projected.go:194] Error preparing data for projected volume kube-api-access-zvvp2 for pod openshift-network-diagnostics/network-check-target-4xlkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:43.753192 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:43.753176    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2 podName:5dd25fb1-d4db-4e69-afa3-005cef443e60 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.753165122 +0000 UTC m=+66.345013078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvvp2" (UniqueName: "kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2") pod "network-check-target-4xlkj" (UID: "5dd25fb1-d4db-4e69-afa3-005cef443e60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:43:43.853834 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.853747    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69xrv\" (UniqueName: \"kubernetes.io/projected/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-kube-api-access-69xrv\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.853834 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.853799    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-hosts-file\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.854049 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.853939    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-tmp-dir\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.854049 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.853957    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-hosts-file\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.854294 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.854275    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-tmp-dir\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.862750 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.862724    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xrv\" (UniqueName: \"kubernetes.io/projected/41d5488e-d6a7-4dfc-87bc-8e2d2eb70965-kube-api-access-69xrv\") pod \"node-resolver-5g4bm\" (UID: \"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965\") " pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:43.971071 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.971036    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:43.971248 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.971036    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:43:43.971472 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.971036    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:43:43.973773 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.973751    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:43:43.974035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.973977    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 17:43:43.974035 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.973988    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\""
May 27 17:43:43.974203 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.974038    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frs9q\""
May 27 17:43:43.974203 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.973992    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 17:43:43.974331 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:43.974314    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 17:43:44.016374 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.016350    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5g4bm"
May 27 17:43:44.056485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056455    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:44.056621 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056536    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:44.056621 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056603    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:44.056725 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056674    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:44.056725 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056682    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.056665028 +0000 UTC m=+35.648512984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:44.056839 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056729    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.056715518 +0000 UTC m=+35.648563490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:44.056839 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056781    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:44.056839 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056792    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:44.056839 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.056822    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.05681337 +0000 UTC m=+35.648661354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:44.056839 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056601    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056850    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056875    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.056940    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.057026    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.057035    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.057016934 +0000 UTC m=+35.648864905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.057061    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.057049867 +0000 UTC m=+35.648897846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:44.057082 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.057078    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:44.057334 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.057144    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.057130519 +0000 UTC m=+35.648978492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:44.157769 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.157684    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:44.157938 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.157876    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:44.158005 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:44.157961    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:45.157944741 +0000 UTC m=+35.749792699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:43:44.178089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.178059    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"]
May 27 17:43:44.182007 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.181986    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"
May 27 17:43:44.184267 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.184239    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bjv88\""
May 27 17:43:44.192298 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.192275    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"]
May 27 17:43:44.258429 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.258378    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmcl\" (UniqueName: \"kubernetes.io/projected/c448058f-5694-426a-9fe3-e0767a923366-kube-api-access-8kmcl\") pod \"network-check-source-7f44b6dd87-hswjp\" (UID: \"c448058f-5694-426a-9fe3-e0767a923366\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"
May 27 17:43:44.359885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.359693    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmcl\" (UniqueName: \"kubernetes.io/projected/c448058f-5694-426a-9fe3-e0767a923366-kube-api-access-8kmcl\") pod \"network-check-source-7f44b6dd87-hswjp\" (UID: \"c448058f-5694-426a-9fe3-e0767a923366\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"
May 27 17:43:44.368732 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.368702    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmcl\" (UniqueName: \"kubernetes.io/projected/c448058f-5694-426a-9fe3-e0767a923366-kube-api-access-8kmcl\") pod \"network-check-source-7f44b6dd87-hswjp\" (UID: \"c448058f-5694-426a-9fe3-e0767a923366\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"
May 27 17:43:44.491941 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:44.491862    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"
May 27 17:43:45.067819 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.067772    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:45.067960 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.067831    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:45.067960 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.067872    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:45.067960 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.067908    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:45.067960 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.067939    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.067977    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.06795699 +0000 UTC m=+37.659804949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.067997    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.067987515 +0000 UTC m=+37.659835477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068036    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068061    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.068074    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068105    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068113    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.068096789 +0000 UTC m=+37.659944762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:45.068154 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068132    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.068120126 +0000 UTC m=+37.659968082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:45.068389 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.068168    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:45.068389 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068181    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.068169515 +0000 UTC m=+37.660017482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:45.068389 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068208    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:45.068389 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068216    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:45.068389 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.068253    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.068245912 +0000 UTC m=+37.660093868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:45.169031 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.169007    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:45.169171 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.169144    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:45.169213 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:45.169189    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:47.169176829 +0000 UTC m=+37.761024786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:43:45.526713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.526410    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tslgf"]
May 27 17:43:45.535060 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.535014    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52552f61_8016_4cfa_aa8b_f9316be383d9.slice/crio-8ca13fab77982f218f7762457b6c6636c118eaa9cdaab66537c1d499200fe6b6 WatchSource:0}: Error finding container 8ca13fab77982f218f7762457b6c6636c118eaa9cdaab66537c1d499200fe6b6: Status 404 returned error can't find the container with id 8ca13fab77982f218f7762457b6c6636c118eaa9cdaab66537c1d499200fe6b6
May 27 17:43:45.550804 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.548466    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"]
May 27 17:43:45.550804 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.550713    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6"]
May 27 17:43:45.551027 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.551003    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746e29df_fb9f_414c_80a6_7df129a77159.slice/crio-838be992d01575a88165847b96ca80389e4538d0db52015c2da7bb6a109743b3 WatchSource:0}: Error finding container 838be992d01575a88165847b96ca80389e4538d0db52015c2da7bb6a109743b3: Status 404 returned error can't find the container with id 838be992d01575a88165847b96ca80389e4538d0db52015c2da7bb6a109743b3
May 27 17:43:45.552202 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.552033    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"]
May 27 17:43:45.553605 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.553022    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-l4676"]
May 27 17:43:45.554104 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.554080    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb383fc96_f413_4d9d_88e5_157c7380da31.slice/crio-64794a9c71b0031555ef65acb9df548d99c278ac7772e861faac0bf614633f00 WatchSource:0}: Error finding container 64794a9c71b0031555ef65acb9df548d99c278ac7772e861faac0bf614633f00: Status 404 returned error can't find the container with id 64794a9c71b0031555ef65acb9df548d99c278ac7772e861faac0bf614633f00
May 27 17:43:45.554755 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.554734    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d993e5f_3828_446c_9d2b_a695684e2f13.slice/crio-15d5f411779da8335895b8c4f280f32d1be2d3d77e3bc9c2b7a155f4844757be WatchSource:0}: Error finding container 15d5f411779da8335895b8c4f280f32d1be2d3d77e3bc9c2b7a155f4844757be: Status 404 returned error can't find the container with id 15d5f411779da8335895b8c4f280f32d1be2d3d77e3bc9c2b7a155f4844757be
May 27 17:43:45.555838 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.555811    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19c34b7_b593_44a5_b2bc_52cf747b7cb4.slice/crio-441cc55ca970ccf6628a384002681c127c3101067bc412a121f851d2cc9f34b8 WatchSource:0}: Error finding container 441cc55ca970ccf6628a384002681c127c3101067bc412a121f851d2cc9f34b8: Status 404 returned error can't find the container with id 441cc55ca970ccf6628a384002681c127c3101067bc412a121f851d2cc9f34b8
May 27 17:43:45.559986 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.559965    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf"]
May 27 17:43:45.563391 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.563369    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc90da2_4813_4fcd_a33c_9ea72580b95f.slice/crio-a741455b848ef811e781803634dcdea0ff5d0671748b862ca3626e5387f9c9d9 WatchSource:0}: Error finding container a741455b848ef811e781803634dcdea0ff5d0671748b862ca3626e5387f9c9d9: Status 404 returned error can't find the container with id a741455b848ef811e781803634dcdea0ff5d0671748b862ca3626e5387f9c9d9
May 27 17:43:45.566850 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.566691    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh"]
May 27 17:43:45.570079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.569974    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp"]
May 27 17:43:45.571174 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:45.571154    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr"]
May 27 17:43:45.573213 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.572367    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c1cbc9c_4038_4654_849e_a30eb7a7e322.slice/crio-80a6b85f3f9a070de01bd2ed2ee5e0dddb161fa327a90591510516febafc6ae5 WatchSource:0}: Error finding container 80a6b85f3f9a070de01bd2ed2ee5e0dddb161fa327a90591510516febafc6ae5: Status 404 returned error can't find the container with id 80a6b85f3f9a070de01bd2ed2ee5e0dddb161fa327a90591510516febafc6ae5
May 27 17:43:45.573474 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.573270    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c99d85_4c12_4338_b879_c2b1711f31ac.slice/crio-f516af9971d5b18874b2e1a6563f74fe07ba0b5dbab4bf77672823b530d786c2 WatchSource:0}: Error finding container f516af9971d5b18874b2e1a6563f74fe07ba0b5dbab4bf77672823b530d786c2: Status 404 returned error can't find the container with id f516af9971d5b18874b2e1a6563f74fe07ba0b5dbab4bf77672823b530d786c2
May 27 17:43:45.574212 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:45.574194    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc448058f_5694_426a_9fe3_e0767a923366.slice/crio-b5e6706969a1058d628810c6f2a2ac735bb2706c7676da3b1a08307f9a4a75f0 WatchSource:0}: Error finding container b5e6706969a1058d628810c6f2a2ac735bb2706c7676da3b1a08307f9a4a75f0: Status 404 returned error can't find the container with id b5e6706969a1058d628810c6f2a2ac735bb2706c7676da3b1a08307f9a4a75f0
May 27 17:43:46.117080 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.116971    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh" event={"ID":"4c1cbc9c-4038-4654-849e-a30eb7a7e322","Type":"ContainerStarted","Data":"80a6b85f3f9a070de01bd2ed2ee5e0dddb161fa327a90591510516febafc6ae5"}
May 27 17:43:46.118480 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.118451    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf" event={"ID":"7fc90da2-4813-4fcd-a33c-9ea72580b95f","Type":"ContainerStarted","Data":"a741455b848ef811e781803634dcdea0ff5d0671748b862ca3626e5387f9c9d9"}
May 27 17:43:46.120070 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.120046    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerStarted","Data":"64794a9c71b0031555ef65acb9df548d99c278ac7772e861faac0bf614633f00"}
May 27 17:43:46.121296 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.121273    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerStarted","Data":"441cc55ca970ccf6628a384002681c127c3101067bc412a121f851d2cc9f34b8"}
May 27 17:43:46.123626 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.123542    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5g4bm" event={"ID":"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965","Type":"ContainerStarted","Data":"8b608fd751714ebd369871cec013f11832552b898372fd86dc50d26145f7065f"}
May 27 17:43:46.123626 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.123587    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5g4bm" event={"ID":"41d5488e-d6a7-4dfc-87bc-8e2d2eb70965","Type":"ContainerStarted","Data":"0dabf638bca4458a9240f9040a627ceee16c02243a5301ae4ae35af7a3bde709"}
May 27 17:43:46.125714 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.125679    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tslgf" event={"ID":"52552f61-8016-4cfa-aa8b-f9316be383d9","Type":"ContainerStarted","Data":"8ca13fab77982f218f7762457b6c6636c118eaa9cdaab66537c1d499200fe6b6"}
May 27 17:43:46.129893 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.129238    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="65c66bb83c40c65f901a32221a9bb556ac503dcf3faf570d0c09ac7d38af924b" exitCode=0
May 27 17:43:46.129893 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.129332    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"65c66bb83c40c65f901a32221a9bb556ac503dcf3faf570d0c09ac7d38af924b"}
May 27 17:43:46.130791 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.130770    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr" event={"ID":"09c99d85-4c12-4338-b879-c2b1711f31ac","Type":"ContainerStarted","Data":"f516af9971d5b18874b2e1a6563f74fe07ba0b5dbab4bf77672823b530d786c2"}
May 27 17:43:46.133519 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.133462    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6" event={"ID":"1d993e5f-3828-446c-9d2b-a695684e2f13","Type":"ContainerStarted","Data":"15d5f411779da8335895b8c4f280f32d1be2d3d77e3bc9c2b7a155f4844757be"}
May 27 17:43:46.135182 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.135101    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88" event={"ID":"746e29df-fb9f-414c-80a6-7df129a77159","Type":"ContainerStarted","Data":"838be992d01575a88165847b96ca80389e4538d0db52015c2da7bb6a109743b3"}
May 27 17:43:46.136255 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.136213    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp" event={"ID":"c448058f-5694-426a-9fe3-e0767a923366","Type":"ContainerStarted","Data":"b5e6706969a1058d628810c6f2a2ac735bb2706c7676da3b1a08307f9a4a75f0"}
May 27 17:43:46.148066 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:46.148017    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5g4bm" podStartSLOduration=3.147981605 podStartE2EDuration="3.147981605s" podCreationTimestamp="2026-05-27 17:43:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:46.147227224 +0000 UTC m=+36.739075236" watchObservedRunningTime="2026-05-27 17:43:46.147981605 +0000 UTC m=+36.739829584"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091154    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091493    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091549    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091622    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091655    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.091686    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.091848    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.091915    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.091896118 +0000 UTC m=+41.683744081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092310    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092356    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.092341598 +0000 UTC m=+41.684189560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092408    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092456    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.092445289 +0000 UTC m=+41.684293248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092513    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092523    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092553    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.09254332 +0000 UTC m=+41.684391277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:47.092735 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092604    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:47.093948 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092637    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.092626166 +0000 UTC m=+41.684474126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:47.093948 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.092693    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.092684541 +0000 UTC m=+41.684532499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:47.163510 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.163335    2549 generic.go:358] "Generic (PLEG): container finished" podID="6825fa48-77ad-4e13-bd05-989ea3286425" containerID="59a97503b3fe688d83247d3fdf533fabc7aec32714789f5ac4297dd496dcae32" exitCode=0
May 27 17:43:47.163510 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.163402    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerDied","Data":"59a97503b3fe688d83247d3fdf533fabc7aec32714789f5ac4297dd496dcae32"}
May 27 17:43:47.194272 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:47.192918    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:47.194272 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.193594    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:47.194272 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:47.193647    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:51.193629608 +0000 UTC m=+41.785477571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:43:48.180393 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:48.180351    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p686w" event={"ID":"6825fa48-77ad-4e13-bd05-989ea3286425","Type":"ContainerStarted","Data":"b2effe93207687c2782f511ba0e0232226e95bb59d2377b270865673f2bf840e"}
May 27 17:43:48.211453 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:48.210516    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p686w" podStartSLOduration=5.389452215 podStartE2EDuration="38.210498844s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:43:12.725312595 +0000 UTC m=+3.317160551" lastFinishedPulling="2026-05-27 17:43:45.546359204 +0000 UTC m=+36.138207180" observedRunningTime="2026-05-27 17:43:48.209976109 +0000 UTC m=+38.801824088" watchObservedRunningTime="2026-05-27 17:43:48.210498844 +0000 UTC m=+38.802346822"
May 27 17:43:50.325603 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:50.325564    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:50.329936 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:50.329908    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19d0e065-7aa7-489d-9a16-06da64ec6832-original-pull-secret\") pod \"global-pull-secret-syncer-k5c6d\" (UID: \"19d0e065-7aa7-489d-9a16-06da64ec6832\") " pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:50.582681 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:50.582610    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c6d"
May 27 17:43:51.133525 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133483    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133564    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133598    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133617    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133628    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133634    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:51.133694 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133681    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133700    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133742    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133768    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133748116 +0000 UTC m=+49.725596077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133795    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133782381 +0000 UTC m=+49.725630346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.133743    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133812    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133840    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133829696 +0000 UTC m=+49.725677661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133857    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133848696 +0000 UTC m=+49.725696652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133872    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133863885 +0000 UTC m=+49.725711848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133892    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:51.134001 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.133924    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.133914894 +0000 UTC m=+49.725762859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:51.234452 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:51.234403    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:51.234662 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.234518    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:51.234662 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:51.234577    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:59.234561766 +0000 UTC m=+49.826409721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:43:59.062474 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.062446    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5c6d"]
May 27 17:43:59.068359 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:43:59.068333    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d0e065_7aa7_489d_9a16_06da64ec6832.slice/crio-531deb19ce306e15c09787b715617591179319b5c0f55905e537c8bcc190bdb8 WatchSource:0}: Error finding container 531deb19ce306e15c09787b715617591179319b5c0f55905e537c8bcc190bdb8: Status 404 returned error can't find the container with id 531deb19ce306e15c09787b715617591179319b5c0f55905e537c8bcc190bdb8
May 27 17:43:59.204775 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.204666    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf" event={"ID":"7fc90da2-4813-4fcd-a33c-9ea72580b95f","Type":"ContainerStarted","Data":"50988e737289ff2ba435ed182c4cb13838926cc8a618d7c08c0f1a1eee59f465"}
May 27 17:43:59.210435 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.209929    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5c6d" event={"ID":"19d0e065-7aa7-489d-9a16-06da64ec6832","Type":"ContainerStarted","Data":"531deb19ce306e15c09787b715617591179319b5c0f55905e537c8bcc190bdb8"}
May 27 17:43:59.214512 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.211941    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerStarted","Data":"f8189742e9405f2f0d0de3262c7aadb60879a6a526c951ad79de7b867e63f07c"}
May 27 17:43:59.215938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.215757    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:43:59.215938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.215813    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:43:59.215938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.215890    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:43:59.215938 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.215928    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:59.216192 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.215964    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:43:59.216192 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.216028    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:43:59.216301 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216216    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:43:59.216301 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216282    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert podName:190ab032-7ef0-4a87-9650-1e9b19f43d07 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216262982 +0000 UTC m=+65.808110950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert") pod "ingress-canary-pz6k6" (UID: "190ab032-7ef0-4a87-9650-1e9b19f43d07") : secret "canary-serving-cert" not found
May 27 17:43:59.216434 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216355    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 17:43:59.216434 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216395    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls podName:3ae7490f-da66-4c0b-8291-ff3b074fbf03 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216381736 +0000 UTC m=+65.808229698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls") pod "cluster-samples-operator-697587599-hh5x4" (UID: "3ae7490f-da66-4c0b-8291-ff3b074fbf03") : secret "samples-operator-tls" not found
May 27 17:43:59.216547 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216500    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:43:59.216547 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216518    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8f8585c59-lc5cv: secret "image-registry-tls" not found
May 27 17:43:59.216647 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216557    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls podName:c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216545573 +0000 UTC m=+65.808393531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls") pod "image-registry-8f8585c59-lc5cv" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3") : secret "image-registry-tls" not found
May 27 17:43:59.216763 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216715    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:43:59.216814 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216773    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216761529 +0000 UTC m=+65.808609491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:43:59.216875 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216831    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216806828 +0000 UTC m=+65.808654792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : configmap references non-existent config key: service-ca.crt
May 27 17:43:59.216937 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216876    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:43:59.216937 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.216930    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs podName:6bc0a4cb-272a-4208-a6ac-0cba4abf1f56 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.216913129 +0000 UTC m=+65.808761091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs") pod "router-default-794b58b6fb-4x6dp" (UID: "6bc0a4cb-272a-4208-a6ac-0cba4abf1f56") : secret "router-metrics-certs-default" not found
May 27 17:43:59.218577 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.218533    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tslgf" event={"ID":"52552f61-8016-4cfa-aa8b-f9316be383d9","Type":"ContainerStarted","Data":"37285e0482cc9c771e4eb95332dc935b22a8435364e1979ade43ae930969d3f5"}
May 27 17:43:59.220355 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.220247    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr" event={"ID":"09c99d85-4c12-4338-b879-c2b1711f31ac","Type":"ContainerStarted","Data":"d59ca249bd0134093f95d9886c5dbd1674933ad081a644ca082c80b786769415"}
May 27 17:43:59.226760 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.226742    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:43:59.232900 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.232567    2549 patch_prober.go:28] interesting pod/console-operator-76dff48d59-l4676 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body=
May 27 17:43:59.232900 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.232630    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused"
May 27 17:43:59.248982 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.248934    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-tslgf" podStartSLOduration=23.814751488 podStartE2EDuration="36.248916018s" podCreationTimestamp="2026-05-27 17:43:23 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.53824143 +0000 UTC m=+36.130089396" lastFinishedPulling="2026-05-27 17:43:57.97240597 +0000 UTC m=+48.564253926" observedRunningTime="2026-05-27 17:43:59.247804492 +0000 UTC m=+49.839652483" watchObservedRunningTime="2026-05-27 17:43:59.248916018 +0000 UTC m=+49.840763998"
May 27 17:43:59.292565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.291664    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-77fgf" podStartSLOduration=15.004417491 podStartE2EDuration="26.291647181s" podCreationTimestamp="2026-05-27 17:43:33 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.564923337 +0000 UTC m=+36.156771293" lastFinishedPulling="2026-05-27 17:43:56.852153023 +0000 UTC m=+47.444000983" observedRunningTime="2026-05-27 17:43:59.290655386 +0000 UTC m=+49.882503388" watchObservedRunningTime="2026-05-27 17:43:59.291647181 +0000 UTC m=+49.883495162"
May 27 17:43:59.292565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.292031    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podStartSLOduration=12.914077923 podStartE2EDuration="26.292021093s" podCreationTimestamp="2026-05-27 17:43:33 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.557780892 +0000 UTC m=+36.149628849" lastFinishedPulling="2026-05-27 17:43:58.935724057 +0000 UTC m=+49.527572019" observedRunningTime="2026-05-27 17:43:59.268511101 +0000 UTC m=+49.860359080" watchObservedRunningTime="2026-05-27 17:43:59.292021093 +0000 UTC m=+49.883869073"
May 27 17:43:59.309781 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.308696    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr" podStartSLOduration=13.912025847 podStartE2EDuration="26.308681809s" podCreationTimestamp="2026-05-27 17:43:33 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.575748775 +0000 UTC m=+36.167596744" lastFinishedPulling="2026-05-27 17:43:57.97240473 +0000 UTC m=+48.564252706" observedRunningTime="2026-05-27 17:43:59.307328249 +0000 UTC m=+49.899176228" watchObservedRunningTime="2026-05-27 17:43:59.308681809 +0000 UTC m=+49.900529788"
May 27 17:43:59.319462 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:43:59.316589    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:43:59.319462 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.318512    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:43:59.319462 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:43:59.318561    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls podName:0fc91952-c036-4b5e-b349-93456b3abdf8 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:15.318545086 +0000 UTC m=+65.910393049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls") pod "dns-default-zspcl" (UID: "0fc91952-c036-4b5e-b349-93456b3abdf8") : secret "dns-default-metrics-tls" not found
May 27 17:44:00.224586 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.224530    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh" event={"ID":"4c1cbc9c-4038-4654-849e-a30eb7a7e322","Type":"ContainerStarted","Data":"a0e41ffcf8474face2ccce4ced14e0fad425f452b1fd4ba4c8646edd677a8835"}
May 27 17:44:00.227288 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.227236    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerStarted","Data":"31ded22a4cdcfc9319b781b723af6f089a1d8a9730625dd0bc8ab109a1e80d7b"}
May 27 17:44:00.230359 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.229674    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/0.log"
May 27 17:44:00.230359 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.229710    2549 generic.go:358] "Generic (PLEG): container finished" podID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4" containerID="f8189742e9405f2f0d0de3262c7aadb60879a6a526c951ad79de7b867e63f07c" exitCode=255
May 27 17:44:00.230359 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.229802    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerDied","Data":"f8189742e9405f2f0d0de3262c7aadb60879a6a526c951ad79de7b867e63f07c"}
May 27 17:44:00.230359 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.230096    2549 scope.go:117] "RemoveContainer" containerID="f8189742e9405f2f0d0de3262c7aadb60879a6a526c951ad79de7b867e63f07c"
May 27 17:44:00.233787 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.233755    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6" event={"ID":"1d993e5f-3828-446c-9d2b-a695684e2f13","Type":"ContainerStarted","Data":"60a4728e9704879bd690b612308f316fc0eb6a14a5a46ed70fcfa2ab80477920"}
May 27 17:44:00.237476 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.235568    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88" event={"ID":"746e29df-fb9f-414c-80a6-7df129a77159","Type":"ContainerStarted","Data":"f88e8be050d088e3bacc7364669a9b8bb37b9c9c4d6a99c999c6ce61aac11fe6"}
May 27 17:44:00.237476 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.236034    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:44:00.238525 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.238367    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88"
May 27 17:44:00.242384 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.240239    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp" event={"ID":"c448058f-5694-426a-9fe3-e0767a923366","Type":"ContainerStarted","Data":"c59e0dd5803e1142d7970e8e3f496de1b43801bdeae767f63e82474aab71af4a"}
May 27 17:44:00.262656 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.262605    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cdd89696-cwmvh" podStartSLOduration=19.839537582 podStartE2EDuration="33.262590356s" podCreationTimestamp="2026-05-27 17:43:27 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.574767559 +0000 UTC m=+36.166615515" lastFinishedPulling="2026-05-27 17:43:58.997820319 +0000 UTC m=+49.589668289" observedRunningTime="2026-05-27 17:44:00.242230956 +0000 UTC m=+50.834078934" watchObservedRunningTime="2026-05-27 17:44:00.262590356 +0000 UTC m=+50.854438338"
May 27 17:44:00.262856 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.262829    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6" podStartSLOduration=13.859900111 podStartE2EDuration="27.262824665s" podCreationTimestamp="2026-05-27 17:43:33 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.557080559 +0000 UTC m=+36.148928515" lastFinishedPulling="2026-05-27 17:43:58.960005096 +0000 UTC m=+49.551853069" observedRunningTime="2026-05-27 17:44:00.261233905 +0000 UTC m=+50.853081909" watchObservedRunningTime="2026-05-27 17:44:00.262824665 +0000 UTC m=+50.854672650"
May 27 17:44:00.310787 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.309864    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hswjp" podStartSLOduration=2.904060764 podStartE2EDuration="16.309846281s" podCreationTimestamp="2026-05-27 17:43:44 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.576716586 +0000 UTC m=+36.168564542" lastFinishedPulling="2026-05-27 17:43:58.982502087 +0000 UTC m=+49.574350059" observedRunningTime="2026-05-27 17:44:00.309299507 +0000 UTC m=+50.901147486" watchObservedRunningTime="2026-05-27 17:44:00.309846281 +0000 UTC m=+50.901694260"
May 27 17:44:00.342401 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:00.341818    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696655d75c-f8p88" podStartSLOduration=19.911876539 podStartE2EDuration="33.341799128s" podCreationTimestamp="2026-05-27 17:43:27 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.553383189 +0000 UTC m=+36.145231147" lastFinishedPulling="2026-05-27 17:43:58.983305777 +0000 UTC m=+49.575153736" observedRunningTime="2026-05-27 17:44:00.341238231 +0000 UTC m=+50.933086210" watchObservedRunningTime="2026-05-27 17:44:00.341799128 +0000 UTC m=+50.933647106"
May 27 17:44:01.243971 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.243940    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/1.log"
May 27 17:44:01.244411 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.244393    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/0.log"
May 27 17:44:01.244510 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.244447    2549 generic.go:358] "Generic (PLEG): container finished" podID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3" exitCode=255
May 27 17:44:01.244617 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.244591    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerDied","Data":"4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"}
May 27 17:44:01.244674 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.244641    2549 scope.go:117] "RemoveContainer" containerID="f8189742e9405f2f0d0de3262c7aadb60879a6a526c951ad79de7b867e63f07c"
May 27 17:44:01.245138 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:01.244826    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:01.245138 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:01.245037    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:02.249914 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:02.249825    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerStarted","Data":"32e262fa2cbfcfe9edefee7805360fc54cf4b60d96b194c4bc47f723aa5d7108"}
May 27 17:44:02.249914 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:02.249870    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerStarted","Data":"a5a7e46b7378acce544c91b7372cd802cdaa08629d4575f0bfa69426899dbc55"}
May 27 17:44:02.251447 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:02.251406    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/1.log"
May 27 17:44:02.251740 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:02.251724    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:02.251939 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:02.251911    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:02.270276 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:02.270232    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" podStartSLOduration=18.960688813 podStartE2EDuration="35.270218411s" podCreationTimestamp="2026-05-27 17:43:27 +0000 UTC" firstStartedPulling="2026-05-27 17:43:45.555871703 +0000 UTC m=+36.147719660" lastFinishedPulling="2026-05-27 17:44:01.865401299 +0000 UTC m=+52.457249258" observedRunningTime="2026-05-27 17:44:02.269843796 +0000 UTC m=+52.861691812" watchObservedRunningTime="2026-05-27 17:44:02.270218411 +0000 UTC m=+52.862066389"
May 27 17:44:03.075864 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:03.075836    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5g4bm_41d5488e-d6a7-4dfc-87bc-8e2d2eb70965/dns-node-resolver/0.log"
May 27 17:44:03.625826 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:03.625799    2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:03.626193 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:03.626166    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:03.626361 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:03.626342    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:04.080352 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:04.080332    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cql8g_1b08ec9b-ac4a-4b41-987d-9de70347f303/node-ca/0.log"
May 27 17:44:04.259731 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:04.259652    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5c6d" event={"ID":"19d0e065-7aa7-489d-9a16-06da64ec6832","Type":"ContainerStarted","Data":"beedc954e43bd0ffa2a7ed9d0d3e4e5534452ed6da14fb23a85d11bb6dd0a210"}
May 27 17:44:04.279030 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:04.278974    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5c6d" podStartSLOduration=41.355422 podStartE2EDuration="46.278959502s" podCreationTimestamp="2026-05-27 17:43:18 +0000 UTC" firstStartedPulling="2026-05-27 17:43:59.070313729 +0000 UTC m=+49.662161686" lastFinishedPulling="2026-05-27 17:44:03.993851231 +0000 UTC m=+54.585699188" observedRunningTime="2026-05-27 17:44:04.278037487 +0000 UTC m=+54.869885465" watchObservedRunningTime="2026-05-27 17:44:04.278959502 +0000 UTC m=+54.870807480"
May 27 17:44:05.679567 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:05.679535    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sg8pr_09c99d85-4c12-4338-b879-c2b1711f31ac/kube-storage-version-migrator-operator/0.log"
May 27 17:44:09.111548 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:09.111521    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcfp"
May 27 17:44:09.227304 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:09.227272    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:09.227695 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:09.227677    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:09.227897 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:09.227876    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:15.262586 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262549    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:44:15.262586 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262593    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262636    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:15.262707    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:15.262758    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls podName:86ff2b0d-cc49-4db3-a66c-c03a30a884d5 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:47.262744091 +0000 UTC m=+97.854592047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-xx5ls" (UID: "86ff2b0d-cc49-4db3-a66c-c03a30a884d5") : secret "cluster-monitoring-operator-tls" not found
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262747    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262783    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:15.263096 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.262837    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:44:15.263476 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.263411    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-service-ca-bundle\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:15.265108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.265076    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc0a4cb-272a-4208-a6ac-0cba4abf1f56-metrics-certs\") pod \"router-default-794b58b6fb-4x6dp\" (UID: \"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56\") " pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:15.265234 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.265108    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"image-registry-8f8585c59-lc5cv\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") " pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:44:15.265369 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.265351    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/190ab032-7ef0-4a87-9650-1e9b19f43d07-cert\") pod \"ingress-canary-pz6k6\" (UID: \"190ab032-7ef0-4a87-9650-1e9b19f43d07\") " pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:44:15.265517 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.265499    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ae7490f-da66-4c0b-8291-ff3b074fbf03-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hh5x4\" (UID: \"3ae7490f-da66-4c0b-8291-ff3b074fbf03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:44:15.364180 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.364142    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:44:15.366386 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.366354    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc91952-c036-4b5e-b349-93456b3abdf8-metrics-tls\") pod \"dns-default-zspcl\" (UID: \"0fc91952-c036-4b5e-b349-93456b3abdf8\") " pod="openshift-dns/dns-default-zspcl"
May 27 17:44:15.371795 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.371773    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp774\""
May 27 17:44:15.379508 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.379489    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:44:15.379852 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.379832    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-67g4d\""
May 27 17:44:15.387763 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.387745    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:15.411167 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.411140    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j8r9n\""
May 27 17:44:15.419467 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.419433    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"
May 27 17:44:15.479287 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.479265    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prtm9\""
May 27 17:44:15.487878 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.487828    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz6k6"
May 27 17:44:15.495124 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.495063    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv9xv\""
May 27 17:44:15.503042 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.502960    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zspcl"
May 27 17:44:15.532968 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.532941    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:44:15.537482 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:15.537404    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ceaace_f5e9_4be9_b3de_8f6d9b2a3fa3.slice/crio-532106e2de8e9022409851eac1422cb1cfea7281938eb63385081267c69364c2 WatchSource:0}: Error finding container 532106e2de8e9022409851eac1422cb1cfea7281938eb63385081267c69364c2: Status 404 returned error can't find the container with id 532106e2de8e9022409851eac1422cb1cfea7281938eb63385081267c69364c2
May 27 17:44:15.554623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.554590    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-794b58b6fb-4x6dp"]
May 27 17:44:15.561362 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:15.561329    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc0a4cb_272a_4208_a6ac_0cba4abf1f56.slice/crio-c278bd36da1ebe1a74c7c01cbe165eabd0bf0216fdc41d58dc016d77df3aa201 WatchSource:0}: Error finding container c278bd36da1ebe1a74c7c01cbe165eabd0bf0216fdc41d58dc016d77df3aa201: Status 404 returned error can't find the container with id c278bd36da1ebe1a74c7c01cbe165eabd0bf0216fdc41d58dc016d77df3aa201
May 27 17:44:15.595826 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.595768    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4"]
May 27 17:44:15.652913 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.652861    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz6k6"]
May 27 17:44:15.656334 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:15.656307    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190ab032_7ef0_4a87_9650_1e9b19f43d07.slice/crio-18aa8c885ddc8f1e0f1fa3c83020ea5923965cf7e92bcb019a944c40c5602aee WatchSource:0}: Error finding container 18aa8c885ddc8f1e0f1fa3c83020ea5923965cf7e92bcb019a944c40c5602aee: Status 404 returned error can't find the container with id 18aa8c885ddc8f1e0f1fa3c83020ea5923965cf7e92bcb019a944c40c5602aee
May 27 17:44:15.666685 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.666661    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:44:15.668766 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.668750    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:44:15.674721 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.674692    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zspcl"]
May 27 17:44:15.677322 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:15.677299    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 17:44:15.677441 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:15.677366    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs podName:0c8fe199-56b8-412d-8605-bacecf7343a0 nodeName:}" failed. No retries permitted until 2026-05-27 17:45:19.677343235 +0000 UTC m=+130.269191191 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs") pod "network-metrics-daemon-fbfqq" (UID: "0c8fe199-56b8-412d-8605-bacecf7343a0") : secret "metrics-daemon-secret" not found
May 27 17:44:15.678907 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:15.678883    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc91952_c036_4b5e_b349_93456b3abdf8.slice/crio-0f684b41b66dc96d9ec04dd986ee073950293a5e02e046840064115d3c49e070 WatchSource:0}: Error finding container 0f684b41b66dc96d9ec04dd986ee073950293a5e02e046840064115d3c49e070: Status 404 returned error can't find the container with id 0f684b41b66dc96d9ec04dd986ee073950293a5e02e046840064115d3c49e070
May 27 17:44:15.767893 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.767822    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:44:15.770465 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.770442    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvp2\" (UniqueName: \"kubernetes.io/projected/5dd25fb1-d4db-4e69-afa3-005cef443e60-kube-api-access-zvvp2\") pod \"network-check-target-4xlkj\" (UID: \"5dd25fb1-d4db-4e69-afa3-005cef443e60\") " pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:44:15.792503 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.792478    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frs9q\""
May 27 17:44:15.801471 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.801452    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:44:15.934847 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:15.934815    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xlkj"]
May 27 17:44:15.939394 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:15.939364    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd25fb1_d4db_4e69_afa3_005cef443e60.slice/crio-bf6601bb9760c3f47c3f4f6daf57441f1efb55dcab8edaa25312f383d2659dac WatchSource:0}: Error finding container bf6601bb9760c3f47c3f4f6daf57441f1efb55dcab8edaa25312f383d2659dac: Status 404 returned error can't find the container with id bf6601bb9760c3f47c3f4f6daf57441f1efb55dcab8edaa25312f383d2659dac
May 27 17:44:16.295883 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.295828    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zspcl" event={"ID":"0fc91952-c036-4b5e-b349-93456b3abdf8","Type":"ContainerStarted","Data":"0f684b41b66dc96d9ec04dd986ee073950293a5e02e046840064115d3c49e070"}
May 27 17:44:16.298904 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.298874    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-794b58b6fb-4x6dp" event={"ID":"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56","Type":"ContainerStarted","Data":"2e9abbc94b6dc311bd5518f840fa40cea839054e2632120c19aab261ad9b6582"}
May 27 17:44:16.299026 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.298912    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-794b58b6fb-4x6dp" event={"ID":"6bc0a4cb-272a-4208-a6ac-0cba4abf1f56","Type":"ContainerStarted","Data":"c278bd36da1ebe1a74c7c01cbe165eabd0bf0216fdc41d58dc016d77df3aa201"}
May 27 17:44:16.300915 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.300863    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" event={"ID":"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3","Type":"ContainerStarted","Data":"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"}
May 27 17:44:16.300915 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.300895    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" event={"ID":"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3","Type":"ContainerStarted","Data":"532106e2de8e9022409851eac1422cb1cfea7281938eb63385081267c69364c2"}
May 27 17:44:16.301158 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.301108    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:44:16.302098 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.302074    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz6k6" event={"ID":"190ab032-7ef0-4a87-9650-1e9b19f43d07","Type":"ContainerStarted","Data":"18aa8c885ddc8f1e0f1fa3c83020ea5923965cf7e92bcb019a944c40c5602aee"}
May 27 17:44:16.303859 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.303806    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4" event={"ID":"3ae7490f-da66-4c0b-8291-ff3b074fbf03","Type":"ContainerStarted","Data":"a2364135f53169e4f82d3494974eae3ea42acbe0b7df8d708123b36fe52346a1"}
May 27 17:44:16.305334 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.305312    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xlkj" event={"ID":"5dd25fb1-d4db-4e69-afa3-005cef443e60","Type":"ContainerStarted","Data":"dd947f71819a8e09edc9cd9094c1bbb915feb2f08810ac40794c43a004ea7a32"}
May 27 17:44:16.305459 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.305342    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xlkj" event={"ID":"5dd25fb1-d4db-4e69-afa3-005cef443e60","Type":"ContainerStarted","Data":"bf6601bb9760c3f47c3f4f6daf57441f1efb55dcab8edaa25312f383d2659dac"}
May 27 17:44:16.305527 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.305468    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:44:16.323960 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.323913    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-794b58b6fb-4x6dp" podStartSLOduration=53.323861203 podStartE2EDuration="53.323861203s" podCreationTimestamp="2026-05-27 17:43:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:44:16.322533914 +0000 UTC m=+66.914381894" watchObservedRunningTime="2026-05-27 17:44:16.323861203 +0000 UTC m=+66.915709210"
May 27 17:44:16.352783 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.351782    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" podStartSLOduration=66.351765089 podStartE2EDuration="1m6.351765089s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:44:16.350824328 +0000 UTC m=+66.942672302" watchObservedRunningTime="2026-05-27 17:44:16.351765089 +0000 UTC m=+66.943613060"
May 27 17:44:16.371693 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.371177    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4xlkj" podStartSLOduration=66.371158135 podStartE2EDuration="1m6.371158135s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:44:16.370040838 +0000 UTC m=+66.961888827" watchObservedRunningTime="2026-05-27 17:44:16.371158135 +0000 UTC m=+66.963006109"
May 27 17:44:16.388771 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.388717    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:16.391741 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:16.391580    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:17.308865 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:17.308836    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:17.310158 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:17.310136    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-794b58b6fb-4x6dp"
May 27 17:44:19.316067 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.316026    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz6k6" event={"ID":"190ab032-7ef0-4a87-9650-1e9b19f43d07","Type":"ContainerStarted","Data":"275c87cf82ec289e078cc88185587cedcdc85885502864d926e9cf0ec9f9116d"}
May 27 17:44:19.317815 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.317790    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4" event={"ID":"3ae7490f-da66-4c0b-8291-ff3b074fbf03","Type":"ContainerStarted","Data":"a9d7ac9f0d5f6ad882d5a2f3f9204826ff1484762a1146aa6a272077972cfb0f"}
May 27 17:44:19.317941 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.317820    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4" event={"ID":"3ae7490f-da66-4c0b-8291-ff3b074fbf03","Type":"ContainerStarted","Data":"bb7c61e496d417f4b4f01431893364c7fd46e534396dfb843400eb8f010347b2"}
May 27 17:44:19.319454 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.319435    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zspcl" event={"ID":"0fc91952-c036-4b5e-b349-93456b3abdf8","Type":"ContainerStarted","Data":"f380abdbdba0ee1e69e47dd79866f2e1167fb254a3e633052feea937967c20a0"}
May 27 17:44:19.319541 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.319457    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zspcl" event={"ID":"0fc91952-c036-4b5e-b349-93456b3abdf8","Type":"ContainerStarted","Data":"abd8a1595fb2b0f69c2249149a7fdbd60dcf290517015e9f6f4f66702d8cb96c"}
May 27 17:44:19.319541 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.319518    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zspcl"
May 27 17:44:19.338003 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.337878    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pz6k6" podStartSLOduration=33.164631745 podStartE2EDuration="36.337866301s" podCreationTimestamp="2026-05-27 17:43:43 +0000 UTC" firstStartedPulling="2026-05-27 17:44:15.65866418 +0000 UTC m=+66.250512150" lastFinishedPulling="2026-05-27 17:44:18.831898746 +0000 UTC m=+69.423746706" observedRunningTime="2026-05-27 17:44:19.33758597 +0000 UTC m=+69.929433971" watchObservedRunningTime="2026-05-27 17:44:19.337866301 +0000 UTC m=+69.929714281"
May 27 17:44:19.392197 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.392149    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zspcl" podStartSLOduration=33.241568437 podStartE2EDuration="36.392135293s" podCreationTimestamp="2026-05-27 17:43:43 +0000 UTC" firstStartedPulling="2026-05-27 17:44:15.680772558 +0000 UTC m=+66.272620514" lastFinishedPulling="2026-05-27 17:44:18.831339397 +0000 UTC m=+69.423187370" observedRunningTime="2026-05-27 17:44:19.371175604 +0000 UTC m=+69.963023594" watchObservedRunningTime="2026-05-27 17:44:19.392135293 +0000 UTC m=+69.983983269"
May 27 17:44:19.392724 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.392699    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hh5x4" podStartSLOduration=43.185690813 podStartE2EDuration="46.392691604s" podCreationTimestamp="2026-05-27 17:43:33 +0000 UTC" firstStartedPulling="2026-05-27 17:44:15.62897067 +0000 UTC m=+66.220818626" lastFinishedPulling="2026-05-27 17:44:18.83597146 +0000 UTC m=+69.427819417" observedRunningTime="2026-05-27 17:44:19.391677548 +0000 UTC m=+69.983525525" watchObservedRunningTime="2026-05-27 17:44:19.392691604 +0000 UTC m=+69.984539589"
May 27 17:44:19.973275 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:19.973247    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:20.323684 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.323657    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:44:20.324065 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.324034    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/1.log"
May 27 17:44:20.324107 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.324063    2549 generic.go:358] "Generic (PLEG): container finished" podID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c" exitCode=255
May 27 17:44:20.324161 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.324141    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerDied","Data":"b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"}
May 27 17:44:20.324199 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.324183    2549 scope.go:117] "RemoveContainer" containerID="4bf6dbac821fbfb8f7989a09f8ade5409c6265ca49c757786485f3639eaa5bf3"
May 27 17:44:20.324542 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:20.324521    2549 scope.go:117] "RemoveContainer" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"
May 27 17:44:20.324760 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:20.324741    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:21.327825 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:21.327800    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:44:23.624942 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:23.624910    2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:23.625310 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:23.625268    2549 scope.go:117] "RemoveContainer" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"
May 27 17:44:23.625478 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:23.625461    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:25.836698 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.836665    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dwq2j"]
May 27 17:44:25.899885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.899851    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwq2j"]
May 27 17:44:25.900024 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.899957    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:25.904113 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.904091    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 17:44:25.904752 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.904728    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-99xjw\""
May 27 17:44:25.904862 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.904786    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 17:44:25.949125 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.949104    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-data-volume\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:25.949244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.949164    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdc5\" (UniqueName: \"kubernetes.io/projected/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-api-access-xgdc5\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:25.949244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.949210    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:25.949244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.949231    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:25.949343 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:25.949250    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-crio-socket\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050230 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050198    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050230 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050234    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-crio-socket\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050447 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050262    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-data-volume\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050447 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050321    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdc5\" (UniqueName: \"kubernetes.io/projected/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-api-access-xgdc5\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050447 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050321    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-crio-socket\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050562 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050476    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050636 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-data-volume\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.050925 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.050909    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.052497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.052481    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.064520 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.064498    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdc5\" (UniqueName: \"kubernetes.io/projected/c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8-kube-api-access-xgdc5\") pod \"insights-runtime-extractor-dwq2j\" (UID: \"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8\") " pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.210129 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.210058    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwq2j"
May 27 17:44:26.368873 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:26.368844    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwq2j"]
May 27 17:44:26.372649 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:26.372623    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99b4fb5_36ee_4305_b1d3_0d9d3d42fef8.slice/crio-edad9292b21e79d135a0541b6a9c240496a4db957db32727978b4e297d02bf96 WatchSource:0}: Error finding container edad9292b21e79d135a0541b6a9c240496a4db957db32727978b4e297d02bf96: Status 404 returned error can't find the container with id edad9292b21e79d135a0541b6a9c240496a4db957db32727978b4e297d02bf96
May 27 17:44:27.344363 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:27.344329    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwq2j" event={"ID":"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8","Type":"ContainerStarted","Data":"4c41063d9dab5fcaaa9b1c3bbda1fefd8f06fe7011927c2596508e5a464297c7"}
May 27 17:44:27.344363 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:27.344366    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwq2j" event={"ID":"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8","Type":"ContainerStarted","Data":"edad9292b21e79d135a0541b6a9c240496a4db957db32727978b4e297d02bf96"}
May 27 17:44:28.348892 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:28.348851    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwq2j" event={"ID":"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8","Type":"ContainerStarted","Data":"72bf82bc6d07c3b916b01619862280b25ec37750b61d79c42a10bd20c1e01b2c"}
May 27 17:44:29.227153 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:29.227118    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:29.227579 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:29.227561    2549 scope.go:117] "RemoveContainer" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"
May 27 17:44:29.227780 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:29.227761    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:29.327408 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:29.327378    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zspcl"
May 27 17:44:30.357091 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:30.357048    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwq2j" event={"ID":"c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8","Type":"ContainerStarted","Data":"2dfa03bdfd9602e2d86f78f68ba40f8f65fb411c4c1eae33879354184a19e4d8"}
May 27 17:44:30.376739 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:30.376695    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dwq2j" podStartSLOduration=2.32468304 podStartE2EDuration="5.376681418s" podCreationTimestamp="2026-05-27 17:44:25 +0000 UTC" firstStartedPulling="2026-05-27 17:44:26.482650553 +0000 UTC m=+77.074498509" lastFinishedPulling="2026-05-27 17:44:29.534648931 +0000 UTC m=+80.126496887" observedRunningTime="2026-05-27 17:44:30.376100236 +0000 UTC m=+80.967948214" watchObservedRunningTime="2026-05-27 17:44:30.376681418 +0000 UTC m=+80.968529395"
May 27 17:44:35.384108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:35.384077    2549 patch_prober.go:28] interesting pod/image-registry-8f8585c59-lc5cv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 17:44:35.384565 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:35.384128    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 17:44:37.313276 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:37.313250    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:44:39.972231 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:39.972199    2549 scope.go:117] "RemoveContainer" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"
May 27 17:44:39.972745 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:44:39.972437    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-l4676_openshift-console-operator(f19c34b7-b593-44a5-b2bc-52cf747b7cb4)\"" pod="openshift-console-operator/console-operator-76dff48d59-l4676" podUID="f19c34b7-b593-44a5-b2bc-52cf747b7cb4"
May 27 17:44:47.311136 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.311103    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4xlkj"
May 27 17:44:47.333443 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.329968    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:44:47.333443 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.332972    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86ff2b0d-cc49-4db3-a66c-c03a30a884d5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-xx5ls\" (UID: \"86ff2b0d-cc49-4db3-a66c-c03a30a884d5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:44:47.501560 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.501534    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8h57\""
May 27 17:44:47.508924 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.508906    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"
May 27 17:44:47.644272 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:47.644239    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls"]
May 27 17:44:47.648731 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:47.648703    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ff2b0d_cc49_4db3_a66c_c03a30a884d5.slice/crio-13ce279c1db364be0281ce859e218a06773f14e6f9fe6a9719fea32e9b08dad6 WatchSource:0}: Error finding container 13ce279c1db364be0281ce859e218a06773f14e6f9fe6a9719fea32e9b08dad6: Status 404 returned error can't find the container with id 13ce279c1db364be0281ce859e218a06773f14e6f9fe6a9719fea32e9b08dad6
May 27 17:44:48.407338 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:48.407300    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls" event={"ID":"86ff2b0d-cc49-4db3-a66c-c03a30a884d5","Type":"ContainerStarted","Data":"13ce279c1db364be0281ce859e218a06773f14e6f9fe6a9719fea32e9b08dad6"}
May 27 17:44:48.488365 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:48.488332    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:44:50.413697 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:50.413660    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls" event={"ID":"86ff2b0d-cc49-4db3-a66c-c03a30a884d5","Type":"ContainerStarted","Data":"7f873efa6b67e96fed8a45def1a4812427a2d66a7f17e62bdc533e4c7211d0e9"}
May 27 17:44:50.431189 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:50.431145    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-xx5ls" podStartSLOduration=85.55504155 podStartE2EDuration="1m27.431132573s" podCreationTimestamp="2026-05-27 17:43:23 +0000 UTC" firstStartedPulling="2026-05-27 17:44:47.650561859 +0000 UTC m=+98.242409814" lastFinishedPulling="2026-05-27 17:44:49.526652877 +0000 UTC m=+100.118500837" observedRunningTime="2026-05-27 17:44:50.43077386 +0000 UTC m=+101.022621839" watchObservedRunningTime="2026-05-27 17:44:50.431132573 +0000 UTC m=+101.022980550"
May 27 17:44:53.971623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:53.971592    2549 scope.go:117] "RemoveContainer" containerID="b9c6c9c3e9f68a2c2fda8bbed54b1674bb570e7fb1e946a5bc176f0b733c182c"
May 27 17:44:54.425131 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:54.425103    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:44:54.425282 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:54.425155    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-l4676" event={"ID":"f19c34b7-b593-44a5-b2bc-52cf747b7cb4","Type":"ContainerStarted","Data":"1d495101bbaa089210dea1ce66942f2342ac8abef6d3f018aa4c1afce4f88ad2"}
May 27 17:44:54.425445 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:54.425411    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:54.434019 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:54.433998    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-l4676"
May 27 17:44:57.610935 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.610903    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-79l8m"]
May 27 17:44:57.613083 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.613066    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.615688 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.615666    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 17:44:57.616077 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.616060    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 17:44:57.616161 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.616086    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4klfq\""
May 27 17:44:57.616620 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.616130    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 17:44:57.620530 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.616833    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 17:44:57.722919 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.722890    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-sys\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.722939    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-wtmp\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.722998    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723032    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-metrics-client-ca\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723064    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-textfile\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723243 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723088    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-accelerators-collector-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723243 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723153    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkq8c\" (UniqueName: \"kubernetes.io/projected/0e73b9d5-49a8-4209-b22a-7dabf8832d43-kube-api-access-tkq8c\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723243 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723187    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-tls\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.723359 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.723256    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-root\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824015 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.823986    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-sys\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824022    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-wtmp\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824042    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824062    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-metrics-client-ca\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824090    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-textfile\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824088    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-sys\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824110    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-accelerators-collector-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824150    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkq8c\" (UniqueName: \"kubernetes.io/projected/0e73b9d5-49a8-4209-b22a-7dabf8832d43-kube-api-access-tkq8c\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824533 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824180    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-wtmp\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824533 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824184    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-tls\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824533 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824279    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-root\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824533 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824353    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e73b9d5-49a8-4209-b22a-7dabf8832d43-root\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824736 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824616    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-textfile\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824736 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824728    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-accelerators-collector-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.824827 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.824757    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e73b9d5-49a8-4209-b22a-7dabf8832d43-metrics-client-ca\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.826357 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.826332    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.826533 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.826517    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e73b9d5-49a8-4209-b22a-7dabf8832d43-node-exporter-tls\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.836240 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.836219    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkq8c\" (UniqueName: \"kubernetes.io/projected/0e73b9d5-49a8-4209-b22a-7dabf8832d43-kube-api-access-tkq8c\") pod \"node-exporter-79l8m\" (UID: \"0e73b9d5-49a8-4209-b22a-7dabf8832d43\") " pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.925839 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:57.925774    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79l8m"
May 27 17:44:57.935953 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:44:57.935919    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e73b9d5_49a8_4209_b22a_7dabf8832d43.slice/crio-9451815c152e35054f52df1e44f81b7674a2af2f360926d37fada265235a389f WatchSource:0}: Error finding container 9451815c152e35054f52df1e44f81b7674a2af2f360926d37fada265235a389f: Status 404 returned error can't find the container with id 9451815c152e35054f52df1e44f81b7674a2af2f360926d37fada265235a389f
May 27 17:44:58.435764 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:58.435726    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79l8m" event={"ID":"0e73b9d5-49a8-4209-b22a-7dabf8832d43","Type":"ContainerStarted","Data":"9451815c152e35054f52df1e44f81b7674a2af2f360926d37fada265235a389f"}
May 27 17:44:59.439976 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:59.439944    2549 generic.go:358] "Generic (PLEG): container finished" podID="0e73b9d5-49a8-4209-b22a-7dabf8832d43" containerID="59af982dfc96ff89d7a3f9ae5c345aa439f2fc9b0608f1e10ef0569b81c75833" exitCode=0
May 27 17:44:59.440388 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:44:59.440033    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79l8m" event={"ID":"0e73b9d5-49a8-4209-b22a-7dabf8832d43","Type":"ContainerDied","Data":"59af982dfc96ff89d7a3f9ae5c345aa439f2fc9b0608f1e10ef0569b81c75833"}
May 27 17:45:00.444502 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:00.444474    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79l8m" event={"ID":"0e73b9d5-49a8-4209-b22a-7dabf8832d43","Type":"ContainerStarted","Data":"7251e06730d77670407f606959235b9e499921e8c7f137dc2c51220bae0d5157"}
May 27 17:45:00.444502 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:00.444509    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79l8m" event={"ID":"0e73b9d5-49a8-4209-b22a-7dabf8832d43","Type":"ContainerStarted","Data":"f6f0a0e9465591fc013cc2064fa80c0351055a05dbd8615f681451ca37c6a220"}
May 27 17:45:00.468871 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:00.468826    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-79l8m" podStartSLOduration=2.4844919819999998 podStartE2EDuration="3.468814459s" podCreationTimestamp="2026-05-27 17:44:57 +0000 UTC" firstStartedPulling="2026-05-27 17:44:57.93779811 +0000 UTC m=+108.529646071" lastFinishedPulling="2026-05-27 17:44:58.922120587 +0000 UTC m=+109.513968548" observedRunningTime="2026-05-27 17:45:00.46706973 +0000 UTC m=+111.058917720" watchObservedRunningTime="2026-05-27 17:45:00.468814459 +0000 UTC m=+111.060662436"
May 27 17:45:05.459392 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:05.459353    2549 generic.go:358] "Generic (PLEG): container finished" podID="52552f61-8016-4cfa-aa8b-f9316be383d9" containerID="37285e0482cc9c771e4eb95332dc935b22a8435364e1979ade43ae930969d3f5" exitCode=0
May 27 17:45:05.459817 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:05.459441    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tslgf" event={"ID":"52552f61-8016-4cfa-aa8b-f9316be383d9","Type":"ContainerDied","Data":"37285e0482cc9c771e4eb95332dc935b22a8435364e1979ade43ae930969d3f5"}
May 27 17:45:05.459817 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:05.459737    2549 scope.go:117] "RemoveContainer" containerID="37285e0482cc9c771e4eb95332dc935b22a8435364e1979ade43ae930969d3f5"
May 27 17:45:06.465935 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:06.465901    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tslgf" event={"ID":"52552f61-8016-4cfa-aa8b-f9316be383d9","Type":"ContainerStarted","Data":"bd9543eabdfbc517d8423638617db561b5952b24d042cbb15a39d4cb098b7a04"}
May 27 17:45:06.593282 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:06.593252    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-794b58b6fb-4x6dp_6bc0a4cb-272a-4208-a6ac-0cba4abf1f56/router/0.log"
May 27 17:45:06.620522 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:06.620493    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pz6k6_190ab032-7ef0-4a87-9650-1e9b19f43d07/serve-healthcheck-canary/0.log"
May 27 17:45:13.511028 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.510954    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerName="registry" containerID="cri-o://5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf" gracePeriod=30
May 27 17:45:13.753701 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.753679    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:45:13.758899 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.758879    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.758974 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.758922    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.758974 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.758970    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.759049 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.758996    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.759049 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.759013    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.759113 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.759066    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.759113 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.759094    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r79h9\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.759499 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.759402    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:45:13.759640 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.759613    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:45:13.761536 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.761459    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9" (OuterVolumeSpecName: "kube-api-access-r79h9") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "kube-api-access-r79h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:45:13.761623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.761554    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:45:13.761751 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.761726    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:45:13.761751 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.761735    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:45:13.767713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.767691    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:45:13.859672 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859637    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets\") pod \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\" (UID: \"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3\") "
May 27 17:45:13.859845 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859833    2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-bound-sa-token\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.859885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859848    2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-ca-trust-extracted\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.859885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859857    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-trusted-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.859885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859867    2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-image-registry-private-configuration\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.859885 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859875    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r79h9\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-kube-api-access-r79h9\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.860029 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859887    2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-certificates\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.860029 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.859899    2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-registry-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:13.861647 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.861623    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" (UID: "c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:45:13.961029 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:13.960992    2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3-installation-pull-secrets\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:45:14.488941 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.488904    2549 generic.go:358] "Generic (PLEG): container finished" podID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerID="5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf" exitCode=0
May 27 17:45:14.489110 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.488970    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv"
May 27 17:45:14.489110 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.488992    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" event={"ID":"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3","Type":"ContainerDied","Data":"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"}
May 27 17:45:14.489110 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.489031    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f8585c59-lc5cv" event={"ID":"c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3","Type":"ContainerDied","Data":"532106e2de8e9022409851eac1422cb1cfea7281938eb63385081267c69364c2"}
May 27 17:45:14.489110 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.489048    2549 scope.go:117] "RemoveContainer" containerID="5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"
May 27 17:45:14.496545 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.496518    2549 scope.go:117] "RemoveContainer" containerID="5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"
May 27 17:45:14.496783 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:45:14.496764    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf\": container with ID starting with 5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf not found: ID does not exist" containerID="5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"
May 27 17:45:14.496840 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.496794    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf"} err="failed to get container status \"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf\": rpc error: code = NotFound desc = could not find container \"5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf\": container with ID starting with 5c298bc4068fb8bb4ce167d46c430c533dc8202b7b2a155a4732df45398c4ebf not found: ID does not exist"
May 27 17:45:14.507780 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.507760    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:45:14.514933 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:14.514913    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8f8585c59-lc5cv"]
May 27 17:45:15.493716 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:15.493678    2549 generic.go:358] "Generic (PLEG): container finished" podID="1d993e5f-3828-446c-9d2b-a695684e2f13" containerID="60a4728e9704879bd690b612308f316fc0eb6a14a5a46ed70fcfa2ab80477920" exitCode=0
May 27 17:45:15.494016 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:15.493729    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6" event={"ID":"1d993e5f-3828-446c-9d2b-a695684e2f13","Type":"ContainerDied","Data":"60a4728e9704879bd690b612308f316fc0eb6a14a5a46ed70fcfa2ab80477920"}
May 27 17:45:15.494139 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:15.494123    2549 scope.go:117] "RemoveContainer" containerID="60a4728e9704879bd690b612308f316fc0eb6a14a5a46ed70fcfa2ab80477920"
May 27 17:45:15.974896 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:15.974862    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" path="/var/lib/kubelet/pods/c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3/volumes"
May 27 17:45:16.498323 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:16.498289    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-r4pd6" event={"ID":"1d993e5f-3828-446c-9d2b-a695684e2f13","Type":"ContainerStarted","Data":"7ea69f364304b5c4409895591dbad24c18786489380aec29abfc6fef031a258b"}
May 27 17:45:19.712802 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:19.712755    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:45:19.715081 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:19.715059    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c8fe199-56b8-412d-8605-bacecf7343a0-metrics-certs\") pod \"network-metrics-daemon-fbfqq\" (UID: \"0c8fe199-56b8-412d-8605-bacecf7343a0\") " pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:45:19.998919 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:19.998839    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\""
May 27 17:45:20.006784 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:20.006763    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfqq"
May 27 17:45:20.127633 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:20.127606    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbfqq"]
May 27 17:45:20.130429 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:45:20.130379    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8fe199_56b8_412d_8605_bacecf7343a0.slice/crio-2d98e0103b81c033a4aff31a08a152325e49c72984142ed0f8e888e73442f964 WatchSource:0}: Error finding container 2d98e0103b81c033a4aff31a08a152325e49c72984142ed0f8e888e73442f964: Status 404 returned error can't find the container with id 2d98e0103b81c033a4aff31a08a152325e49c72984142ed0f8e888e73442f964
May 27 17:45:20.514843 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:20.514807    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfqq" event={"ID":"0c8fe199-56b8-412d-8605-bacecf7343a0","Type":"ContainerStarted","Data":"2d98e0103b81c033a4aff31a08a152325e49c72984142ed0f8e888e73442f964"}
May 27 17:45:21.518868 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:21.518826    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfqq" event={"ID":"0c8fe199-56b8-412d-8605-bacecf7343a0","Type":"ContainerStarted","Data":"5323b2e2e2a455ca47f7bc0feb091bd0a55d5331863f85aaa0598a064501930c"}
May 27 17:45:21.518868 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:21.518868    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfqq" event={"ID":"0c8fe199-56b8-412d-8605-bacecf7343a0","Type":"ContainerStarted","Data":"1951673f02a6d2956c0019450199ae20fbf5051351a9859df504814aee87bb52"}
May 27 17:45:21.536256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:21.536210    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbfqq" podStartSLOduration=130.595170809 podStartE2EDuration="2m11.536194424s" podCreationTimestamp="2026-05-27 17:43:10 +0000 UTC" firstStartedPulling="2026-05-27 17:45:20.132191295 +0000 UTC m=+130.724039252" lastFinishedPulling="2026-05-27 17:45:21.073214911 +0000 UTC m=+131.665062867" observedRunningTime="2026-05-27 17:45:21.534894078 +0000 UTC m=+132.126742055" watchObservedRunningTime="2026-05-27 17:45:21.536194424 +0000 UTC m=+132.128042403"
May 27 17:45:23.662791 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:23.662756    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" podUID="b383fc96-f413-4d9d-88e5-157c7380da31" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 17:45:30.544251 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:30.544213    2549 generic.go:358] "Generic (PLEG): container finished" podID="09c99d85-4c12-4338-b879-c2b1711f31ac" containerID="d59ca249bd0134093f95d9886c5dbd1674933ad081a644ca082c80b786769415" exitCode=0
May 27 17:45:30.544740 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:30.544277    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr" event={"ID":"09c99d85-4c12-4338-b879-c2b1711f31ac","Type":"ContainerDied","Data":"d59ca249bd0134093f95d9886c5dbd1674933ad081a644ca082c80b786769415"}
May 27 17:45:30.544740 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:30.544703    2549 scope.go:117] "RemoveContainer" containerID="d59ca249bd0134093f95d9886c5dbd1674933ad081a644ca082c80b786769415"
May 27 17:45:31.548739 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:31.548702    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sg8pr" event={"ID":"09c99d85-4c12-4338-b879-c2b1711f31ac","Type":"ContainerStarted","Data":"948079a4f98675436c6d635ee7afae79245feeb0322786c87048d47cacd12795"}
May 27 17:45:33.662970 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:33.662935    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" podUID="b383fc96-f413-4d9d-88e5-157c7380da31" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 17:45:43.663496 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:43.663457    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" podUID="b383fc96-f413-4d9d-88e5-157c7380da31" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 17:45:43.663878 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:43.663521    2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf"
May 27 17:45:43.663982 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:43.663964    2549 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"32e262fa2cbfcfe9edefee7805360fc54cf4b60d96b194c4bc47f723aa5d7108"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 27 17:45:43.664025 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:43.664001    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" podUID="b383fc96-f413-4d9d-88e5-157c7380da31" containerName="service-proxy" containerID="cri-o://32e262fa2cbfcfe9edefee7805360fc54cf4b60d96b194c4bc47f723aa5d7108" gracePeriod=30
May 27 17:45:44.586460 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:44.586402    2549 generic.go:358] "Generic (PLEG): container finished" podID="b383fc96-f413-4d9d-88e5-157c7380da31" containerID="32e262fa2cbfcfe9edefee7805360fc54cf4b60d96b194c4bc47f723aa5d7108" exitCode=2
May 27 17:45:44.586629 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:44.586474    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerDied","Data":"32e262fa2cbfcfe9edefee7805360fc54cf4b60d96b194c4bc47f723aa5d7108"}
May 27 17:45:44.586629 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:45:44.586514    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c8488bbfb-zg7rf" event={"ID":"b383fc96-f413-4d9d-88e5-157c7380da31","Type":"ContainerStarted","Data":"ec446585be49eacf6b51abb26d3914263b6f7bf1ccf58ac9b329a61513a7f2be"}
May 27 17:48:09.884348 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:48:09.884322    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:48:09.885639 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:48:09.885614    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:48:09.893809 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:48:09.893783    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:48:09.895561 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:48:09.895538    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:48:09.899369 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:48:09.899349    2549 kubelet.go:1628] "Image garbage collection succeeded"
May 27 17:49:38.830476 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.830440    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"]
May 27 17:49:38.831048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.830842    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerName="registry"
May 27 17:49:38.831048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.830860    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerName="registry"
May 27 17:49:38.831048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.830945    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7ceaace-f5e9-4be9-b3de-8f6d9b2a3fa3" containerName="registry"
May 27 17:49:38.833853 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.833832    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:38.836643 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.836619    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 17:49:38.836771 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.836728    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 17:49:38.837264 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.837238    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ngn6g\""
May 27 17:49:38.837446 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.837412    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 17:49:38.837563 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.837547    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 17:49:38.861689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.861667    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"]
May 27 17:49:38.921029 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.920999    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swmp4\" (UniqueName: \"kubernetes.io/projected/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-kube-api-access-swmp4\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:38.921145 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.921033    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:38.921145 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:38.921059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.021787 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.021741    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swmp4\" (UniqueName: \"kubernetes.io/projected/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-kube-api-access-swmp4\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.021962 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.021809    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.021962 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.021850    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.024230 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.024208    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.024324 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.024308    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.033199 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.033179    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swmp4\" (UniqueName: \"kubernetes.io/projected/419a8a0e-3ec8-4ced-a163-8c0adfdd0571-kube-api-access-swmp4\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-rhp9f\" (UID: \"419a8a0e-3ec8-4ced-a163-8c0adfdd0571\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.144123 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.144050    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:39.272799 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.272772    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"]
May 27 17:49:39.275375 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:49:39.275339    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419a8a0e_3ec8_4ced_a163_8c0adfdd0571.slice/crio-562b4dad9c6d9d551758352352eaa6fba6728579164b4b45fa8a6416ea3c616a WatchSource:0}: Error finding container 562b4dad9c6d9d551758352352eaa6fba6728579164b4b45fa8a6416ea3c616a: Status 404 returned error can't find the container with id 562b4dad9c6d9d551758352352eaa6fba6728579164b4b45fa8a6416ea3c616a
May 27 17:49:39.276952 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:39.276936    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:49:40.222089 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:40.222051    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f" event={"ID":"419a8a0e-3ec8-4ced-a163-8c0adfdd0571","Type":"ContainerStarted","Data":"562b4dad9c6d9d551758352352eaa6fba6728579164b4b45fa8a6416ea3c616a"}
May 27 17:49:42.230045 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:42.230006    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f" event={"ID":"419a8a0e-3ec8-4ced-a163-8c0adfdd0571","Type":"ContainerStarted","Data":"a424a91aff2d7934dfc7a7cb054fc8582a175a6092554941338a3bcd88023635"}
May 27 17:49:42.230527 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:42.230156    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:42.251261 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:42.251219    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f" podStartSLOduration=1.780911033 podStartE2EDuration="4.251202356s" podCreationTimestamp="2026-05-27 17:49:38 +0000 UTC" firstStartedPulling="2026-05-27 17:49:39.27706314 +0000 UTC m=+389.868911097" lastFinishedPulling="2026-05-27 17:49:41.747354465 +0000 UTC m=+392.339202420" observedRunningTime="2026-05-27 17:49:42.249711237 +0000 UTC m=+392.841559213" watchObservedRunningTime="2026-05-27 17:49:42.251202356 +0000 UTC m=+392.843050335"
May 27 17:49:53.236063 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:53.236027    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-rhp9f"
May 27 17:49:56.423489 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.423452    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"]
May 27 17:49:56.426705 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.426683    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.428886 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.428862    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 27 17:49:56.429527 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.429505    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 27 17:49:56.430088 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.430070    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hxhc\""
May 27 17:49:56.442995 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.442969    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"]
May 27 17:49:56.458227 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.458204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnvr\" (UniqueName: \"kubernetes.io/projected/b0d208b5-78ad-49af-8f9d-7ea4a5391878-kube-api-access-stnvr\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.458356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.458263    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.458356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.458310    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tmp\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.559157 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.559125    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.559326 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.559193    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tmp\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.559326 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.559236    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stnvr\" (UniqueName: \"kubernetes.io/projected/b0d208b5-78ad-49af-8f9d-7ea4a5391878-kube-api-access-stnvr\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.561515 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.561482    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tmp\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.561759 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.561739    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0d208b5-78ad-49af-8f9d-7ea4a5391878-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.591132 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.591108    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnvr\" (UniqueName: \"kubernetes.io/projected/b0d208b5-78ad-49af-8f9d-7ea4a5391878-kube-api-access-stnvr\") pod \"kube-auth-proxy-695c6f7b6-rshgc\" (UID: \"b0d208b5-78ad-49af-8f9d-7ea4a5391878\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.736749 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.736662    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"
May 27 17:49:56.881560 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:56.881532    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc"]
May 27 17:49:56.884772 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:49:56.884743    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d208b5_78ad_49af_8f9d_7ea4a5391878.slice/crio-59673c1b423f94a218de6545d4cc3313d04c565cc5e27b6cca233b628455fc66 WatchSource:0}: Error finding container 59673c1b423f94a218de6545d4cc3313d04c565cc5e27b6cca233b628455fc66: Status 404 returned error can't find the container with id 59673c1b423f94a218de6545d4cc3313d04c565cc5e27b6cca233b628455fc66
May 27 17:49:57.275830 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:57.275797    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc" event={"ID":"b0d208b5-78ad-49af-8f9d-7ea4a5391878","Type":"ContainerStarted","Data":"59673c1b423f94a218de6545d4cc3313d04c565cc5e27b6cca233b628455fc66"}
May 27 17:49:59.465936 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.465902    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9dcsj"]
May 27 17:49:59.469080 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.469065    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:49:59.471525 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.471501    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 27 17:49:59.471729 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.471715    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mbt2x\""
May 27 17:49:59.480688 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.480667    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9dcsj"]
May 27 17:49:59.581829 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.581802    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vpgs\" (UniqueName: \"kubernetes.io/projected/75e2f50c-5c10-4eea-8e4c-27cabe13978e-kube-api-access-8vpgs\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:49:59.581972 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.581842    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:49:59.682575 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.682540    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vpgs\" (UniqueName: \"kubernetes.io/projected/75e2f50c-5c10-4eea-8e4c-27cabe13978e-kube-api-access-8vpgs\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:49:59.682732 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.682587    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:49:59.682732 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:49:59.682692    2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 27 17:49:59.682813 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:49:59.682743    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert podName:75e2f50c-5c10-4eea-8e4c-27cabe13978e nodeName:}" failed. No retries permitted until 2026-05-27 17:50:00.182727228 +0000 UTC m=+410.774575184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert") pod "odh-model-controller-858dbf95b8-9dcsj" (UID: "75e2f50c-5c10-4eea-8e4c-27cabe13978e") : secret "odh-model-controller-webhook-cert" not found
May 27 17:49:59.697028 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:49:59.696997    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vpgs\" (UniqueName: \"kubernetes.io/projected/75e2f50c-5c10-4eea-8e4c-27cabe13978e-kube-api-access-8vpgs\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:00.187367 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:00.187331    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:00.189944 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:00.189915    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e2f50c-5c10-4eea-8e4c-27cabe13978e-cert\") pod \"odh-model-controller-858dbf95b8-9dcsj\" (UID: \"75e2f50c-5c10-4eea-8e4c-27cabe13978e\") " pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:00.379718 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:00.379676    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:00.855203 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:50:00.855172    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e2f50c_5c10_4eea_8e4c_27cabe13978e.slice/crio-1a66e17337995854c6ad94b4d72d66fb886f9f553c17843238a9cd7c3d84dad6 WatchSource:0}: Error finding container 1a66e17337995854c6ad94b4d72d66fb886f9f553c17843238a9cd7c3d84dad6: Status 404 returned error can't find the container with id 1a66e17337995854c6ad94b4d72d66fb886f9f553c17843238a9cd7c3d84dad6
May 27 17:50:00.855638 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:00.855603    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9dcsj"]
May 27 17:50:01.290596 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:01.290560    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" event={"ID":"75e2f50c-5c10-4eea-8e4c-27cabe13978e","Type":"ContainerStarted","Data":"1a66e17337995854c6ad94b4d72d66fb886f9f553c17843238a9cd7c3d84dad6"}
May 27 17:50:01.291817 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:01.291793    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc" event={"ID":"b0d208b5-78ad-49af-8f9d-7ea4a5391878","Type":"ContainerStarted","Data":"a4c903ef3ae74a21179c8aab2a1695a02fc4ef2ad85dc8a9330d776777127cf6"}
May 27 17:50:01.316863 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:01.316819    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-rshgc" podStartSLOduration=1.4405193330000001 podStartE2EDuration="5.316803921s" podCreationTimestamp="2026-05-27 17:49:56 +0000 UTC" firstStartedPulling="2026-05-27 17:49:56.886316047 +0000 UTC m=+407.478164002" lastFinishedPulling="2026-05-27 17:50:00.762600631 +0000 UTC m=+411.354448590" observedRunningTime="2026-05-27 17:50:01.315739134 +0000 UTC m=+411.907587113" watchObservedRunningTime="2026-05-27 17:50:01.316803921 +0000 UTC m=+411.908651899"
May 27 17:50:05.306391 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:05.306351    2549 generic.go:358] "Generic (PLEG): container finished" podID="75e2f50c-5c10-4eea-8e4c-27cabe13978e" containerID="519b4046e4c007e0be9b153138190bbb20fe3ed8fd3f05883ef6442aed1d1cc2" exitCode=1
May 27 17:50:05.306763 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:05.306441    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" event={"ID":"75e2f50c-5c10-4eea-8e4c-27cabe13978e","Type":"ContainerDied","Data":"519b4046e4c007e0be9b153138190bbb20fe3ed8fd3f05883ef6442aed1d1cc2"}
May 27 17:50:05.306763 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:05.306651    2549 scope.go:117] "RemoveContainer" containerID="519b4046e4c007e0be9b153138190bbb20fe3ed8fd3f05883ef6442aed1d1cc2"
May 27 17:50:06.090853 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.090820    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5x9fd"]
May 27 17:50:06.093941 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.093922    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.096358 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.096227    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 27 17:50:06.096358 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.096294    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6dzvm\""
May 27 17:50:06.107141 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.107119    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5x9fd"]
May 27 17:50:06.137307 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.137273    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.137307 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.137309    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm59w\" (UniqueName: \"kubernetes.io/projected/4c8b283a-e607-4cbd-a0a6-743857157070-kube-api-access-rm59w\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.238648 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.238231    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.238648 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.238282    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rm59w\" (UniqueName: \"kubernetes.io/projected/4c8b283a-e607-4cbd-a0a6-743857157070-kube-api-access-rm59w\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.238648 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:50:06.238434    2549 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 27 17:50:06.238648 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:50:06.238512    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert podName:4c8b283a-e607-4cbd-a0a6-743857157070 nodeName:}" failed. No retries permitted until 2026-05-27 17:50:06.738490836 +0000 UTC m=+417.330338797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert") pod "kserve-controller-manager-856948b99f-5x9fd" (UID: "4c8b283a-e607-4cbd-a0a6-743857157070") : secret "kserve-webhook-server-cert" not found
May 27 17:50:06.251386 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.251357    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm59w\" (UniqueName: \"kubernetes.io/projected/4c8b283a-e607-4cbd-a0a6-743857157070-kube-api-access-rm59w\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.310840 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.310811    2549 generic.go:358] "Generic (PLEG): container finished" podID="75e2f50c-5c10-4eea-8e4c-27cabe13978e" containerID="52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db" exitCode=1
May 27 17:50:06.311141 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.310898    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" event={"ID":"75e2f50c-5c10-4eea-8e4c-27cabe13978e","Type":"ContainerDied","Data":"52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db"}
May 27 17:50:06.311141 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.310948    2549 scope.go:117] "RemoveContainer" containerID="519b4046e4c007e0be9b153138190bbb20fe3ed8fd3f05883ef6442aed1d1cc2"
May 27 17:50:06.311141 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.311140    2549 scope.go:117] "RemoveContainer" containerID="52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db"
May 27 17:50:06.311354 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:50:06.311337    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9dcsj_opendatahub(75e2f50c-5c10-4eea-8e4c-27cabe13978e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" podUID="75e2f50c-5c10-4eea-8e4c-27cabe13978e"
May 27 17:50:06.744325 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.744293    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:06.746743 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:06.746717    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c8b283a-e607-4cbd-a0a6-743857157070-cert\") pod \"kserve-controller-manager-856948b99f-5x9fd\" (UID: \"4c8b283a-e607-4cbd-a0a6-743857157070\") " pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:07.005408 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:07.005329    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:07.135135 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:07.135108    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5x9fd"]
May 27 17:50:07.138535 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:50:07.138503    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8b283a_e607_4cbd_a0a6_743857157070.slice/crio-9505333d23e83b5695117b8120c2bf343b66ec66c462a5cc8dd997d42ef5243a WatchSource:0}: Error finding container 9505333d23e83b5695117b8120c2bf343b66ec66c462a5cc8dd997d42ef5243a: Status 404 returned error can't find the container with id 9505333d23e83b5695117b8120c2bf343b66ec66c462a5cc8dd997d42ef5243a
May 27 17:50:07.315566 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:07.315542    2549 scope.go:117] "RemoveContainer" containerID="52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db"
May 27 17:50:07.315950 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:50:07.315762    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9dcsj_opendatahub(75e2f50c-5c10-4eea-8e4c-27cabe13978e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" podUID="75e2f50c-5c10-4eea-8e4c-27cabe13978e"
May 27 17:50:07.316310 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:07.316285    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd" event={"ID":"4c8b283a-e607-4cbd-a0a6-743857157070","Type":"ContainerStarted","Data":"9505333d23e83b5695117b8120c2bf343b66ec66c462a5cc8dd997d42ef5243a"}
May 27 17:50:10.380818 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:10.380776    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:10.381352 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:10.381239    2549 scope.go:117] "RemoveContainer" containerID="52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db"
May 27 17:50:10.381503 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:50:10.381480    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9dcsj_opendatahub(75e2f50c-5c10-4eea-8e4c-27cabe13978e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" podUID="75e2f50c-5c10-4eea-8e4c-27cabe13978e"
May 27 17:50:11.329394 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:11.329361    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd" event={"ID":"4c8b283a-e607-4cbd-a0a6-743857157070","Type":"ContainerStarted","Data":"a65bfbc0f3747b98e6c816294cf8f48f810537619cf01df8aaa15da52e3e1830"}
May 27 17:50:11.329589 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:11.329467    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:11.367570 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:11.367517    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd" podStartSLOduration=1.754121598 podStartE2EDuration="5.367504196s" podCreationTimestamp="2026-05-27 17:50:06 +0000 UTC" firstStartedPulling="2026-05-27 17:50:07.139852633 +0000 UTC m=+417.731700589" lastFinishedPulling="2026-05-27 17:50:10.753235213 +0000 UTC m=+421.345083187" observedRunningTime="2026-05-27 17:50:11.365626188 +0000 UTC m=+421.957474166" watchObservedRunningTime="2026-05-27 17:50:11.367504196 +0000 UTC m=+421.959352175"
May 27 17:50:13.979791 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.979760    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"]
May 27 17:50:13.983457 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.983436    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:13.985660 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.985643    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 27 17:50:13.985873 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.985860    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-n259l\""
May 27 17:50:13.985948 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.985869    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 27 17:50:13.994704 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:13.994677    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"]
May 27 17:50:14.111185 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.111160    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d99d770-70a7-4c6c-9e60-e422f7f38819-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.111350 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.111240    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvvz7\" (UniqueName: \"kubernetes.io/projected/0d99d770-70a7-4c6c-9e60-e422f7f38819-kube-api-access-tvvz7\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.212567 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.212536    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d99d770-70a7-4c6c-9e60-e422f7f38819-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.212733 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.212606    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvvz7\" (UniqueName: \"kubernetes.io/projected/0d99d770-70a7-4c6c-9e60-e422f7f38819-kube-api-access-tvvz7\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.214966 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.214945    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d99d770-70a7-4c6c-9e60-e422f7f38819-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.221862 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.221837    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvvz7\" (UniqueName: \"kubernetes.io/projected/0d99d770-70a7-4c6c-9e60-e422f7f38819-kube-api-access-tvvz7\") pod \"servicemesh-operator3-55f49c5f94-kjqlg\" (UID: \"0d99d770-70a7-4c6c-9e60-e422f7f38819\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.292492 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.292456    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:14.421295 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:14.421265    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"]
May 27 17:50:14.425318 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:50:14.425288    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d99d770_70a7_4c6c_9e60_e422f7f38819.slice/crio-55de543b4448b9681121113df6477556aceebd1fbe32bd18df0b760b6739feda WatchSource:0}: Error finding container 55de543b4448b9681121113df6477556aceebd1fbe32bd18df0b760b6739feda: Status 404 returned error can't find the container with id 55de543b4448b9681121113df6477556aceebd1fbe32bd18df0b760b6739feda
May 27 17:50:15.344921 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:15.344885    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg" event={"ID":"0d99d770-70a7-4c6c-9e60-e422f7f38819","Type":"ContainerStarted","Data":"55de543b4448b9681121113df6477556aceebd1fbe32bd18df0b760b6739feda"}
May 27 17:50:19.359262 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:19.359184    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg" event={"ID":"0d99d770-70a7-4c6c-9e60-e422f7f38819","Type":"ContainerStarted","Data":"89700d406854e88cfff30eaf3988b410503a9808fb28ff36dae0e0c5464497fb"}
May 27 17:50:19.359661 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:19.359331    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:19.389061 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:19.388903    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg" podStartSLOduration=2.298278664 podStartE2EDuration="6.388887755s" podCreationTimestamp="2026-05-27 17:50:13 +0000 UTC" firstStartedPulling="2026-05-27 17:50:14.428232907 +0000 UTC m=+425.020080863" lastFinishedPulling="2026-05-27 17:50:18.518841999 +0000 UTC m=+429.110689954" observedRunningTime="2026-05-27 17:50:19.386351168 +0000 UTC m=+429.978199147" watchObservedRunningTime="2026-05-27 17:50:19.388887755 +0000 UTC m=+429.980735734"
May 27 17:50:20.380144 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:20.380115    2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:20.380535 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:20.380408    2549 scope.go:117] "RemoveContainer" containerID="52693a24abb2d351d374f18075f83709b4187f5b0cfbd9f2197721081d1f83db"
May 27 17:50:21.367807 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:21.367774    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" event={"ID":"75e2f50c-5c10-4eea-8e4c-27cabe13978e","Type":"ContainerStarted","Data":"a76ce9d6e38a8c49a60822fb9684205fb67c01be00f41fb6742d37075014a763"}
May 27 17:50:21.367981 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:21.367965    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:21.390485 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:21.390441    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj" podStartSLOduration=2.546696751 podStartE2EDuration="22.390403939s" podCreationTimestamp="2026-05-27 17:49:59 +0000 UTC" firstStartedPulling="2026-05-27 17:50:00.856571488 +0000 UTC m=+411.448419444" lastFinishedPulling="2026-05-27 17:50:20.700278677 +0000 UTC m=+431.292126632" observedRunningTime="2026-05-27 17:50:21.389084435 +0000 UTC m=+431.980932413" watchObservedRunningTime="2026-05-27 17:50:21.390403939 +0000 UTC m=+431.982251916"
May 27 17:50:30.365662 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:30.365626    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kjqlg"
May 27 17:50:32.373690 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:32.373656    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-9dcsj"
May 27 17:50:42.338122 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:42.338084    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-5x9fd"
May 27 17:50:44.693046 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.693013    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"]
May 27 17:50:44.695956 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.695933    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.698085 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.698059    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 27 17:50:44.698273 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.698258    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 27 17:50:44.698377 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.698357    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 27 17:50:44.698445 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.698359    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8lgp8\""
May 27 17:50:44.698536 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.698517    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 27 17:50:44.706585 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.706564    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"]
May 27 17:50:44.760165 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760133    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760165 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760170    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760196    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760213    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760299    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760332    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqsbn\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-kube-api-access-hqsbn\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.760370 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.760368    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b679c3df-4761-4732-8e41-48b3b0dfdbeb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861364 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861333    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861364 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861364    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861624 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861390    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861624 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861434    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqsbn\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-kube-api-access-hqsbn\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861624 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861469    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b679c3df-4761-4732-8e41-48b3b0dfdbeb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861624 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861532    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.861624 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.861563    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.862222 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.862194    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.863898 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.863871    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b679c3df-4761-4732-8e41-48b3b0dfdbeb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.863982 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.863918    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.864751 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.864731    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.864838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.864808    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.869389 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.869367    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:44.869597 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:44.869580    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqsbn\" (UniqueName: \"kubernetes.io/projected/b679c3df-4761-4732-8e41-48b3b0dfdbeb-kube-api-access-hqsbn\") pod \"istiod-openshift-gateway-798958bb55-cg69p\" (UID: \"b679c3df-4761-4732-8e41-48b3b0dfdbeb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:45.005635 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:45.005552    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:45.143762 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:45.143724    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"]
May 27 17:50:45.146935 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:50:45.146907    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb679c3df_4761_4732_8e41_48b3b0dfdbeb.slice/crio-06d224e786a344f438f2c349f159e4cfa759edaaf8e12a7f64007a374d43bf24 WatchSource:0}: Error finding container 06d224e786a344f438f2c349f159e4cfa759edaaf8e12a7f64007a374d43bf24: Status 404 returned error can't find the container with id 06d224e786a344f438f2c349f159e4cfa759edaaf8e12a7f64007a374d43bf24
May 27 17:50:45.444443 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:45.444391    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p" event={"ID":"b679c3df-4761-4732-8e41-48b3b0dfdbeb","Type":"ContainerStarted","Data":"06d224e786a344f438f2c349f159e4cfa759edaaf8e12a7f64007a374d43bf24"}
May 27 17:50:47.621470 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:47.621431    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 27 17:50:47.621884 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:47.621501    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 27 17:50:48.460168 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:48.460134    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p" event={"ID":"b679c3df-4761-4732-8e41-48b3b0dfdbeb","Type":"ContainerStarted","Data":"c3d2b5f29c3fd937d35fa0423f2e5d1ac140f02038e9f2b93004c7e0b5d36fa8"}
May 27 17:50:48.460365 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:48.460328    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:50:48.462112 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:48.462082    2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-cg69p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 27 17:50:48.462235 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:48.462138    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p" podUID="b679c3df-4761-4732-8e41-48b3b0dfdbeb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 17:50:48.481122 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:48.481075    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p" podStartSLOduration=2.009027828 podStartE2EDuration="4.481058943s" podCreationTimestamp="2026-05-27 17:50:44 +0000 UTC" firstStartedPulling="2026-05-27 17:50:45.14915887 +0000 UTC m=+455.741006826" lastFinishedPulling="2026-05-27 17:50:47.621189979 +0000 UTC m=+458.213037941" observedRunningTime="2026-05-27 17:50:48.479076577 +0000 UTC m=+459.070924555" watchObservedRunningTime="2026-05-27 17:50:48.481058943 +0000 UTC m=+459.072906922"
May 27 17:50:49.464519 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:50:49.464492    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cg69p"
May 27 17:51:29.975497 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.975463    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"]
May 27 17:51:29.981230 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.981208    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:29.984323 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.984301    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 17:51:29.984323 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.984320    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 17:51:29.984524 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.984333    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 17:51:29.985039 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.985020    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9zvph\""
May 27 17:51:29.985473 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:29.985455    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"]
May 27 17:51:30.045326 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.045297    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47t9h\" (UniqueName: \"kubernetes.io/projected/17a613c7-33ee-4d20-9348-2befc3a28be7-kube-api-access-47t9h\") pod \"dns-operator-controller-manager-648d5c98bc-65gkv\" (UID: \"17a613c7-33ee-4d20-9348-2befc3a28be7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:30.146132 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.146100    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47t9h\" (UniqueName: \"kubernetes.io/projected/17a613c7-33ee-4d20-9348-2befc3a28be7-kube-api-access-47t9h\") pod \"dns-operator-controller-manager-648d5c98bc-65gkv\" (UID: \"17a613c7-33ee-4d20-9348-2befc3a28be7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:30.154581 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.154556    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47t9h\" (UniqueName: \"kubernetes.io/projected/17a613c7-33ee-4d20-9348-2befc3a28be7-kube-api-access-47t9h\") pod \"dns-operator-controller-manager-648d5c98bc-65gkv\" (UID: \"17a613c7-33ee-4d20-9348-2befc3a28be7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:30.292356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.292329    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:30.432322 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.430686    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"]
May 27 17:51:30.436011 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:51:30.435984    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a613c7_33ee_4d20_9348_2befc3a28be7.slice/crio-52859a596c3082a8427e627639af950addb2b1535a1868925bb579875aa73a89 WatchSource:0}: Error finding container 52859a596c3082a8427e627639af950addb2b1535a1868925bb579875aa73a89: Status 404 returned error can't find the container with id 52859a596c3082a8427e627639af950addb2b1535a1868925bb579875aa73a89
May 27 17:51:30.593960 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:30.593881    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv" event={"ID":"17a613c7-33ee-4d20-9348-2befc3a28be7","Type":"ContainerStarted","Data":"52859a596c3082a8427e627639af950addb2b1535a1868925bb579875aa73a89"}
May 27 17:51:33.462161 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.462122    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"]
May 27 17:51:33.465644 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.465622    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:33.468025 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.468001    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zl79d\""
May 27 17:51:33.476285 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.476260    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"]
May 27 17:51:33.476568 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.476546    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsm7\" (UniqueName: \"kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" (UID: \"b782d874-a899-479c-a090-4d69d1877c5e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:33.577711 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.577678    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsm7\" (UniqueName: \"kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" (UID: \"b782d874-a899-479c-a090-4d69d1877c5e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:33.585556 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.585528    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsm7\" (UniqueName: \"kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" (UID: \"b782d874-a899-479c-a090-4d69d1877c5e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:33.606093 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.606064    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv" event={"ID":"17a613c7-33ee-4d20-9348-2befc3a28be7","Type":"ContainerStarted","Data":"e8c3c71032966cdf2df2f66b44c2e8071cc02d3297baa4c92d2d1a5acc5ab929"}
May 27 17:51:33.606210 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.606177    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:33.626095 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.626052    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv" podStartSLOduration=2.103925729 podStartE2EDuration="4.62603832s" podCreationTimestamp="2026-05-27 17:51:29 +0000 UTC" firstStartedPulling="2026-05-27 17:51:30.437958 +0000 UTC m=+501.029805975" lastFinishedPulling="2026-05-27 17:51:32.960070609 +0000 UTC m=+503.551918566" observedRunningTime="2026-05-27 17:51:33.624242371 +0000 UTC m=+504.216090349" watchObservedRunningTime="2026-05-27 17:51:33.62603832 +0000 UTC m=+504.217886298"
May 27 17:51:33.776328 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.776299    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:33.924995 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:33.924969    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"]
May 27 17:51:33.927729 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:51:33.927704    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb782d874_a899_479c_a090_4d69d1877c5e.slice/crio-060201d08f812a87f3c84a7c5fd8ef875b468a59da6f51a6b56692372a035fc5 WatchSource:0}: Error finding container 060201d08f812a87f3c84a7c5fd8ef875b468a59da6f51a6b56692372a035fc5: Status 404 returned error can't find the container with id 060201d08f812a87f3c84a7c5fd8ef875b468a59da6f51a6b56692372a035fc5
May 27 17:51:34.610901 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:34.610865    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" event={"ID":"b782d874-a899-479c-a090-4d69d1877c5e","Type":"ContainerStarted","Data":"060201d08f812a87f3c84a7c5fd8ef875b468a59da6f51a6b56692372a035fc5"}
May 27 17:51:36.619092 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:36.619053    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" event={"ID":"b782d874-a899-479c-a090-4d69d1877c5e","Type":"ContainerStarted","Data":"f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85"}
May 27 17:51:36.619588 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:36.619175    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:36.640182 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:36.640008    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" podStartSLOduration=1.409696322 podStartE2EDuration="3.639992208s" podCreationTimestamp="2026-05-27 17:51:33 +0000 UTC" firstStartedPulling="2026-05-27 17:51:33.930086986 +0000 UTC m=+504.521934946" lastFinishedPulling="2026-05-27 17:51:36.160382873 +0000 UTC m=+506.752230832" observedRunningTime="2026-05-27 17:51:36.63908394 +0000 UTC m=+507.230931918" watchObservedRunningTime="2026-05-27 17:51:36.639992208 +0000 UTC m=+507.231840185"
May 27 17:51:44.612815 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:44.612784    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-65gkv"
May 27 17:51:47.624459 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:47.624399    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:57.665053 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.664974    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"]
May 27 17:51:57.665479 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.665282    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" podUID="b782d874-a899-479c-a090-4d69d1877c5e" containerName="manager" containerID="cri-o://f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85" gracePeriod=2
May 27 17:51:57.667447 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.667398    2549 status_manager.go:895] "Failed to get status for pod" podUID="b782d874-a899-479c-a090-4d69d1877c5e" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" err="pods \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" is forbidden: User \"system:node:ip-10-0-135-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-90.ec2.internal' and this object"
May 27 17:51:57.667880 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.667857    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"]
May 27 17:51:57.690802 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.690774    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"]
May 27 17:51:57.691295 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.691276    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b782d874-a899-479c-a090-4d69d1877c5e" containerName="manager"
May 27 17:51:57.691351 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.691309    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b782d874-a899-479c-a090-4d69d1877c5e" containerName="manager"
May 27 17:51:57.691452 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.691409    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="b782d874-a899-479c-a090-4d69d1877c5e" containerName="manager"
May 27 17:51:57.693639 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.693616    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:57.703621 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.703598    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"]
May 27 17:51:57.716906 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.716878    2549 status_manager.go:895] "Failed to get status for pod" podUID="b782d874-a899-479c-a090-4d69d1877c5e" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" err="pods \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" is forbidden: User \"system:node:ip-10-0-135-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-90.ec2.internal' and this object"
May 27 17:51:57.790219 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.790194    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6bvs\" (UniqueName: \"kubernetes.io/projected/8870adac-2920-425e-96dd-f7d625becf8f-kube-api-access-w6bvs\") pod \"limitador-operator-controller-manager-85c4996f8c-nb896\" (UID: \"8870adac-2920-425e-96dd-f7d625becf8f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:57.891391 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.891366    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bvs\" (UniqueName: \"kubernetes.io/projected/8870adac-2920-425e-96dd-f7d625becf8f-kube-api-access-w6bvs\") pod \"limitador-operator-controller-manager-85c4996f8c-nb896\" (UID: \"8870adac-2920-425e-96dd-f7d625becf8f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:57.894057 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.894034    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:57.896024 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.896001    2549 status_manager.go:895] "Failed to get status for pod" podUID="b782d874-a899-479c-a090-4d69d1877c5e" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn" err="pods \"limitador-operator-controller-manager-85c4996f8c-nzqsn\" is forbidden: User \"system:node:ip-10-0-135-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-90.ec2.internal' and this object"
May 27 17:51:57.899526 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.899502    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6bvs\" (UniqueName: \"kubernetes.io/projected/8870adac-2920-425e-96dd-f7d625becf8f-kube-api-access-w6bvs\") pod \"limitador-operator-controller-manager-85c4996f8c-nb896\" (UID: \"8870adac-2920-425e-96dd-f7d625becf8f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:57.992229 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.992163    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktsm7\" (UniqueName: \"kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7\") pod \"b782d874-a899-479c-a090-4d69d1877c5e\" (UID: \"b782d874-a899-479c-a090-4d69d1877c5e\") "
May 27 17:51:57.994280 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:57.994257    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7" (OuterVolumeSpecName: "kube-api-access-ktsm7") pod "b782d874-a899-479c-a090-4d69d1877c5e" (UID: "b782d874-a899-479c-a090-4d69d1877c5e"). InnerVolumeSpecName "kube-api-access-ktsm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:51:58.031263 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.031237    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:58.093257 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.093221    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktsm7\" (UniqueName: \"kubernetes.io/projected/b782d874-a899-479c-a090-4d69d1877c5e-kube-api-access-ktsm7\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:51:58.165188 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.165158    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"]
May 27 17:51:58.168493 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:51:58.168461    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8870adac_2920_425e_96dd_f7d625becf8f.slice/crio-2412ab5e6660c32255a9889adaf13344ea0d184c800aaf92732f738b497392d4 WatchSource:0}: Error finding container 2412ab5e6660c32255a9889adaf13344ea0d184c800aaf92732f738b497392d4: Status 404 returned error can't find the container with id 2412ab5e6660c32255a9889adaf13344ea0d184c800aaf92732f738b497392d4
May 27 17:51:58.704079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.704044    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896" event={"ID":"8870adac-2920-425e-96dd-f7d625becf8f","Type":"ContainerStarted","Data":"4c2b88c729e0ce1dfdc1baef89f6b8464ed943c1139588783cbcee0bacbbc24c"}
May 27 17:51:58.704504 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.704082    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896" event={"ID":"8870adac-2920-425e-96dd-f7d625becf8f","Type":"ContainerStarted","Data":"2412ab5e6660c32255a9889adaf13344ea0d184c800aaf92732f738b497392d4"}
May 27 17:51:58.704504 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.704115    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:51:58.705178 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.705158    2549 generic.go:358] "Generic (PLEG): container finished" podID="b782d874-a899-479c-a090-4d69d1877c5e" containerID="f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85" exitCode=0
May 27 17:51:58.705226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.705194    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzqsn"
May 27 17:51:58.705226 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.705222    2549 scope.go:117] "RemoveContainer" containerID="f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85"
May 27 17:51:58.713254 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.713233    2549 scope.go:117] "RemoveContainer" containerID="f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85"
May 27 17:51:58.713534 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:51:58.713513    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85\": container with ID starting with f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85 not found: ID does not exist" containerID="f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85"
May 27 17:51:58.713610 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.713540    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85"} err="failed to get container status \"f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85\": rpc error: code = NotFound desc = could not find container \"f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85\": container with ID starting with f9f08a7c5cf68d07c8badf50fefcab99c535b9fe1e93b53edf9a8884563c2d85 not found: ID does not exist"
May 27 17:51:58.724737 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:58.724700    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896" podStartSLOduration=1.724688813 podStartE2EDuration="1.724688813s" podCreationTimestamp="2026-05-27 17:51:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:51:58.722932712 +0000 UTC m=+529.314780690" watchObservedRunningTime="2026-05-27 17:51:58.724688813 +0000 UTC m=+529.316536859"
May 27 17:51:59.975437 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:51:59.975386    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b782d874-a899-479c-a090-4d69d1877c5e" path="/var/lib/kubelet/pods/b782d874-a899-479c-a090-4d69d1877c5e/volumes"
May 27 17:52:09.711948 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:09.711917    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nb896"
May 27 17:52:48.586958 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.586924    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:52:48.589372 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.589352    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.591383 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.591363    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 27 17:52:48.591527 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.591430    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cjrkq\""
May 27 17:52:48.599587 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.599534    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:52:48.690211 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.690184    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:52:48.719842 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.719810    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.719981 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.719887    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8fwd\" (UniqueName: \"kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.821306 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.821277    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8fwd\" (UniqueName: \"kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.821470 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.821338    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.822208 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.822189    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.832216 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.832183    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8fwd\" (UniqueName: \"kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd\") pod \"limitador-limitador-7d549b5b-n2stz\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") " pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:48.900143 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:48.900065    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:49.027439 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:49.027379    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:52:49.030441 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:52:49.030399    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a9a1a5_ab04_4de4_98c4_d6c344f3dc42.slice/crio-695bfbe08c0082c484967958e0b013d3eeaba518def331a6f2c520aaabdc99b2 WatchSource:0}: Error finding container 695bfbe08c0082c484967958e0b013d3eeaba518def331a6f2c520aaabdc99b2: Status 404 returned error can't find the container with id 695bfbe08c0082c484967958e0b013d3eeaba518def331a6f2c520aaabdc99b2
May 27 17:52:49.875055 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:49.875006    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" event={"ID":"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42","Type":"ContainerStarted","Data":"695bfbe08c0082c484967958e0b013d3eeaba518def331a6f2c520aaabdc99b2"}
May 27 17:52:51.883742 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:51.883704    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" event={"ID":"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42","Type":"ContainerStarted","Data":"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"}
May 27 17:52:51.884100 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:51.883813    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:52:51.900429 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:52:51.900367    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" podStartSLOduration=1.19707873 podStartE2EDuration="3.900354658s" podCreationTimestamp="2026-05-27 17:52:48 +0000 UTC" firstStartedPulling="2026-05-27 17:52:49.032081281 +0000 UTC m=+579.623929241" lastFinishedPulling="2026-05-27 17:52:51.735357213 +0000 UTC m=+582.327205169" observedRunningTime="2026-05-27 17:52:51.899207761 +0000 UTC m=+582.491055741" watchObservedRunningTime="2026-05-27 17:52:51.900354658 +0000 UTC m=+582.492202637"
May 27 17:53:02.887755 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:02.887724    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:53:03.336235 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.336205    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:53:03.336511 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.336484    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" podUID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" containerName="limitador" containerID="cri-o://d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9" gracePeriod=30
May 27 17:53:03.896924 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.896873    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:53:03.925969 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.925937    2549 generic.go:358] "Generic (PLEG): container finished" podID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" containerID="d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9" exitCode=0
May 27 17:53:03.926108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.926000    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz"
May 27 17:53:03.926108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.926018    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" event={"ID":"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42","Type":"ContainerDied","Data":"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"}
May 27 17:53:03.926108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.926056    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-n2stz" event={"ID":"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42","Type":"ContainerDied","Data":"695bfbe08c0082c484967958e0b013d3eeaba518def331a6f2c520aaabdc99b2"}
May 27 17:53:03.926108 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.926075    2549 scope.go:117] "RemoveContainer" containerID="d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"
May 27 17:53:03.934360 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.934343    2549 scope.go:117] "RemoveContainer" containerID="d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"
May 27 17:53:03.934651 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:53:03.934631    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9\": container with ID starting with d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9 not found: ID does not exist" containerID="d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"
May 27 17:53:03.934786 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.934658    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9"} err="failed to get container status \"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9\": rpc error: code = NotFound desc = could not find container \"d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9\": container with ID starting with d25054b4105bb5c4c39c5274002b6acf01d798b9c7dfb0387063292bf68a68b9 not found: ID does not exist"
May 27 17:53:03.955079 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.955055    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file\") pod \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") "
May 27 17:53:03.955171 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.955124    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8fwd\" (UniqueName: \"kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd\") pod \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\" (UID: \"85a9a1a5-ab04-4de4-98c4-d6c344f3dc42\") "
May 27 17:53:03.955393 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.955373    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file" (OuterVolumeSpecName: "config-file") pod "85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" (UID: "85a9a1a5-ab04-4de4-98c4-d6c344f3dc42"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:53:03.957020 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:03.957000    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd" (OuterVolumeSpecName: "kube-api-access-r8fwd") pod "85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" (UID: "85a9a1a5-ab04-4de4-98c4-d6c344f3dc42"). InnerVolumeSpecName "kube-api-access-r8fwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:53:04.055783 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.055752    2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-config-file\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:53:04.055783 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.055778    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8fwd\" (UniqueName: \"kubernetes.io/projected/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42-kube-api-access-r8fwd\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:53:04.242640 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.242573    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:53:04.246038 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.246015    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-n2stz"]
May 27 17:53:04.411742 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.411711    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d65v6"]
May 27 17:53:04.412145 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.412125    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" containerName="limitador"
May 27 17:53:04.412145 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.412147    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" containerName="limitador"
May 27 17:53:04.412343 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.412266    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" containerName="limitador"
May 27 17:53:04.415048 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.415029    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.417459 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.417439    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4m8xd\""
May 27 17:53:04.417574 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.417506    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 27 17:53:04.424674 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.424637    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d65v6"]
May 27 17:53:04.458322 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.458285    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmj5n\" (UniqueName: \"kubernetes.io/projected/53a007cc-823a-4e41-bf78-a8980c5e8d70-kube-api-access-mmj5n\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.458479 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.458410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53a007cc-823a-4e41-bf78-a8980c5e8d70-data\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.559548 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.559511    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53a007cc-823a-4e41-bf78-a8980c5e8d70-data\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.559727 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.559562    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmj5n\" (UniqueName: \"kubernetes.io/projected/53a007cc-823a-4e41-bf78-a8980c5e8d70-kube-api-access-mmj5n\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.559879 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.559847    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53a007cc-823a-4e41-bf78-a8980c5e8d70-data\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.569353 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.569333    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmj5n\" (UniqueName: \"kubernetes.io/projected/53a007cc-823a-4e41-bf78-a8980c5e8d70-kube-api-access-mmj5n\") pod \"postgres-68c4fbbd6f-d65v6\" (UID: \"53a007cc-823a-4e41-bf78-a8980c5e8d70\") " pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.728689 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.728657    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:04.855722 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.855696    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d65v6"]
May 27 17:53:04.857631 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:53:04.857607    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a007cc_823a_4e41_bf78_a8980c5e8d70.slice/crio-853efaf4f39f0db203414ce47910eb874555e176bfbb57135ffb389e5fae44fa WatchSource:0}: Error finding container 853efaf4f39f0db203414ce47910eb874555e176bfbb57135ffb389e5fae44fa: Status 404 returned error can't find the container with id 853efaf4f39f0db203414ce47910eb874555e176bfbb57135ffb389e5fae44fa
May 27 17:53:04.930791 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:04.930762    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-d65v6" event={"ID":"53a007cc-823a-4e41-bf78-a8980c5e8d70","Type":"ContainerStarted","Data":"853efaf4f39f0db203414ce47910eb874555e176bfbb57135ffb389e5fae44fa"}
May 27 17:53:05.977688 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:05.977653    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a9a1a5-ab04-4de4-98c4-d6c344f3dc42" path="/var/lib/kubelet/pods/85a9a1a5-ab04-4de4-98c4-d6c344f3dc42/volumes"
May 27 17:53:09.915164 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.915138    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:53:09.915782 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.915767    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:53:09.919887 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.919869    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:53:09.920495 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.920470    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:53:09.950356 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.950328    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-d65v6" event={"ID":"53a007cc-823a-4e41-bf78-a8980c5e8d70","Type":"ContainerStarted","Data":"64ee7b32dbcb6f158c5da713fad2c9482d374ccd2327704a1822104492099dd0"}
May 27 17:53:09.950462 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.950409    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:09.967280 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:09.967237    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-d65v6" podStartSLOduration=1.5563805739999999 podStartE2EDuration="5.967224806s" podCreationTimestamp="2026-05-27 17:53:04 +0000 UTC" firstStartedPulling="2026-05-27 17:53:04.858897047 +0000 UTC m=+595.450745002" lastFinishedPulling="2026-05-27 17:53:09.269741277 +0000 UTC m=+599.861589234" observedRunningTime="2026-05-27 17:53:09.965546633 +0000 UTC m=+600.557394611" watchObservedRunningTime="2026-05-27 17:53:09.967224806 +0000 UTC m=+600.559072783"
May 27 17:53:15.982622 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:15.982592    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-d65v6"
May 27 17:53:21.320279 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.320201    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:21.326999 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.326979    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:21.329526 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.329504    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 27 17:53:21.329623 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.329506    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8rmq\""
May 27 17:53:21.333270 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.333248    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:21.411866 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.411834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck9gl\" (UniqueName: \"kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl\") pod \"maas-controller-766d766d75-bf5wq\" (UID: \"91caa464-d96b-4af7-a428-c788812da701\") " pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:21.477713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.477682    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:53:21.509278 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.509243    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:53:21.509450 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.509297    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:21.512350 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.512322    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9gl\" (UniqueName: \"kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl\") pod \"maas-controller-766d766d75-bf5wq\" (UID: \"91caa464-d96b-4af7-a428-c788812da701\") " pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:21.519755 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.519736    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck9gl\" (UniqueName: \"kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl\") pod \"maas-controller-766d766d75-bf5wq\" (UID: \"91caa464-d96b-4af7-a428-c788812da701\") " pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:21.613316 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.613245    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5f4k\" (UniqueName: \"kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k\") pod \"maas-controller-5485687775-bbkd5\" (UID: \"413147d8-aab1-4e5f-99ca-a48a55dc5f26\") " pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:21.638302 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.638280    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:21.714291 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.714260    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5f4k\" (UniqueName: \"kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k\") pod \"maas-controller-5485687775-bbkd5\" (UID: \"413147d8-aab1-4e5f-99ca-a48a55dc5f26\") " pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:21.723515 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.723478    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5f4k\" (UniqueName: \"kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k\") pod \"maas-controller-5485687775-bbkd5\" (UID: \"413147d8-aab1-4e5f-99ca-a48a55dc5f26\") " pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:21.767521 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.767485    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:21.770843 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:53:21.770813    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91caa464_d96b_4af7_a428_c788812da701.slice/crio-60adabeadd613366072aa54a149f60fc8aafcf1240ef04e52345cdb3a51fb194 WatchSource:0}: Error finding container 60adabeadd613366072aa54a149f60fc8aafcf1240ef04e52345cdb3a51fb194: Status 404 returned error can't find the container with id 60adabeadd613366072aa54a149f60fc8aafcf1240ef04e52345cdb3a51fb194
May 27 17:53:21.819569 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.819540    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:21.947378 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.947354    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:53:21.949521 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:53:21.949494    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413147d8_aab1_4e5f_99ca_a48a55dc5f26.slice/crio-ff3cb92e527fb6660489f8558ad9110f4545b982219a1e872f619151ebc90260 WatchSource:0}: Error finding container ff3cb92e527fb6660489f8558ad9110f4545b982219a1e872f619151ebc90260: Status 404 returned error can't find the container with id ff3cb92e527fb6660489f8558ad9110f4545b982219a1e872f619151ebc90260
May 27 17:53:21.990429 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.990387    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-bbkd5" event={"ID":"413147d8-aab1-4e5f-99ca-a48a55dc5f26","Type":"ContainerStarted","Data":"ff3cb92e527fb6660489f8558ad9110f4545b982219a1e872f619151ebc90260"}
May 27 17:53:21.991473 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:21.991448    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-bf5wq" event={"ID":"91caa464-d96b-4af7-a428-c788812da701","Type":"ContainerStarted","Data":"60adabeadd613366072aa54a149f60fc8aafcf1240ef04e52345cdb3a51fb194"}
May 27 17:53:25.005077 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.004984    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-bbkd5" event={"ID":"413147d8-aab1-4e5f-99ca-a48a55dc5f26","Type":"ContainerStarted","Data":"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"}
May 27 17:53:25.005541 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.005142    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:25.006458 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.006408    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-bf5wq" event={"ID":"91caa464-d96b-4af7-a428-c788812da701","Type":"ContainerStarted","Data":"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"}
May 27 17:53:25.006579 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.006542    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:25.032561 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.032075    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5485687775-bbkd5" podStartSLOduration=1.369611919 podStartE2EDuration="4.03206147s" podCreationTimestamp="2026-05-27 17:53:21 +0000 UTC" firstStartedPulling="2026-05-27 17:53:21.950828293 +0000 UTC m=+612.542676250" lastFinishedPulling="2026-05-27 17:53:24.613277832 +0000 UTC m=+615.205125801" observedRunningTime="2026-05-27 17:53:25.031692396 +0000 UTC m=+615.623540375" watchObservedRunningTime="2026-05-27 17:53:25.03206147 +0000 UTC m=+615.623909462"
May 27 17:53:25.048777 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:25.048737    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-766d766d75-bf5wq" podStartSLOduration=1.217819497 podStartE2EDuration="4.048725678s" podCreationTimestamp="2026-05-27 17:53:21 +0000 UTC" firstStartedPulling="2026-05-27 17:53:21.772050363 +0000 UTC m=+612.363898320" lastFinishedPulling="2026-05-27 17:53:24.602956531 +0000 UTC m=+615.194804501" observedRunningTime="2026-05-27 17:53:25.047627277 +0000 UTC m=+615.639475279" watchObservedRunningTime="2026-05-27 17:53:25.048725678 +0000 UTC m=+615.640573655"
May 27 17:53:36.015988 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.015953    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:53:36.016492 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.016337    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:36.073781 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.073751    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:36.073961 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.073939    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-766d766d75-bf5wq" podUID="91caa464-d96b-4af7-a428-c788812da701" containerName="manager" containerID="cri-o://924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac" gracePeriod=30
May 27 17:53:36.320346 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.320322    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:36.441339 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.441310    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck9gl\" (UniqueName: \"kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl\") pod \"91caa464-d96b-4af7-a428-c788812da701\" (UID: \"91caa464-d96b-4af7-a428-c788812da701\") "
May 27 17:53:36.443509 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.443481    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl" (OuterVolumeSpecName: "kube-api-access-ck9gl") pod "91caa464-d96b-4af7-a428-c788812da701" (UID: "91caa464-d96b-4af7-a428-c788812da701"). InnerVolumeSpecName "kube-api-access-ck9gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:53:36.542701 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:36.542657    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck9gl\" (UniqueName: \"kubernetes.io/projected/91caa464-d96b-4af7-a428-c788812da701-kube-api-access-ck9gl\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:53:37.046560 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.046524    2549 generic.go:358] "Generic (PLEG): container finished" podID="91caa464-d96b-4af7-a428-c788812da701" containerID="924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac" exitCode=0
May 27 17:53:37.046956 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.046590    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-bf5wq"
May 27 17:53:37.046956 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.046611    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-bf5wq" event={"ID":"91caa464-d96b-4af7-a428-c788812da701","Type":"ContainerDied","Data":"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"}
May 27 17:53:37.046956 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.046652    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-bf5wq" event={"ID":"91caa464-d96b-4af7-a428-c788812da701","Type":"ContainerDied","Data":"60adabeadd613366072aa54a149f60fc8aafcf1240ef04e52345cdb3a51fb194"}
May 27 17:53:37.046956 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.046668    2549 scope.go:117] "RemoveContainer" containerID="924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"
May 27 17:53:37.055514 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.055486    2549 scope.go:117] "RemoveContainer" containerID="924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"
May 27 17:53:37.055766 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:53:37.055746    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac\": container with ID starting with 924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac not found: ID does not exist" containerID="924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"
May 27 17:53:37.055830 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.055775    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac"} err="failed to get container status \"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac\": rpc error: code = NotFound desc = could not find container \"924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac\": container with ID starting with 924b283ecfcd1450c177d54311d6512ea0e513aa70c4c4860b0b38b747175aac not found: ID does not exist"
May 27 17:53:37.070652 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.070633    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:37.075586 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.075566    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-766d766d75-bf5wq"]
May 27 17:53:37.975936 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:37.975894    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91caa464-d96b-4af7-a428-c788812da701" path="/var/lib/kubelet/pods/91caa464-d96b-4af7-a428-c788812da701/volumes"
May 27 17:53:55.831557 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.831527    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5699856b9f-fb8tr"]
May 27 17:53:55.835789 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.831851    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91caa464-d96b-4af7-a428-c788812da701" containerName="manager"
May 27 17:53:55.835789 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.831862    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="91caa464-d96b-4af7-a428-c788812da701" containerName="manager"
May 27 17:53:55.835789 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.831923    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="91caa464-d96b-4af7-a428-c788812da701" containerName="manager"
May 27 17:53:55.835917 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.835795    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:55.838055 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.838035    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 27 17:53:55.838187 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.838170    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bvb88\""
May 27 17:53:55.844713 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.844691    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5699856b9f-fb8tr"]
May 27 17:53:55.898498 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.898472    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:55.898655 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.898541    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdgq\" (UniqueName: \"kubernetes.io/projected/88edd2d7-3f46-4ccd-818c-66356edcbe7d-kube-api-access-7fdgq\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:55.999465 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.999411    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:55.999616 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:55.999498    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdgq\" (UniqueName: \"kubernetes.io/projected/88edd2d7-3f46-4ccd-818c-66356edcbe7d-kube-api-access-7fdgq\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:55.999616 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:53:55.999544    2549 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 27 17:53:55.999616 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:53:55.999608    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls podName:88edd2d7-3f46-4ccd-818c-66356edcbe7d nodeName:}" failed. No retries permitted until 2026-05-27 17:53:56.499588053 +0000 UTC m=+647.091436023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls") pod "maas-api-5699856b9f-fb8tr" (UID: "88edd2d7-3f46-4ccd-818c-66356edcbe7d") : secret "maas-api-serving-cert" not found
May 27 17:53:56.011792 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.011765    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdgq\" (UniqueName: \"kubernetes.io/projected/88edd2d7-3f46-4ccd-818c-66356edcbe7d-kube-api-access-7fdgq\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:56.183792 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.183707    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k2sds"]
May 27 17:53:56.186561 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.186540    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:56.188440 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.188409    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 27 17:53:56.197232 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.197198    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k2sds"]
May 27 17:53:56.201637 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.201616    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dh9\" (UniqueName: \"kubernetes.io/projected/d26ed89b-654e-4e95-8217-091ce5b83393-kube-api-access-n5dh9\") pod \"payload-processing-58b6c8fdc7-k2sds\" (UID: \"d26ed89b-654e-4e95-8217-091ce5b83393\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:56.302517 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.302485    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dh9\" (UniqueName: \"kubernetes.io/projected/d26ed89b-654e-4e95-8217-091ce5b83393-kube-api-access-n5dh9\") pod \"payload-processing-58b6c8fdc7-k2sds\" (UID: \"d26ed89b-654e-4e95-8217-091ce5b83393\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:56.311406 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.311372    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dh9\" (UniqueName: \"kubernetes.io/projected/d26ed89b-654e-4e95-8217-091ce5b83393-kube-api-access-n5dh9\") pod \"payload-processing-58b6c8fdc7-k2sds\" (UID: \"d26ed89b-654e-4e95-8217-091ce5b83393\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:56.497740 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.497647    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:56.503784 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.503743    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:56.506061 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.506040    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88edd2d7-3f46-4ccd-818c-66356edcbe7d-maas-api-tls\") pod \"maas-api-5699856b9f-fb8tr\" (UID: \"88edd2d7-3f46-4ccd-818c-66356edcbe7d\") " pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:56.641073 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.641042    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-k2sds"]
May 27 17:53:56.647639 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:53:56.647610    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26ed89b_654e_4e95_8217_091ce5b83393.slice/crio-5eeb22e58440d3e10bb427f75582e83fbffff00b9a285028e3eef05b1a79daca WatchSource:0}: Error finding container 5eeb22e58440d3e10bb427f75582e83fbffff00b9a285028e3eef05b1a79daca: Status 404 returned error can't find the container with id 5eeb22e58440d3e10bb427f75582e83fbffff00b9a285028e3eef05b1a79daca
May 27 17:53:56.747576 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.747549    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:56.873513 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:56.873488    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5699856b9f-fb8tr"]
May 27 17:53:56.875218 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:53:56.875193    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88edd2d7_3f46_4ccd_818c_66356edcbe7d.slice/crio-24d6ae8d4d12a7310e545b80839bc682e9b3a5244060620ce24b8f8c436bf3e7 WatchSource:0}: Error finding container 24d6ae8d4d12a7310e545b80839bc682e9b3a5244060620ce24b8f8c436bf3e7: Status 404 returned error can't find the container with id 24d6ae8d4d12a7310e545b80839bc682e9b3a5244060620ce24b8f8c436bf3e7
May 27 17:53:57.113011 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:57.112974    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5699856b9f-fb8tr" event={"ID":"88edd2d7-3f46-4ccd-818c-66356edcbe7d","Type":"ContainerStarted","Data":"24d6ae8d4d12a7310e545b80839bc682e9b3a5244060620ce24b8f8c436bf3e7"}
May 27 17:53:57.113914 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:57.113885    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds" event={"ID":"d26ed89b-654e-4e95-8217-091ce5b83393","Type":"ContainerStarted","Data":"5eeb22e58440d3e10bb427f75582e83fbffff00b9a285028e3eef05b1a79daca"}
May 27 17:53:59.124296 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.124258    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5699856b9f-fb8tr" event={"ID":"88edd2d7-3f46-4ccd-818c-66356edcbe7d","Type":"ContainerStarted","Data":"25f906e4b5486925bd4458af8efb3ffd00ff50d1d927dc5854116087c952abdc"}
May 27 17:53:59.124744 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.124381    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:53:59.125757 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.125735    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds" event={"ID":"d26ed89b-654e-4e95-8217-091ce5b83393","Type":"ContainerStarted","Data":"c3b3c2c6fe7347f5b9dc5ca4d48743c94ecd0962cdafc811616045b531dcd955"}
May 27 17:53:59.125854 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.125787    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:53:59.143971 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.143923    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5699856b9f-fb8tr" podStartSLOduration=2.307172979 podStartE2EDuration="4.14391149s" podCreationTimestamp="2026-05-27 17:53:55 +0000 UTC" firstStartedPulling="2026-05-27 17:53:56.876657138 +0000 UTC m=+647.468505094" lastFinishedPulling="2026-05-27 17:53:58.713395649 +0000 UTC m=+649.305243605" observedRunningTime="2026-05-27 17:53:59.14158871 +0000 UTC m=+649.733436723" watchObservedRunningTime="2026-05-27 17:53:59.14391149 +0000 UTC m=+649.735759467"
May 27 17:53:59.157773 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:53:59.157727    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds" podStartSLOduration=1.096096013 podStartE2EDuration="3.157712622s" podCreationTimestamp="2026-05-27 17:53:56 +0000 UTC" firstStartedPulling="2026-05-27 17:53:56.649166982 +0000 UTC m=+647.241014955" lastFinishedPulling="2026-05-27 17:53:58.710783604 +0000 UTC m=+649.302631564" observedRunningTime="2026-05-27 17:53:59.15557779 +0000 UTC m=+649.747425768" watchObservedRunningTime="2026-05-27 17:53:59.157712622 +0000 UTC m=+649.749560601"
May 27 17:54:05.134375 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:05.134347    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5699856b9f-fb8tr"
May 27 17:54:10.130406 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:10.130382    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-k2sds"
May 27 17:54:21.989881 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.989850    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"]
May 27 17:54:21.993301 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.993280    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:21.997182 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.997163    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 17:54:21.997449 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.997406    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8lks5\""
May 27 17:54:21.997449 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.997449    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 27 17:54:21.997615 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:21.997487    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 17:54:22.005959 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.005940    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"]
May 27 17:54:22.119099 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119065    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.119244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119120    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.119244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119148    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.119244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119171    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ghfq\" (UniqueName: \"kubernetes.io/projected/46dde8c0-8291-415e-8335-c50903152ae8-kube-api-access-5ghfq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.119244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.119244 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.119222    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46dde8c0-8291-415e-8335-c50903152ae8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220665 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220605    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220669    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220696    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220726    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ghfq\" (UniqueName: \"kubernetes.io/projected/46dde8c0-8291-415e-8335-c50903152ae8-kube-api-access-5ghfq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220765    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.220838 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.220788    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46dde8c0-8291-415e-8335-c50903152ae8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.221773 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.221717    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.221899 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.221783    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.222214 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.222186    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.227871 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.227851    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46dde8c0-8291-415e-8335-c50903152ae8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.229836 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.229812    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46dde8c0-8291-415e-8335-c50903152ae8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.230529 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.230507    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ghfq\" (UniqueName: \"kubernetes.io/projected/46dde8c0-8291-415e-8335-c50903152ae8-kube-api-access-5ghfq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk\" (UID: \"46dde8c0-8291-415e-8335-c50903152ae8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.303570 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.303545    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:22.439207 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:22.439180    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"]
May 27 17:54:22.441253 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:54:22.441223    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dde8c0_8291_415e_8335_c50903152ae8.slice/crio-1147f3d765aa5203bc1bf4c491f860ce05fb4b5ea9602d9fc1a1c52eab0fb947 WatchSource:0}: Error finding container 1147f3d765aa5203bc1bf4c491f860ce05fb4b5ea9602d9fc1a1c52eab0fb947: Status 404 returned error can't find the container with id 1147f3d765aa5203bc1bf4c491f860ce05fb4b5ea9602d9fc1a1c52eab0fb947
May 27 17:54:23.216194 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:23.216159    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk" event={"ID":"46dde8c0-8291-415e-8335-c50903152ae8","Type":"ContainerStarted","Data":"1147f3d765aa5203bc1bf4c491f860ce05fb4b5ea9602d9fc1a1c52eab0fb947"}
May 27 17:54:28.243069 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:28.243033    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk" event={"ID":"46dde8c0-8291-415e-8335-c50903152ae8","Type":"ContainerStarted","Data":"391cd8611a2628c5a9cf7a562e1b5bc4be101c97830b14e91d81328dc0fc54eb"}
May 27 17:54:33.261523 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:33.261489    2549 generic.go:358] "Generic (PLEG): container finished" podID="46dde8c0-8291-415e-8335-c50903152ae8" containerID="391cd8611a2628c5a9cf7a562e1b5bc4be101c97830b14e91d81328dc0fc54eb" exitCode=0
May 27 17:54:33.261865 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:33.261562    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk" event={"ID":"46dde8c0-8291-415e-8335-c50903152ae8","Type":"ContainerDied","Data":"391cd8611a2628c5a9cf7a562e1b5bc4be101c97830b14e91d81328dc0fc54eb"}
May 27 17:54:35.272235 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:35.272201    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk" event={"ID":"46dde8c0-8291-415e-8335-c50903152ae8","Type":"ContainerStarted","Data":"f94a9ac9cc8c4d85730f970cfaf5992979966381cafff2abf66c097082ee086f"}
May 27 17:54:35.272653 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:35.272453    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:54:35.289833 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:35.289789    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk" podStartSLOduration=2.372051299 podStartE2EDuration="14.289777421s" podCreationTimestamp="2026-05-27 17:54:21 +0000 UTC" firstStartedPulling="2026-05-27 17:54:22.443516281 +0000 UTC m=+673.035364237" lastFinishedPulling="2026-05-27 17:54:34.361242403 +0000 UTC m=+684.953090359" observedRunningTime="2026-05-27 17:54:35.28838838 +0000 UTC m=+685.880236383" watchObservedRunningTime="2026-05-27 17:54:35.289777421 +0000 UTC m=+685.881625403"
May 27 17:54:46.289013 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:54:46.288978    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk"
May 27 17:55:06.075390 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.075354    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"]
May 27 17:55:06.098887 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.098850    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"]
May 27 17:55:06.099346 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.099323    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.103445 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.102984    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 27 17:55:06.197757 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197721    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.197757 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197759    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.197953 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197795    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.197953 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32bf3268-176f-427f-93f0-b55471408149-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.197953 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197874    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgjj\" (UniqueName: \"kubernetes.io/projected/32bf3268-176f-427f-93f0-b55471408149-kube-api-access-swgjj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.197953 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.197892    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.298978 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.298942    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299151 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.298986    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32bf3268-176f-427f-93f0-b55471408149-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299151 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299035    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swgjj\" (UniqueName: \"kubernetes.io/projected/32bf3268-176f-427f-93f0-b55471408149-kube-api-access-swgjj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299151 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299063    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299312 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299150    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299312 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299174    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299409 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299376    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299525 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299468    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.299633 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.299615    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.301162 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.301138    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32bf3268-176f-427f-93f0-b55471408149-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.301443 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.301395    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32bf3268-176f-427f-93f0-b55471408149-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.306604 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.306588    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgjj\" (UniqueName: \"kubernetes.io/projected/32bf3268-176f-427f-93f0-b55471408149-kube-api-access-swgjj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd\" (UID: \"32bf3268-176f-427f-93f0-b55471408149\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.417505 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.417403    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:06.560402 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.560378    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"]
May 27 17:55:06.562184 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:55:06.562155    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bf3268_176f_427f_93f0_b55471408149.slice/crio-a0efe0bb68d60ab0cfe200b29b0487e3b659cc82a67166a34cf94c6bca869600 WatchSource:0}: Error finding container a0efe0bb68d60ab0cfe200b29b0487e3b659cc82a67166a34cf94c6bca869600: Status 404 returned error can't find the container with id a0efe0bb68d60ab0cfe200b29b0487e3b659cc82a67166a34cf94c6bca869600
May 27 17:55:06.563914 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:06.563896    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:55:07.382952 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:07.382915    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd" event={"ID":"32bf3268-176f-427f-93f0-b55471408149","Type":"ContainerStarted","Data":"200a0cff60288c8c766c434467a6de6a74d71726cf5562b45a478dc0fccd7002"}
May 27 17:55:07.382952 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:07.382954    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd" event={"ID":"32bf3268-176f-427f-93f0-b55471408149","Type":"ContainerStarted","Data":"a0efe0bb68d60ab0cfe200b29b0487e3b659cc82a67166a34cf94c6bca869600"}
May 27 17:55:12.402157 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:12.402124    2549 generic.go:358] "Generic (PLEG): container finished" podID="32bf3268-176f-427f-93f0-b55471408149" containerID="200a0cff60288c8c766c434467a6de6a74d71726cf5562b45a478dc0fccd7002" exitCode=0
May 27 17:55:12.402542 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:12.402197    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd" event={"ID":"32bf3268-176f-427f-93f0-b55471408149","Type":"ContainerDied","Data":"200a0cff60288c8c766c434467a6de6a74d71726cf5562b45a478dc0fccd7002"}
May 27 17:55:13.407005 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:13.406974    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd" event={"ID":"32bf3268-176f-427f-93f0-b55471408149","Type":"ContainerStarted","Data":"cb1165c0865dc2e840aa47d0ad4b773c588a2fd3c3e32c7b1226e425f69001c1"}
May 27 17:55:13.407392 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:13.407194    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:55:13.427920 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:13.426282    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd" podStartSLOduration=7.148938301 podStartE2EDuration="7.42626735s" podCreationTimestamp="2026-05-27 17:55:06 +0000 UTC" firstStartedPulling="2026-05-27 17:55:12.402837725 +0000 UTC m=+722.994685680" lastFinishedPulling="2026-05-27 17:55:12.680166773 +0000 UTC m=+723.272014729" observedRunningTime="2026-05-27 17:55:13.424867313 +0000 UTC m=+724.016715314" watchObservedRunningTime="2026-05-27 17:55:13.42626735 +0000 UTC m=+724.018115329"
May 27 17:55:24.425223 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:55:24.425123    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd"
May 27 17:57:25.080438 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.080390    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:57:25.080991 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.080635    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5485687775-bbkd5" podUID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" containerName="manager" containerID="cri-o://aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1" gracePeriod=30
May 27 17:57:25.333903 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.333843    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:57:25.389186 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.389155    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5f4k\" (UniqueName: \"kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k\") pod \"413147d8-aab1-4e5f-99ca-a48a55dc5f26\" (UID: \"413147d8-aab1-4e5f-99ca-a48a55dc5f26\") "
May 27 17:57:25.391269 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.391242    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k" (OuterVolumeSpecName: "kube-api-access-f5f4k") pod "413147d8-aab1-4e5f-99ca-a48a55dc5f26" (UID: "413147d8-aab1-4e5f-99ca-a48a55dc5f26"). InnerVolumeSpecName "kube-api-access-f5f4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:57:25.490711 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.490681    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5f4k\" (UniqueName: \"kubernetes.io/projected/413147d8-aab1-4e5f-99ca-a48a55dc5f26-kube-api-access-f5f4k\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\""
May 27 17:57:25.874090 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.874054    2549 generic.go:358] "Generic (PLEG): container finished" podID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" containerID="aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1" exitCode=0
May 27 17:57:25.874256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.874120    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-bbkd5"
May 27 17:57:25.874256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.874139    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-bbkd5" event={"ID":"413147d8-aab1-4e5f-99ca-a48a55dc5f26","Type":"ContainerDied","Data":"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"}
May 27 17:57:25.874256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.874177    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-bbkd5" event={"ID":"413147d8-aab1-4e5f-99ca-a48a55dc5f26","Type":"ContainerDied","Data":"ff3cb92e527fb6660489f8558ad9110f4545b982219a1e872f619151ebc90260"}
May 27 17:57:25.874256 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.874193    2549 scope.go:117] "RemoveContainer" containerID="aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"
May 27 17:57:25.883227 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.883210    2549 scope.go:117] "RemoveContainer" containerID="aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"
May 27 17:57:25.883479 ip-10-0-135-90 kubenswrapper[2549]: E0527 17:57:25.883456    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1\": container with ID starting with aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1 not found: ID does not exist" containerID="aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"
May 27 17:57:25.883536 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.883491    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1"} err="failed to get container status \"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1\": rpc error: code = NotFound desc = could not find container \"aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1\": container with ID starting with aa648994f1e1ddee08759846f06fefdbd25cf953266e25aab292dc8711cb01b1 not found: ID does not exist"
May 27 17:57:25.920150 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.920121    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:57:25.939038 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.939013    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5485687775-bbkd5"]
May 27 17:57:25.976123 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:25.976097    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" path="/var/lib/kubelet/pods/413147d8-aab1-4e5f-99ca-a48a55dc5f26/volumes"
May 27 17:57:26.782786 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.782755    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5485687775-54cb4"]
May 27 17:57:26.783154 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.783120    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" containerName="manager"
May 27 17:57:26.783154 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.783130    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" containerName="manager"
May 27 17:57:26.783221 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.783188    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="413147d8-aab1-4e5f-99ca-a48a55dc5f26" containerName="manager"
May 27 17:57:26.787564 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.787544    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:26.795265 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.795249    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8rmq\""
May 27 17:57:26.795395 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.795380    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 27 17:57:26.800574 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.800554    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqv2z\" (UniqueName: \"kubernetes.io/projected/cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7-kube-api-access-rqv2z\") pod \"maas-controller-5485687775-54cb4\" (UID: \"cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7\") " pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:26.805311 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.805290    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5485687775-54cb4"]
May 27 17:57:26.901212 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.901184    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqv2z\" (UniqueName: \"kubernetes.io/projected/cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7-kube-api-access-rqv2z\") pod \"maas-controller-5485687775-54cb4\" (UID: \"cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7\") " pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:26.924599 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:26.924576    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqv2z\" (UniqueName: \"kubernetes.io/projected/cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7-kube-api-access-rqv2z\") pod \"maas-controller-5485687775-54cb4\" (UID: \"cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7\") " pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:27.097489 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:27.097377    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:27.239174 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:27.239151    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5485687775-54cb4"]
May 27 17:57:27.240882 ip-10-0-135-90 kubenswrapper[2549]: W0527 17:57:27.240854    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf7a6a3_b063_4b8b_8509_6a6f0457b3a7.slice/crio-331de4a4cf2e6173fdd01cbbc7f9c8d3bb5ce09fd509484e090b457ee152acfc WatchSource:0}: Error finding container 331de4a4cf2e6173fdd01cbbc7f9c8d3bb5ce09fd509484e090b457ee152acfc: Status 404 returned error can't find the container with id 331de4a4cf2e6173fdd01cbbc7f9c8d3bb5ce09fd509484e090b457ee152acfc
May 27 17:57:27.882328 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:27.882307    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-54cb4" event={"ID":"cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7","Type":"ContainerStarted","Data":"331de4a4cf2e6173fdd01cbbc7f9c8d3bb5ce09fd509484e090b457ee152acfc"}
May 27 17:57:28.886817 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:28.886785    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5485687775-54cb4" event={"ID":"cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7","Type":"ContainerStarted","Data":"2a15a5a3ce0d51998b6e135a1704e6691c41a89af51754eb3e0599d6d982a3a1"}
May 27 17:57:28.887179 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:28.886889    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:57:28.926830 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:28.926786    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5485687775-54cb4" podStartSLOduration=2.291039348 podStartE2EDuration="2.926768634s" podCreationTimestamp="2026-05-27 17:57:26 +0000 UTC" firstStartedPulling="2026-05-27 17:57:27.242588341 +0000 UTC m=+857.834436297" lastFinishedPulling="2026-05-27 17:57:27.878317628 +0000 UTC m=+858.470165583" observedRunningTime="2026-05-27 17:57:28.924685023 +0000 UTC m=+859.516533001" watchObservedRunningTime="2026-05-27 17:57:28.926768634 +0000 UTC m=+859.518616642"
May 27 17:57:39.897043 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:57:39.897014    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5485687775-54cb4"
May 27 17:58:09.940350 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:58:09.940321    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:58:09.941388 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:58:09.941369    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 17:58:09.944882 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:58:09.944867    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 17:58:09.946033 ip-10-0-135-90 kubenswrapper[2549]: I0527 17:58:09.946016    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:03:09.964800 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:03:09.964771    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:03:09.966923 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:03:09.966895    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:03:09.969610 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:03:09.969591    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:03:09.972029 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:03:09.972008    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:08:09.988658 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:08:09.988628    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:08:09.993369 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:08:09.993349    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:08:09.994402 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:08:09.994385    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:08:09.998819 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:08:09.998804    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:13:10.015539 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:13:10.015509    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:13:10.019471 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:13:10.019451    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:13:10.020353 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:13:10.020333    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:13:10.023989 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:13:10.023972    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:18:10.038934 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:10.038904    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:18:10.043919 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:10.043895    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:18:10.044319 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:10.044301    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:18:10.048886 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:10.048870    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:18:37.835855 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:37.835828    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5x9fd_4c8b283a-e607-4cbd-a0a6-743857157070/manager/0.log"
May 27 18:18:37.954156 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:37.954128    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5699856b9f-fb8tr_88edd2d7-3f46-4ccd-818c-66356edcbe7d/maas-api/0.log"
May 27 18:18:38.329594 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:38.329565    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5485687775-54cb4_cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7/manager/0.log"
May 27 18:18:38.445831 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:38.445807    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9dcsj_75e2f50c-5c10-4eea-8e4c-27cabe13978e/manager/2.log"
May 27 18:18:38.693091 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:38.693010    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-rhp9f_419a8a0e-3ec8-4ced-a163-8c0adfdd0571/manager/0.log"
May 27 18:18:38.920174 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:38.920143    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-d65v6_53a007cc-823a-4e41-bf78-a8980c5e8d70/postgres/0.log"
May 27 18:18:40.437933 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:40.437900    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-65gkv_17a613c7-33ee-4d20-9348-2befc3a28be7/manager/0.log"
May 27 18:18:41.040573 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:41.040546    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-nb896_8870adac-2920-425e-96dd-f7d625becf8f/manager/0.log"
May 27 18:18:41.491805 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:41.491735    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cg69p_b679c3df-4761-4732-8e41-48b3b0dfdbeb/discovery/0.log"
May 27 18:18:41.703949 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:41.703923    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695c6f7b6-rshgc_b0d208b5-78ad-49af-8f9d-7ea4a5391878/kube-auth-proxy/0.log"
May 27 18:18:41.931680 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:41.931653    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-k2sds_d26ed89b-654e-4e95-8217-091ce5b83393/payload-processing/0.log"
May 27 18:18:42.056028 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:42.056000    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-794b58b6fb-4x6dp_6bc0a4cb-272a-4208-a6ac-0cba4abf1f56/router/0.log"
May 27 18:18:42.395677 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:42.395654    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd_32bf3268-176f-427f-93f0-b55471408149/storage-initializer/0.log"
May 27 18:18:42.402300 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:42.402267    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-m5lzd_32bf3268-176f-427f-93f0-b55471408149/main/0.log"
May 27 18:18:42.740288 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:42.740208    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk_46dde8c0-8291-415e-8335-c50903152ae8/storage-initializer/0.log"
May 27 18:18:42.746875 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:42.746848    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9spgk_46dde8c0-8291-415e-8335-c50903152ae8/main/0.log"
May 27 18:18:49.489529 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:49.489452    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5c6d_19d0e065-7aa7-489d-9a16-06da64ec6832/global-pull-secret-syncer/0.log"
May 27 18:18:49.604095 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:49.604066    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nmtgf_8e23ed83-ee15-4908-8715-ce0068b9544a/konnectivity-agent/0.log"
May 27 18:18:49.669505 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:49.669478    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-90.ec2.internal_5f42337b4f9dd6ac7307e2a872828488/haproxy/0.log"
May 27 18:18:54.181972 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:54.181921    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-65gkv_17a613c7-33ee-4d20-9348-2befc3a28be7/manager/0.log"
May 27 18:18:54.404194 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:54.404157    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-nb896_8870adac-2920-425e-96dd-f7d625becf8f/manager/0.log"
May 27 18:18:56.019209 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:56.019182    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-xx5ls_86ff2b0d-cc49-4db3-a66c-c03a30a884d5/cluster-monitoring-operator/0.log"
May 27 18:18:56.185849 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:56.185825    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79l8m_0e73b9d5-49a8-4209-b22a-7dabf8832d43/node-exporter/0.log"
May 27 18:18:56.211714 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:56.211690    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79l8m_0e73b9d5-49a8-4209-b22a-7dabf8832d43/kube-rbac-proxy/0.log"
May 27 18:18:56.229958 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:56.229940    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79l8m_0e73b9d5-49a8-4209-b22a-7dabf8832d43/init-textfile/0.log"
May 27 18:18:58.022384 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.022345    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"]
May 27 18:18:58.025124 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.025101    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.027281 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.027252    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d9xm9\"/\"default-dockercfg-z8mxt\""
May 27 18:18:58.027905 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.027887    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"kube-root-ca.crt\""
May 27 18:18:58.028045 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.028028    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"openshift-service-ca.crt\""
May 27 18:18:58.034908 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.034885    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"]
May 27 18:18:58.090975 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.090950    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-proc\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.091088 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.090979    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-lib-modules\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.091088 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.091000    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-podres\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.091163 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.091086    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-sys\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.091163 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.091116    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n7fl\" (UniqueName: \"kubernetes.io/projected/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-kube-api-access-5n7fl\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192231 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192207    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-proc\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192331 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192234    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-lib-modules\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192331 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192256    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-podres\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192331 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192291    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-sys\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192331 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192319    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5n7fl\" (UniqueName: \"kubernetes.io/projected/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-kube-api-access-5n7fl\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192506 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192325    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-proc\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192506 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192387    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-podres\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192506 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192387    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-lib-modules\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.192506 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.192434    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-sys\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.202798 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.202773    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n7fl\" (UniqueName: \"kubernetes.io/projected/b29b91d3-ff6f-47bd-b143-ae938e8cadbd-kube-api-access-5n7fl\") pod \"perf-node-gather-daemonset-jtxp6\" (UID: \"b29b91d3-ff6f-47bd-b143-ae938e8cadbd\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.336253 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.336194    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:58.466824 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.466801    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"]
May 27 18:18:58.469478 ip-10-0-135-90 kubenswrapper[2549]: W0527 18:18:58.469450    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb29b91d3_ff6f_47bd_b143_ae938e8cadbd.slice/crio-448c91218b5f5822fd63d0de09a2b97f758b500f6302e688a6e52b76a9296a73 WatchSource:0}: Error finding container 448c91218b5f5822fd63d0de09a2b97f758b500f6302e688a6e52b76a9296a73: Status 404 returned error can't find the container with id 448c91218b5f5822fd63d0de09a2b97f758b500f6302e688a6e52b76a9296a73
May 27 18:18:58.471123 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.471105    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:18:58.508949 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.508901    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/2.log"
May 27 18:18:58.510234 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:58.510218    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-l4676_f19c34b7-b593-44a5-b2bc-52cf747b7cb4/console-operator/3.log"
May 27 18:18:59.362887 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:59.362849    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6" event={"ID":"b29b91d3-ff6f-47bd-b143-ae938e8cadbd","Type":"ContainerStarted","Data":"4bbb8f36df0f4fcac0348047cd1174722a13f4d04b1585da66124cda72c5edeb"}
May 27 18:18:59.363299 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:59.362894    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:18:59.363299 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:59.362911    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6" event={"ID":"b29b91d3-ff6f-47bd-b143-ae938e8cadbd","Type":"ContainerStarted","Data":"448c91218b5f5822fd63d0de09a2b97f758b500f6302e688a6e52b76a9296a73"}
May 27 18:18:59.378638 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:59.378591    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6" podStartSLOduration=1.378578697 podStartE2EDuration="1.378578697s" podCreationTimestamp="2026-05-27 18:18:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:18:59.376925968 +0000 UTC m=+2149.968773948" watchObservedRunningTime="2026-05-27 18:18:59.378578697 +0000 UTC m=+2149.970426674"
May 27 18:18:59.565242 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:18:59.565213    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-77fgf_7fc90da2-4813-4fcd-a33c-9ea72580b95f/volume-data-source-validator/0.log"
May 27 18:19:00.470047 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:00.470017    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zspcl_0fc91952-c036-4b5e-b349-93456b3abdf8/dns/0.log"
May 27 18:19:00.488181 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:00.488154    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zspcl_0fc91952-c036-4b5e-b349-93456b3abdf8/kube-rbac-proxy/0.log"
May 27 18:19:00.508054 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:00.508030    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5g4bm_41d5488e-d6a7-4dfc-87bc-8e2d2eb70965/dns-node-resolver/0.log"
May 27 18:19:01.013872 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:01.013841    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cql8g_1b08ec9b-ac4a-4b41-987d-9de70347f303/node-ca/0.log"
May 27 18:19:01.951290 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:01.951257    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cg69p_b679c3df-4761-4732-8e41-48b3b0dfdbeb/discovery/0.log"
May 27 18:19:01.994451 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:01.994403    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695c6f7b6-rshgc_b0d208b5-78ad-49af-8f9d-7ea4a5391878/kube-auth-proxy/0.log"
May 27 18:19:02.138517 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:02.138488    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-k2sds_d26ed89b-654e-4e95-8217-091ce5b83393/payload-processing/0.log"
May 27 18:19:02.158590 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:02.158571    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-794b58b6fb-4x6dp_6bc0a4cb-272a-4208-a6ac-0cba4abf1f56/router/0.log"
May 27 18:19:02.713987 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:02.713960    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pz6k6_190ab032-7ef0-4a87-9650-1e9b19f43d07/serve-healthcheck-canary/0.log"
May 27 18:19:03.198612 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:03.198582    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-tslgf_52552f61-8016-4cfa-aa8b-f9316be383d9/insights-operator/0.log"
May 27 18:19:03.198959 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:03.198881    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-tslgf_52552f61-8016-4cfa-aa8b-f9316be383d9/insights-operator/1.log"
May 27 18:19:03.282781 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:03.282757    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwq2j_c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8/kube-rbac-proxy/0.log"
May 27 18:19:03.301961 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:03.301940    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwq2j_c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8/exporter/0.log"
May 27 18:19:03.324037 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:03.324021    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwq2j_c99b4fb5-36ee-4305-b1d3-0d9d3d42fef8/extractor/0.log"
May 27 18:19:05.281368 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.281341    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5x9fd_4c8b283a-e607-4cbd-a0a6-743857157070/manager/0.log"
May 27 18:19:05.311727 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.311703    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5699856b9f-fb8tr_88edd2d7-3f46-4ccd-818c-66356edcbe7d/maas-api/0.log"
May 27 18:19:05.377991 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.377966    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-jtxp6"
May 27 18:19:05.421246 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.421212    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5485687775-54cb4_cbf7a6a3-b063-4b8b-8509-6a6f0457b3a7/manager/0.log"
May 27 18:19:05.438995 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.438968    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9dcsj_75e2f50c-5c10-4eea-8e4c-27cabe13978e/manager/1.log"
May 27 18:19:05.450829 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.450808    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9dcsj_75e2f50c-5c10-4eea-8e4c-27cabe13978e/manager/2.log"
May 27 18:19:05.511717 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.511689    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-rhp9f_419a8a0e-3ec8-4ced-a163-8c0adfdd0571/manager/0.log"
May 27 18:19:05.550945 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:05.550887    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-d65v6_53a007cc-823a-4e41-bf78-a8980c5e8d70/postgres/0.log"
May 27 18:19:11.628212 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:11.628119    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sg8pr_09c99d85-4c12-4338-b879-c2b1711f31ac/kube-storage-version-migrator-operator/1.log"
May 27 18:19:11.629277 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:11.629255    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sg8pr_09c99d85-4c12-4338-b879-c2b1711f31ac/kube-storage-version-migrator-operator/0.log"
May 27 18:19:12.833009 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.832985    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/kube-multus-additional-cni-plugins/0.log"
May 27 18:19:12.852490 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.852469    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/egress-router-binary-copy/0.log"
May 27 18:19:12.869958 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.869939    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/cni-plugins/0.log"
May 27 18:19:12.888143 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.888125    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/bond-cni-plugin/0.log"
May 27 18:19:12.906472 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.906453    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/routeoverride-cni/0.log"
May 27 18:19:12.925600 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.925574    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/whereabouts-cni-bincopy/0.log"
May 27 18:19:12.944074 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:12.944052    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p686w_6825fa48-77ad-4e13-bd05-989ea3286425/whereabouts-cni/0.log"
May 27 18:19:13.109807 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:13.109735    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-px84d_f05c9b09-c8be-44fd-8b40-b7b389f73d53/kube-multus/0.log"
May 27 18:19:13.243812 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:13.243788    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbfqq_0c8fe199-56b8-412d-8605-bacecf7343a0/network-metrics-daemon/0.log"
May 27 18:19:13.263013 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:13.262988    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbfqq_0c8fe199-56b8-412d-8605-bacecf7343a0/kube-rbac-proxy/0.log"
May 27 18:19:14.668629 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.668600    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-controller/0.log"
May 27 18:19:14.684953 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.684928    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/0.log"
May 27 18:19:14.694047 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.694027    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovn-acl-logging/1.log"
May 27 18:19:14.710283 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.710264    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/kube-rbac-proxy-node/0.log"
May 27 18:19:14.729953 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.729931    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/kube-rbac-proxy-ovn-metrics/0.log"
May 27 18:19:14.747928 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.747911    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/northd/0.log"
May 27 18:19:14.774666 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.774645    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/nbdb/0.log"
May 27 18:19:14.799117 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.799100    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/sbdb/0.log"
May 27 18:19:14.898098 ip-10-0-135-90 kubenswrapper[2549]: I0527 18:19:14.898066    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcfp_aa5c5c83-c41d-4e60-99e6-9a7ed0a2651c/ovnkube-controller/0.log"