May 27 17:57:42.643135 ip-10-0-139-141 systemd[1]: Starting Kubernetes Kubelet...
May 27 17:57:43.148972 ip-10-0-139-141 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:57:43.148972 ip-10-0-139-141 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 17:57:43.148972 ip-10-0-139-141 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:57:43.148972 ip-10-0-139-141 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 17:57:43.148972 ip-10-0-139-141 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:57:43.151727 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.151628    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 17:57:43.158177 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158158    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:57:43.158177 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158175    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:57:43.158177 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158182    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158186    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158199    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158204    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158207    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158211    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158214    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158218    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158222    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158226    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158229    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158233    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158237    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158241    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158246    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158250    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158254    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158258    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158262    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158266    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:57:43.158371 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158270    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158274    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158279    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158283    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158287    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158291    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158295    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158299    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158304    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158314    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158320    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158325    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158329    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158334    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158339    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158344    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158348    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158352    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158357    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158362    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:57:43.159206 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158366    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158372    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158376    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158380    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158384    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158388    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158392    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158396    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158400    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158405    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158409    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158413    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158417    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158425    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158431    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158436    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158442    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158446    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158452    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:57:43.159954 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158456    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158461    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158465    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158471    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158476    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158480    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158484    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158489    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158493    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158498    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158502    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158506    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158510    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158514    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158522    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158528    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158533    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158537    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158541    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:57:43.160408 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158545    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158550    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158554    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158558    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158562    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.158566    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159233    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159243    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159247    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159252    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159258    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159262    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159267    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159271    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159276    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159280    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159285    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159290    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159294    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159299    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:57:43.161129 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159307    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159313    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159318    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159325    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159330    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159335    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159339    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159343    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159347    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159351    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159355    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159360    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159364    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159368    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159372    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159376    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159380    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159385    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159388    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:57:43.161992 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159392    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159396    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159401    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159405    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159409    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159413    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159418    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159422    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159427    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159431    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159435    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159440    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159446    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159453    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159457    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159461    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159467    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159471    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159475    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159480    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:57:43.162469 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159484    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159488    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159492    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159496    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159500    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159504    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159508    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159512    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159517    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159521    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159525    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159529    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159533    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159537    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159541    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159545    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159549    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159553    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159557    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159561    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:57:43.163071 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159566    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159570    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159574    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159579    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159583    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159588    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159591    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159595    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159599    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159603    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159608    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159612    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.159616    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160549    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160566    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160576    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160584    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160591    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160596    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160603    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160610    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 17:57:43.163664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160614    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160619    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160625    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160630    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160636    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160640    2558 flags.go:64] FLAG: --cgroup-root=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160645    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160650    2558 flags.go:64] FLAG: --client-ca-file=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160655    2558 flags.go:64] FLAG: --cloud-config=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160660    2558 flags.go:64] FLAG: --cloud-provider="external"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160665    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160673    2558 flags.go:64] FLAG: --cluster-domain=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160678    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160683    2558 flags.go:64] FLAG: --config-dir=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160687    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160694    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160700    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160706    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160711    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160716    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160721    2558 flags.go:64] FLAG: --contention-profiling="false"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160726    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160730    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160735    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160740    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 17:57:43.164341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160747    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160752    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160757    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160762    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160766    2558 flags.go:64] FLAG: --enable-server="true"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160771    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160778    2558 flags.go:64] FLAG: --event-burst="100"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160783    2558 flags.go:64] FLAG: --event-qps="50"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160788    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160793    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160798    2558 flags.go:64] FLAG: --eviction-hard=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160804    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160808    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160813    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160818    2558 flags.go:64] FLAG: --eviction-soft=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160825    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160848    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160854    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160858    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160863    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160868    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160873    2558 flags.go:64] FLAG: --feature-gates=""
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160879    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160886    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160891    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 17:57:43.165050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160896    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160902    2558 flags.go:64] FLAG: --healthz-port="10248"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160906    2558 flags.go:64] FLAG: --help="false"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160911    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-139-141.ec2.internal"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160916    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160921    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160925    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160931    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160937    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160942    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160947    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160951    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160956    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160960    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160965    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160970    2558 flags.go:64] FLAG: --kube-reserved=""
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160974    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160979    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160984    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160989    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160994    2558 flags.go:64] FLAG: --lock-file=""
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.160998    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161007    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161013    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 17:57:43.165752 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161022    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161027    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161032    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161036    2558 flags.go:64] FLAG: --logging-format="text"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161041    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161046    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161052    2558 flags.go:64] FLAG: --manifest-url=""
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161057    2558 flags.go:64] FLAG: --manifest-url-header=""
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161064    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161070    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161076    2558 flags.go:64] FLAG: --max-pods="110"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161081    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161086    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161090    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161095    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161100    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161105    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161109    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161120    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161125    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161130    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161135    2558 flags.go:64] FLAG: --pod-cidr=""
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161140    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 17:57:43.166334 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161148    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161152    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161157    2558 flags.go:64] FLAG: --pods-per-core="0"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161162    2558 flags.go:64] FLAG: --port="10250"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161167    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161172    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-092f359acc0a17826"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161177    2558 flags.go:64] FLAG: --qos-reserved=""
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161182    2558 flags.go:64] FLAG: --read-only-port="10255"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161189    2558 flags.go:64] FLAG: --register-node="true"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161194    2558 flags.go:64] FLAG: --register-schedulable="true"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161199    2558 flags.go:64] FLAG: --register-with-taints=""
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161206    2558 flags.go:64] FLAG: --registry-burst="10"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161211    2558 flags.go:64] FLAG: --registry-qps="5"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161216    2558 flags.go:64] FLAG: --reserved-cpus=""
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161220    2558 flags.go:64] FLAG: --reserved-memory=""
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161227    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161232    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161243    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161248    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161253    2558 flags.go:64] FLAG: --runonce="false"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161257    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161263    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161268    2558 flags.go:64] FLAG: --seccomp-default="false"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161273    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161278    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161283    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 17:57:43.166972 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161288    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161293    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161298    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161303    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161308    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161312    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161317    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161322    2558 flags.go:64] FLAG: --system-cgroups=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161327    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161336    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161341    2558 flags.go:64] FLAG: --tls-cert-file=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161345    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161353    2558 flags.go:64] FLAG: --tls-min-version=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161357    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161363    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161368    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161373    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161378    2558 flags.go:64] FLAG: --v="2"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161384    2558 flags.go:64] FLAG: --version="false"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161391    2558 flags.go:64] FLAG: --vmodule=""
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161397    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.161403    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161554    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161561    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:57:43.167600 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161567    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161572    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161577    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161581    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161586    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161591    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161596    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161600    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161605    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161610    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161614    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161618    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161622    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161626    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161631    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161635    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161639    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161643    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161647    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161652    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:57:43.168188 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161656    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161660    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161666    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161670    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161675    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161679    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161685    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161691    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161696    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161700    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161704    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161708    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161712    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161717    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161722    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161726    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161730    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161735    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161739    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161743    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:57:43.168681 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161747    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161751    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161756    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161759    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161764    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161768    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161772    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161776    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161783    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161789    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161794    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161799    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161803    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161811    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161816    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161821    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161825    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161848    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161853    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161858    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:57:43.169197 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161863    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161867    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161871    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161876    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161880    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161884    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161889    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161893    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161898    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161902    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161906    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161910    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161914    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161918    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161922    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161926    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161930    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161934    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161938    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:57:43.169729 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161943    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:57:43.170287 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161947    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:57:43.170287 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161951    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:57:43.170287 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161955    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:57:43.170287 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.161960    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:57:43.170287 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.162725    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:57:43.171724 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.171699    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 17:57:43.171724 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.171721    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171772    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171776    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171780    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171783    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171786    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171789    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171793    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171797    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171800    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171803    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171806    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171809    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171812    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171815    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171817    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171820    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171822    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171825    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171848    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:57:43.171829 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171852    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171855    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171858    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171861    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171864    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171867    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171870    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171873    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171875    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171878    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171880    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171882    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171885    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171887    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171890    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171892    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171895    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171898    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171901    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171903    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:57:43.172365 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171905    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171908    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171910    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171912    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171915    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171917    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171920    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171922    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171924    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171927    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171929    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171932    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171934    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171937    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171940    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171942    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171944    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171947    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171949    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:57:43.172864 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171951    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171954    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171956    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171959    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171961    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171964    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171966    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171969    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171971    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171974    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171976    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171978    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171981    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171983    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171986    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171988    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171991    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171993    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171996    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:57:43.173341 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.171998    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172002    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172006    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172008    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172010    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172013    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172015    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172018    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172020    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.172025    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172119    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172124    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172127    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172130    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172132    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:57:43.173813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172135    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172138    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172140    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172143    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172145    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172147    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172150    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172153    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172155    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172157    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172160    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172162    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172165    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172169    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172172    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172175    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172179    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172182    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172186    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:57:43.174196 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172188    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172190    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172193    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172195    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172198    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172200    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172203    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172206    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172208    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172211    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172214    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172218    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172220    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172223    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172225    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172228    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172230    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172233    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172235    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:57:43.174647 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172237    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172240    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172242    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172244    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172247    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172249    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172252    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172254    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172256    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172259    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172261    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172264    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172268    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172270    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172273    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172275    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172278    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172280    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172282    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172285    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:57:43.175131 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172288    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172290    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172293    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172295    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172297    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172300    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172302    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172305    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172307    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172310    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172312    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172315    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172317    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172319    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172322    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172324    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172326    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172329    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172331    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172333    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:57:43.175658 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172336    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:57:43.176154 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172338    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:57:43.176154 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:43.172340    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:57:43.176154 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.172346    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:57:43.176154 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.173610    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 17:57:43.178615 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.178600    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 17:57:43.180362 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.180349    2558 server.go:1019] "Starting client certificate rotation"
May 27 17:57:43.180470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.180451    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:57:43.180514 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.180499    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:57:43.212779 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.212753    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:57:43.215406 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.215383    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:57:43.245887 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.245860    2558 log.go:25] "Validated CRI v1 runtime API"
May 27 17:57:43.251372 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.251356    2558 log.go:25] "Validated CRI v1 image API"
May 27 17:57:43.253873 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.253857    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 17:57:43.257515 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.257487    2558 fs.go:135] Filesystem UUIDs: map[5c9e84cc-52ce-4f72-ad93-6f8a88bdacea:/dev/nvme0n1p3 5f86ccfd-1c6b-4cc3-a368-d5b3fe47bac0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 27 17:57:43.257605 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.257514    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 17:57:43.258329 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.258313    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:57:43.263195 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.263069    2558 manager.go:217] Machine: {Timestamp:2026-05-27 17:57:43.26251901 +0000 UTC m=+0.486151752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103739 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5ca77cb08c1edaec704d35afcb49 SystemUUID:ec2b5ca7-7cb0-8c1e-daec-704d35afcb49 BootID:fde194a9-2b31-4e8d-81e2-1a2ddec12d16 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:10:40:1e:2c:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:10:40:1e:2c:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:9e:a6:b4:df:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 17:57:43.264050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.264037    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 17:57:43.264178 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.264166    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 17:57:43.266844 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.266797    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 17:57:43.266994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.266847    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 17:57:43.267038 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.267005    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 27 17:57:43.267038 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.267014    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 27 17:57:43.267038 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.267022    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:57:43.268102 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.268090    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:57:43.270205 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.270192    2558 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:57:43.270490 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.270481    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 17:57:43.273014 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.273003    2558 kubelet.go:491] "Attempting to sync node with API server"
May 27 17:57:43.273064 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.273018    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 17:57:43.273064 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.273030    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 17:57:43.273064 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.273040    2558 kubelet.go:397] "Adding apiserver pod source"
May 27 17:57:43.273064 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.273049    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 17:57:43.274261 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.274248    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:57:43.274302 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.274268    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:57:43.278846 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.278811    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 17:57:43.280508 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.280494    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 17:57:43.281985 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.281966    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 17:57:43.281985 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.281983    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 17:57:43.281985 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.281989    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.281997    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282008    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282014    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282020    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282026    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282033    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282039    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282047    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 17:57:43.282127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282052    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 17:57:43.282971 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282960    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 17:57:43.283006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.282991    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 17:57:43.286416 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286403    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 17:57:43.286504 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286440    2558 server.go:1295] "Started kubelet"
May 27 17:57:43.286547 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286515    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 17:57:43.286646 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286569    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 17:57:43.286686 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286674    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 17:57:43.286714 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.286680    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 17:57:43.286745 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.286725    2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 17:57:43.286828 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.286813    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 17:57:43.287164 ip-10-0-139-141 systemd[1]: Started Kubernetes Kubelet.
May 27 17:57:43.288285 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.288264    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 17:57:43.289262 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.289246    2558 server.go:317] "Adding debug handlers to kubelet server"
May 27 17:57:43.295432 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.294441    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18b37ddc653f82f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-05-27 17:57:43.286416118 +0000 UTC m=+0.510048860,LastTimestamp:2026-05-27 17:57:43.286416118 +0000 UTC m=+0.510048860,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
May 27 17:57:43.295566 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.295549    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 17:57:43.296227 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.296181    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 17:57:43.296416 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.296403    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 17:57:43.296512 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.296493    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 17:57:43.296650 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.296637    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 17:57:43.297208 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297194    2558 reconstruct.go:97] "Volume reconstruction finished"
May 27 17:57:43.297330 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297307    2558 reconciler.go:26] "Reconciler: start to sync state"
May 27 17:57:43.297330 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.297193    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.297477 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297433    2558 factory.go:55] Registering systemd factory
May 27 17:57:43.297477 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297449    2558 factory.go:223] Registration of the systemd container factory successfully
May 27 17:57:43.297801 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297780    2558 factory.go:153] Registering CRI-O factory
May 27 17:57:43.297801 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297797    2558 factory.go:223] Registration of the crio container factory successfully
May 27 17:57:43.297938 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297883    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 17:57:43.297938 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297902    2558 factory.go:103] Registering Raw factory
May 27 17:57:43.297938 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.297916    2558 manager.go:1196] Started watching for new ooms in manager
May 27 17:57:43.298109 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.298091    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 17:57:43.300066 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.299202    2558 manager.go:319] Starting recovery of all containers
May 27 17:57:43.302942 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.302916    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 17:57:43.303206 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.303065    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 17:57:43.308711 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.308573    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rszns"
May 27 17:57:43.311929 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.311911    2558 manager.go:324] Recovery completed
May 27 17:57:43.316057 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.316010    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rszns"
May 27 17:57:43.316443 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.316430    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.318478 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.318460    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.318558 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.318497    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.318558 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.318512    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.319098 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.319082    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 17:57:43.319098 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.319096    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 17:57:43.319184 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.319112    2558 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:57:43.320580 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.320513    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18b37ddc6728bfff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-05-27 17:57:43.318478847 +0000 UTC m=+0.542111589,LastTimestamp:2026-05-27 17:57:43.318478847 +0000 UTC m=+0.542111589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
May 27 17:57:43.322460 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.322446    2558 policy_none.go:49] "None policy: Start"
May 27 17:57:43.322526 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.322464    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 17:57:43.322526 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.322475    2558 state_mem.go:35] "Initializing new in-memory state store"
May 27 17:57:43.362436 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362418    2558 manager.go:341] "Starting Device Plugin manager"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.362455    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362470    2558 server.go:85] "Starting device plugin registration server"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362706    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362721    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362811    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362911    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.362920    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.363540    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 17:57:43.384952 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.363590    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.415915 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.415816    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 17:57:43.417384 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.417358    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 17:57:43.417506 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.417396    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 17:57:43.417506 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.417424    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 17:57:43.417506 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.417432    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 17:57:43.417506 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.417467    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 17:57:43.419651 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.419632    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:57:43.463587 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.463549    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.465403 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.465385    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.465516 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.465419    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.465516 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.465433    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.465516 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.465482    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-141.ec2.internal"
May 27 17:57:43.474844 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.474811    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-141.ec2.internal"
May 27 17:57:43.474944 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.474855    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-141.ec2.internal\": node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.498970 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.498941    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.517564 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.517535    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"]
May 27 17:57:43.517662 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.517598    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.520471 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.520454    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.520553 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.520489    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.520553 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.520502    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.521617 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.521605    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.521764 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.521749    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.521806 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.521779    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.522393 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522377    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.522470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522409    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.522470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522420    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.522470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522377    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.522603 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522487    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.522603 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.522504    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.523443 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.523427    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.523519 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.523452    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:57:43.524209 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.524191    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:57:43.524306 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.524218    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:57:43.524306 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.524235    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
May 27 17:57:43.552375 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.552354    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal"
May 27 17:57:43.556733 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.556718    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal"
May 27 17:57:43.599745 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.599710    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.699063 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.698976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.699063 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.699010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.699063 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.699031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25fb5cb1f42738b5be23b63fef28578b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"25fb5cb1f42738b5be23b63fef28578b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.699988 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.699969    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.799702 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799660    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25fb5cb1f42738b5be23b63fef28578b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"25fb5cb1f42738b5be23b63fef28578b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.799702 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799704    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.799894 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799726    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.799894 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799762    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.799894 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799766    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25fb5cb1f42738b5be23b63fef28578b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"25fb5cb1f42738b5be23b63fef28578b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.799894 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.799774    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6970329407e5f588ff8e603bfed2aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"6970329407e5f588ff8e603bfed2aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.800693 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.800677    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:43.853904 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.853861    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.859441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:43.859422    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:43.901329 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:43.901300    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:44.001822 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:44.001741    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:44.102233 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:44.102185    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:44.180425 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.180381    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 17:57:44.180964 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.180569    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 17:57:44.202885 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:44.202852    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:44.295707 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.295678    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 17:57:44.303356 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:44.303315    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
May 27 17:57:44.305391 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.305362    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:57:44.305552 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.305448    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:57:44.319231 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.319190    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 17:52:43 +0000 UTC" deadline="2028-01-05 23:50:02.972690432 +0000 UTC"
May 27 17:57:44.319349 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.319221    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14117h52m18.653472599s"
May 27 17:57:44.330508 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.330480    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thdxm"
May 27 17:57:44.337076 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.337051    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thdxm"
May 27 17:57:44.396491 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.396460    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
May 27 17:57:44.414886 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.414866    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:57:44.417166 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.417146    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
May 27 17:57:44.419737 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:44.419701    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6970329407e5f588ff8e603bfed2aa91.slice/crio-1c8d3ce8799455fd3ed970259d46c5ca9ebfb271eadd34d908c3e5050ca947ab WatchSource:0}: Error finding container 1c8d3ce8799455fd3ed970259d46c5ca9ebfb271eadd34d908c3e5050ca947ab: Status 404 returned error can't find the container with id 1c8d3ce8799455fd3ed970259d46c5ca9ebfb271eadd34d908c3e5050ca947ab
May 27 17:57:44.420024 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:44.419997    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fb5cb1f42738b5be23b63fef28578b.slice/crio-ef4bb94232c212b7eaf1a63098da32a9556f1a6aef4d7aefaf9930c4aa43283b WatchSource:0}: Error finding container ef4bb94232c212b7eaf1a63098da32a9556f1a6aef4d7aefaf9930c4aa43283b: Status 404 returned error can't find the container with id ef4bb94232c212b7eaf1a63098da32a9556f1a6aef4d7aefaf9930c4aa43283b
May 27 17:57:44.423679 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.423580    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:57:44.424015 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.424002    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:57:44.460869 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.460828    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:57:44.679192 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:44.679116    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:57:45.275168 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.275118    2558 apiserver.go:52] "Watching apiserver"
May 27 17:57:45.283269 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.283239    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 17:57:45.287721 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.287683    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-g86lf","kube-system/global-pull-secret-syncer-gjwwm","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w","openshift-image-registry/node-ca-4vzsh","openshift-multus/multus-vkxfg","openshift-ovn-kubernetes/ovnkube-node-mvnx4","kube-system/konnectivity-agent-th6cd","openshift-cluster-node-tuning-operator/tuned-xf46r","openshift-dns/node-resolver-chctj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","openshift-multus/multus-additional-cni-plugins-lczsm","openshift-multus/network-metrics-daemon-dw7lr","openshift-network-diagnostics/network-check-target-bb9km"]
May 27 17:57:45.290783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.290759    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.292748 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.292726    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.292879 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.292799    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:45.293818 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.293794    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 17:57:45.293977 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.293948    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 17:57:45.295238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.294733    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 17:57:45.295238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.294766    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d5gmc\""
May 27 17:57:45.295238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.294965    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 17:57:45.295238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.294978    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 17:57:45.295238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.295145    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 17:57:45.296927 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.296896    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:45.297013 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.296964    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:45.301489 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.301225    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.301489 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.301315    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.303338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303286    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.303685 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303668    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 17:57:45.303758 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303717    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 17:57:45.303758 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303735    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 17:57:45.303895 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303770    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vcnhv\""
May 27 17:57:45.303986 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.303965    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vg9q9\""
May 27 17:57:45.304656 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.304636    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 17:57:45.304656 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.304648    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 17:57:45.304807 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.304794    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 17:57:45.305568 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.305480    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 17:57:45.307266 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.305683    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 17:57:45.307266 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.305754    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 17:57:45.307266 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.305874    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 17:57:45.307266 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.306046    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tkpsb\""
May 27 17:57:45.307470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65wd2\" (UniqueName: \"kubernetes.io/projected/44a4e941-9d7a-4d64-95aa-87f828ef665e-kube-api-access-65wd2\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.307470 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-systemd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-etc-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-node-log\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad910420-8c30-4666-83f6-a15d0166506a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.307985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-registration-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-socket-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-slash\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-log-socket\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-script-lib\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308143    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74w2\" (UniqueName: \"kubernetes.io/projected/ad910420-8c30-4666-83f6-a15d0166506a-kube-api-access-b74w2\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nc2p\" (UniqueName: \"kubernetes.io/projected/7e68f161-aaa9-4d2e-8321-635538a4a777-kube-api-access-2nc2p\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.308328 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-device-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vsqj\" (UniqueName: \"kubernetes.io/projected/cf666ebc-7c3a-494c-9115-9aea111c75b3-kube-api-access-7vsqj\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/44a4e941-9d7a-4d64-95aa-87f828ef665e-serviceca\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44a4e941-9d7a-4d64-95aa-87f828ef665e-host\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-systemd-units\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-var-lib-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-bin\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-kubelet\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308479    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-ovn\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-env-overrides\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-netns\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-netd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-config\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.309210 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.308687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-sys-fs\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.310928 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.310898    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j9ks\""
May 27 17:57:45.311340 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.311171    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 17:57:45.311340 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.311265    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 17:57:45.312679 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.312438    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.314657 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.314636    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 17:57:45.314770 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.314644    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.314968 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.314950    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 17:57:45.315074 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.314799    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vx96v\""
May 27 17:57:45.315216 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.315195    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 17:57:45.317039 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.317014    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.317177 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.317153    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.318584 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.318564    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 17:57:45.318673 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.318591    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 17:57:45.318735 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.318675    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2m7dm\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319253    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.319316    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319350    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319577    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d58xn\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319624    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319659    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nvmwq\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319740    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 17:57:45.319856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.319800    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 17:57:45.337758 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.337714    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:52:44 +0000 UTC" deadline="2028-01-03 09:28:16.831496948 +0000 UTC"
May 27 17:57:45.337867 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.337758    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14055h30m31.493742608s"
May 27 17:57:45.397909 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.397852    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 17:57:45.409555 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409522    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.409717 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409566    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-registration-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.409717 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-systemd\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.409717 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-tuned\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.409717 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409658    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.409717 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-iptables-alerter-script\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409658    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-registration-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409742    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-socket-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-sys\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-host\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-kubelet-config\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409827    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-script-lib\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7h5\" (UniqueName: \"kubernetes.io/projected/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-kube-api-access-cd7h5\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409922    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-socket-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409963    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.409994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.409999    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vsqj\" (UniqueName: \"kubernetes.io/projected/cf666ebc-7c3a-494c-9115-9aea111c75b3-kube-api-access-7vsqj\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-host-slash\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-multus-certs\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410087    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/44a4e941-9d7a-4d64-95aa-87f828ef665e-serviceca\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7c2\" (UniqueName: \"kubernetes.io/projected/5d24cbac-10d6-4c32-9045-3ce79030de11-kube-api-access-2g7c2\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410154    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-var-lib-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-tmp\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cnibin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cni-binary-copy\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6b9m\" (UniqueName: \"kubernetes.io/projected/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-kube-api-access-k6b9m\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-dbus\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410257    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-env-overrides\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-lib-modules\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-k8s-cni-cncf-io\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-bin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.410562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-daemon-config\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.411324 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-etc-kubernetes\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.411324 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410567    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-hosts-file\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.411324 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.410605    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-netd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412008 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.411894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-socket-dir-parent\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.412008 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.411947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-hostroot\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.412008 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.411948    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-script-lib\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412188 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.411991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-conf-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.412188 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412015    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-var-lib-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412269 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412195    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/44a4e941-9d7a-4d64-95aa-87f828ef665e-serviceca\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.412314 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412274    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-netd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412381 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-cnibin\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.412431 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412414    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-systemd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412479 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412448    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-etc-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412522 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412507    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad910420-8c30-4666-83f6-a15d0166506a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412568 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412536    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.412617 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-kubernetes\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.412617 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22286faa-e5de-4229-b9cd-737f501cd9b6-agent-certs\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.412697 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-netns\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.412697 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412680    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-env-overrides\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412780 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412733    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-etc-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.412780 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-tmp-dir\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.412780 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-run\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.412936 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-var-lib-kubelet\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.412936 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cp9t\" (UniqueName: \"kubernetes.io/projected/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-kube-api-access-2cp9t\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.413018 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-kubelet\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.413018 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.412986    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-slash\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413018 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413012    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-log-socket\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413150 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413044    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b74w2\" (UniqueName: \"kubernetes.io/projected/ad910420-8c30-4666-83f6-a15d0166506a-kube-api-access-b74w2\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413150 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413080    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 17:57:45.413150 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413127    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nc2p\" (UniqueName: \"kubernetes.io/projected/7e68f161-aaa9-4d2e-8321-635538a4a777-kube-api-access-2nc2p\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.413276 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413166    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.413276 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413196    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-device-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.413276 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysconfig\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.413276 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-os-release\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-modprobe-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwmf\" (UniqueName: \"kubernetes.io/projected/f8dd8761-fff9-4435-aaa9-d197bdde86c6-kube-api-access-rqwmf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22286faa-e5de-4229-b9cd-737f501cd9b6-konnectivity-ca\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-system-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-multus\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.413441 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-os-release\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.413688 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.413688 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413578    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44a4e941-9d7a-4d64-95aa-87f828ef665e-host\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.413688 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413604    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-systemd-units\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413688 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413635    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-bin\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413688 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413706    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-kubelet\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413737    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413762    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-ovn\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413796    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413798    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-systemd\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413797    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-device-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413872    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413900    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-slash\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.413925 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-binary-copy\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.413981    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-netns\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414010    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-config\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414043    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-sys-fs\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-conf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-system-cni-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414167    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-log-socket\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.414261    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414264    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65wd2\" (UniqueName: \"kubernetes.io/projected/44a4e941-9d7a-4d64-95aa-87f828ef665e-kube-api-access-65wd2\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414300    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.414338 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414339    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-kubelet\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414354    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-node-log\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.414404    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:45.914350815 +0000 UTC m=+3.137983563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414418    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-sys-fs\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414291    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf666ebc-7c3a-494c-9115-9aea111c75b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414305    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-node-log\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414534    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-ovn\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414577    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-cni-bin\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414593    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-host-run-netns\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414664    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-run-openvswitch\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.414872 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.414765    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44a4e941-9d7a-4d64-95aa-87f828ef665e-host\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.415322 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.415059    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad910420-8c30-4666-83f6-a15d0166506a-ovnkube-config\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.415322 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.415159    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad910420-8c30-4666-83f6-a15d0166506a-systemd-units\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.419257 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.419179    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad910420-8c30-4666-83f6-a15d0166506a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.424142 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.424078    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"6970329407e5f588ff8e603bfed2aa91","Type":"ContainerStarted","Data":"1c8d3ce8799455fd3ed970259d46c5ca9ebfb271eadd34d908c3e5050ca947ab"}
May 27 17:57:45.425138 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.425114    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vsqj\" (UniqueName: \"kubernetes.io/projected/cf666ebc-7c3a-494c-9115-9aea111c75b3-kube-api-access-7vsqj\") pod \"aws-ebs-csi-driver-node-2tj9w\" (UID: \"cf666ebc-7c3a-494c-9115-9aea111c75b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.426083 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.425319    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:57:45.426083 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.425350    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:57:45.426083 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.425365    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:45.426083 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.425505    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:45.925440368 +0000 UTC m=+3.149073114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:45.427593 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.427571    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"25fb5cb1f42738b5be23b63fef28578b","Type":"ContainerStarted","Data":"ef4bb94232c212b7eaf1a63098da32a9556f1a6aef4d7aefaf9930c4aa43283b"}
May 27 17:57:45.429631 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.429610    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65wd2\" (UniqueName: \"kubernetes.io/projected/44a4e941-9d7a-4d64-95aa-87f828ef665e-kube-api-access-65wd2\") pod \"node-ca-4vzsh\" (UID: \"44a4e941-9d7a-4d64-95aa-87f828ef665e\") " pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.429923 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.429898    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nc2p\" (UniqueName: \"kubernetes.io/projected/7e68f161-aaa9-4d2e-8321-635538a4a777-kube-api-access-2nc2p\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.430453 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.430433    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74w2\" (UniqueName: \"kubernetes.io/projected/ad910420-8c30-4666-83f6-a15d0166506a-kube-api-access-b74w2\") pod \"ovnkube-node-mvnx4\" (UID: \"ad910420-8c30-4666-83f6-a15d0166506a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.514943 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.514894    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-conf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.514954    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-system-cni-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.514983    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515012    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-systemd\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515039    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-tuned\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515090    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-system-cni-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515101    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-iptables-alerter-script\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.515140 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.515131    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515154    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.515198    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:46.015177292 +0000 UTC m=+3.238810043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515208    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-systemd\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515220    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-sys\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515095    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-conf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515250    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-host\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515276    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-kubelet-config\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515303    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515332    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7h5\" (UniqueName: \"kubernetes.io/projected/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-kube-api-access-cd7h5\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515358    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-host-slash\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515376    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-host\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515383    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-multus-certs\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515423    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-multus-certs\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515424    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515476    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-kubelet-config\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.515485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515461    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7c2\" (UniqueName: \"kubernetes.io/projected/5d24cbac-10d6-4c32-9045-3ce79030de11-kube-api-access-2g7c2\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515521    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-tmp\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515548    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cnibin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515573    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cni-binary-copy\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515574    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysctl-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515600    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6b9m\" (UniqueName: \"kubernetes.io/projected/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-kube-api-access-k6b9m\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515627    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-dbus\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515628    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-iptables-alerter-script\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515637    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515654    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-lib-modules\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515679    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-k8s-cni-cncf-io\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515705    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-bin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515719    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cnibin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515719    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-sys\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515731    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-daemon-config\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515753    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-k8s-cni-cncf-io\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515757    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-etc-kubernetes\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515681    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-host-slash\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.516218 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515678    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515784    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-hosts-file\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515919    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-socket-dir-parent\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515935    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-dbus\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515948    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-hostroot\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515971    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-bin\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.515975    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-conf-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516022    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-hostroot\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516031    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-etc-kubernetes\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516062    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-cnibin\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516111    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-socket-dir-parent\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516131    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-lib-modules\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516144    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-cnibin\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516184    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-kubernetes\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516190    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-conf-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516227    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-hosts-file\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516230    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22286faa-e5de-4229-b9cd-737f501cd9b6-agent-certs\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516248    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-cni-binary-copy\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517037 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516257    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-netns\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516304    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-tmp-dir\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516309    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-run-netns\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516320    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-multus-daemon-config\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516318    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-kubernetes\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516352    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-run\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516380    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-var-lib-kubelet\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516393    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-run\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516407    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cp9t\" (UniqueName: \"kubernetes.io/projected/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-kube-api-access-2cp9t\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516432    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-kubelet\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516442    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-var-lib-kubelet\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516463    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysconfig\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516490    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-os-release\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516504    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-tmp-dir\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516514    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-modprobe-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516558    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-sysconfig\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516573    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwmf\" (UniqueName: \"kubernetes.io/projected/f8dd8761-fff9-4435-aaa9-d197bdde86c6-kube-api-access-rqwmf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516585    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-kubelet\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.517783 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516600    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22286faa-e5de-4229-b9cd-737f501cd9b6-konnectivity-ca\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516627    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-system-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516654    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-multus\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516660    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-modprobe-d\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516679    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-os-release\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516706    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516722    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-os-release\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516736    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516761    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-host-var-lib-cni-multus\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516787    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-os-release\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516920    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-system-cni-dir\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516953    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d24cbac-10d6-4c32-9045-3ce79030de11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.516975    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-binary-copy\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.517347    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.517395    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d24cbac-10d6-4c32-9045-3ce79030de11-cni-binary-copy\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.517497    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22286faa-e5de-4229-b9cd-737f501cd9b6-konnectivity-ca\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.518438    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-tmp\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.518577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.518574    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8dd8761-fff9-4435-aaa9-d197bdde86c6-etc-tuned\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.519171 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.518982    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22286faa-e5de-4229-b9cd-737f501cd9b6-agent-certs\") pod \"konnectivity-agent-th6cd\" (UID: \"22286faa-e5de-4229-b9cd-737f501cd9b6\") " pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.529477 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.529403    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd7h5\" (UniqueName: \"kubernetes.io/projected/1497a690-7d7a-4cc2-aeaf-73907aa1c11d-kube-api-access-cd7h5\") pod \"multus-vkxfg\" (UID: \"1497a690-7d7a-4cc2-aeaf-73907aa1c11d\") " pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.529639 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.529540    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7c2\" (UniqueName: \"kubernetes.io/projected/5d24cbac-10d6-4c32-9045-3ce79030de11-kube-api-access-2g7c2\") pod \"multus-additional-cni-plugins-lczsm\" (UID: \"5d24cbac-10d6-4c32-9045-3ce79030de11\") " pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.529922 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.529902    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwmf\" (UniqueName: \"kubernetes.io/projected/f8dd8761-fff9-4435-aaa9-d197bdde86c6-kube-api-access-rqwmf\") pod \"tuned-xf46r\" (UID: \"f8dd8761-fff9-4435-aaa9-d197bdde86c6\") " pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.530201 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.530176    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6b9m\" (UniqueName: \"kubernetes.io/projected/e8fed2bd-8f58-4021-b8c6-f355e2f010d7-kube-api-access-k6b9m\") pod \"node-resolver-chctj\" (UID: \"e8fed2bd-8f58-4021-b8c6-f355e2f010d7\") " pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.530283 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.530178    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cp9t\" (UniqueName: \"kubernetes.io/projected/8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f-kube-api-access-2cp9t\") pod \"iptables-alerter-g86lf\" (UID: \"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f\") " pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.603321 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.603284    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:57:45.613591 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.613562    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w"
May 27 17:57:45.624455 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.624426    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vzsh"
May 27 17:57:45.631417 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.631400    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkxfg"
May 27 17:57:45.636988 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.636970    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xf46r"
May 27 17:57:45.644508 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.644491    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g86lf"
May 27 17:57:45.654300 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.654061    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:57:45.659677 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.659660    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chctj"
May 27 17:57:45.665241 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.665222    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lczsm"
May 27 17:57:45.719968 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.719937    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:57:45.919235 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:45.919148    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:45.919393 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.919342    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:45.919457 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:45.919437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:46.919415164 +0000 UTC m=+4.143047900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:46.019803 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.019754    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:46.019803 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.019803    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.019914    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.019938    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.019963    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.019975    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.019975    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:47.019956655 +0000 UTC m=+4.243589382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:57:46.020051 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.020040    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:47.020022856 +0000 UTC m=+4.243655590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:46.228962 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.228917    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df6f0e0_e1a9_4e3f_ae81_5fab7e07767f.slice/crio-56654a173ce68ee83b53d8ba0deaade596ebf0982386e1734c624a982a7266be WatchSource:0}: Error finding container 56654a173ce68ee83b53d8ba0deaade596ebf0982386e1734c624a982a7266be: Status 404 returned error can't find the container with id 56654a173ce68ee83b53d8ba0deaade596ebf0982386e1734c624a982a7266be
May 27 17:57:46.234937 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.234900    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1497a690_7d7a_4cc2_aeaf_73907aa1c11d.slice/crio-3733503bfacc541381c7544051628d24be69460db0ba12e71815c3c70b9bb34a WatchSource:0}: Error finding container 3733503bfacc541381c7544051628d24be69460db0ba12e71815c3c70b9bb34a: Status 404 returned error can't find the container with id 3733503bfacc541381c7544051628d24be69460db0ba12e71815c3c70b9bb34a
May 27 17:57:46.237643 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.237533    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a4e941_9d7a_4d64_95aa_87f828ef665e.slice/crio-c5fcc9cb3e25e2363ad08cb626ee56faf76729c81cc18270c43d600f8a0eaffe WatchSource:0}: Error finding container c5fcc9cb3e25e2363ad08cb626ee56faf76729c81cc18270c43d600f8a0eaffe: Status 404 returned error can't find the container with id c5fcc9cb3e25e2363ad08cb626ee56faf76729c81cc18270c43d600f8a0eaffe
May 27 17:57:46.239447 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.239382    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf666ebc_7c3a_494c_9115_9aea111c75b3.slice/crio-d957580692db719ee745c428780f08dd75456285ce90fe799ba12a55994f5522 WatchSource:0}: Error finding container d957580692db719ee745c428780f08dd75456285ce90fe799ba12a55994f5522: Status 404 returned error can't find the container with id d957580692db719ee745c428780f08dd75456285ce90fe799ba12a55994f5522
May 27 17:57:46.239808 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.239773    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22286faa_e5de_4229_b9cd_737f501cd9b6.slice/crio-98b8b0a5e29ade3fadea190dcd773fe69d393108c791636790bb01a99d0550a2 WatchSource:0}: Error finding container 98b8b0a5e29ade3fadea190dcd773fe69d393108c791636790bb01a99d0550a2: Status 404 returned error can't find the container with id 98b8b0a5e29ade3fadea190dcd773fe69d393108c791636790bb01a99d0550a2
May 27 17:57:46.244773 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:57:46.244681    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fed2bd_8f58_4021_b8c6_f355e2f010d7.slice/crio-70ee02ec685744114475eb2cd380f6433ac03aeee4aa1ce77e3e67381d3963a7 WatchSource:0}: Error finding container 70ee02ec685744114475eb2cd380f6433ac03aeee4aa1ce77e3e67381d3963a7: Status 404 returned error can't find the container with id 70ee02ec685744114475eb2cd380f6433ac03aeee4aa1ce77e3e67381d3963a7
May 27 17:57:46.338612 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.338443    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:52:44 +0000 UTC" deadline="2028-03-01 01:38:16.86917835 +0000 UTC"
May 27 17:57:46.338612 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.338610    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15439h40m30.530571595s"
May 27 17:57:46.418083 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.418052    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:46.418260 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.418171    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:46.431532 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.431489    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"25fb5cb1f42738b5be23b63fef28578b","Type":"ContainerStarted","Data":"ab7ebbd6c391557769640a83d19ca7f9d93874a95cdca110f8a34caef32a51a4"}
May 27 17:57:46.432809 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.432778    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chctj" event={"ID":"e8fed2bd-8f58-4021-b8c6-f355e2f010d7","Type":"ContainerStarted","Data":"70ee02ec685744114475eb2cd380f6433ac03aeee4aa1ce77e3e67381d3963a7"}
May 27 17:57:46.433713 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.433687    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-th6cd" event={"ID":"22286faa-e5de-4229-b9cd-737f501cd9b6","Type":"ContainerStarted","Data":"98b8b0a5e29ade3fadea190dcd773fe69d393108c791636790bb01a99d0550a2"}
May 27 17:57:46.434650 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.434630    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xf46r" event={"ID":"f8dd8761-fff9-4435-aaa9-d197bdde86c6","Type":"ContainerStarted","Data":"ef9377502408b153a3e3a115c50cc1e78876967a3e6f7c970cd6d820da300cde"}
May 27 17:57:46.435700 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.435680    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vzsh" event={"ID":"44a4e941-9d7a-4d64-95aa-87f828ef665e","Type":"ContainerStarted","Data":"c5fcc9cb3e25e2363ad08cb626ee56faf76729c81cc18270c43d600f8a0eaffe"}
May 27 17:57:46.436824 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.436803    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkxfg" event={"ID":"1497a690-7d7a-4cc2-aeaf-73907aa1c11d","Type":"ContainerStarted","Data":"3733503bfacc541381c7544051628d24be69460db0ba12e71815c3c70b9bb34a"}
May 27 17:57:46.438005 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.437984    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g86lf" event={"ID":"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f","Type":"ContainerStarted","Data":"56654a173ce68ee83b53d8ba0deaade596ebf0982386e1734c624a982a7266be"}
May 27 17:57:46.440853 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.440816    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerStarted","Data":"2a25c686adc70c06adc01fd898990fca840dfdb8a17bda6273f6ee4f5d824b97"}
May 27 17:57:46.442744 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.442720    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"c0a9e8bc694107a9efb73ff932ca4284c779c40fa465fff794ef1a20154fdaa4"}
May 27 17:57:46.443854 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.443816    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w" event={"ID":"cf666ebc-7c3a-494c-9115-9aea111c75b3","Type":"ContainerStarted","Data":"d957580692db719ee745c428780f08dd75456285ce90fe799ba12a55994f5522"}
May 27 17:57:46.446701 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.446661    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" podStartSLOduration=2.446650237 podStartE2EDuration="2.446650237s" podCreationTimestamp="2026-05-27 17:57:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:57:46.446486109 +0000 UTC m=+3.670118862" watchObservedRunningTime="2026-05-27 17:57:46.446650237 +0000 UTC m=+3.670282987"
May 27 17:57:46.925413 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:46.925303    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:46.925568 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.925458    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:46.925568 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:46.925538    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:48.925515093 +0000 UTC m=+6.149147831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:47.026637 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.026598    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:47.026802 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.026648    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:47.026802 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.026763    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:57:47.026957 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.026855    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:49.02681648 +0000 UTC m=+6.250449225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:57:47.027301 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.027277    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:57:47.027411 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.027305    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:57:47.027411 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.027317    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:47.027411 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.027362    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:49.027346392 +0000 UTC m=+6.250979122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:47.420444 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.420407    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:47.420970 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.420544    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:47.421054 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.420995    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:47.421119 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:47.421102    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:47.457232 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.457191    2558 generic.go:358] "Generic (PLEG): container finished" podID="6970329407e5f588ff8e603bfed2aa91" containerID="3518c4d5d8c0622144a409792c63021410251c4fa250381c16c83c36910f7c3b" exitCode=0
May 27 17:57:47.458108 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:47.458080    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"6970329407e5f588ff8e603bfed2aa91","Type":"ContainerDied","Data":"3518c4d5d8c0622144a409792c63021410251c4fa250381c16c83c36910f7c3b"}
May 27 17:57:48.418524 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:48.417986    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:48.418524 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:48.418120    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:48.471897 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:48.471144    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"6970329407e5f588ff8e603bfed2aa91","Type":"ContainerStarted","Data":"bb575c58ad510032b0cb7f1ea756d0d9b2fd8ddd6231c229de4b93944fa61604"}
May 27 17:57:48.942354 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:48.942314    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:48.942551 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:48.942524    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:48.942620 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:48.942593    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:52.94257288 +0000 UTC m=+10.166205613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:49.042757 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:49.042715    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:49.042958 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:49.042773    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:49.042958 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.042927    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:57:49.043083 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.042992    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:53.042975272 +0000 UTC m=+10.266608007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:57:49.043455 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.043436    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:57:49.043542 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.043460    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:57:49.043542 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.043473    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:49.043542 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.043518    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:57:53.043502513 +0000 UTC m=+10.267135245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:49.418360 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:49.418276    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:49.418523 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.418432    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:49.418889 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:49.418868    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:49.418996 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:49.418973    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:50.417665 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:50.417636    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:50.418089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:50.417736    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:51.420023 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:51.419962    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:51.420443 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:51.420090    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:51.420443 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:51.420397    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:51.420566 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:51.420494    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:52.417909 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:52.417873    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:52.418093 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:52.418004    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:52.978305 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:52.978263    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:52.978790 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:52.978400    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:52.978790 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:52.978462    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:00.978446302 +0000 UTC m=+18.202079036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:53.079559    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:53.079613    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.079740    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.079804    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:01.07978554 +0000 UTC m=+18.303418276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.080229    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.080247    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.080260    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:53.080345 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.080305    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:01.080290003 +0000 UTC m=+18.303922737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:57:53.418548 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:53.418450    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:53.418706 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.418581    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:53.422610 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:53.419037    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:53.422610 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:53.419158    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:54.418088 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:54.417999    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:54.418527 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:54.418109    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:55.421011 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:55.420983    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:55.421404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:55.421103    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:55.421404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:55.421178    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:55.421404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:55.421250    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:56.418134 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:56.418111    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:56.418231 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:56.418214    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:57.426563 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:57.426528    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:57.427008 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:57.426528    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:57.427008 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:57.426682    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:57:57.427008 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:57.426760    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:58.418520 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:58.418480    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:57:58.418714 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:58.418607    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:57:59.420427 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:59.420394    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:57:59.420902 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:57:59.420392    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:57:59.420902 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:59.420530    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:57:59.420902 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:57:59.420597    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:00.418485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:00.418454    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:00.419334 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:00.418573    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:01.043457 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:01.043414    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:01.043961 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.043586    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:58:01.043961 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.043661    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:17.043644414 +0000 UTC m=+34.267277157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:58:01.143990 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:01.143947    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:01.143990 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:01.143994    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144130    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144136    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144158    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144168    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144192    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:17.144171915 +0000 UTC m=+34.367804663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:58:01.144236 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.144214    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:17.144200798 +0000 UTC m=+34.367833526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:58:01.417711 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:01.417633    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:01.417899 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.417759    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:01.417899 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:01.417769    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:01.417899 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:01.417883    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:02.418156 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:02.418106    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:02.418605 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:02.418226    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:03.419244 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:03.419207    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:03.419718 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:03.419317    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:03.419718 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:03.419384    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:03.419718 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:03.419506    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:04.418305 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:04.418264    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:04.418493 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:04.418376    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:05.418466 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.418269    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:05.419084 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.418277    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:05.419084 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:05.418557    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:05.419084 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:05.418616    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:05.501497 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.501408    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vzsh" event={"ID":"44a4e941-9d7a-4d64-95aa-87f828ef665e","Type":"ContainerStarted","Data":"a1042bfdaa41729a68ada43951ef4bf257ddcde34aa704088a818147ef9c0c33"}
May 27 17:58:05.503197 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.503166    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkxfg" event={"ID":"1497a690-7d7a-4cc2-aeaf-73907aa1c11d","Type":"ContainerStarted","Data":"a4554b3314e7e266c1ad1dd498fe7c2ddf45867c9434996f7b3ae155fb683f7f"}
May 27 17:58:05.504759 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.504730    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="bdfb2ab131f455de60f0491839de3607b04e69888259c34102485d285fcf105e" exitCode=0
May 27 17:58:05.505023 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.505000    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"bdfb2ab131f455de60f0491839de3607b04e69888259c34102485d285fcf105e"}
May 27 17:58:05.508244 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508226    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 17:58:05.508655 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508625    2558 generic.go:358] "Generic (PLEG): container finished" podID="ad910420-8c30-4666-83f6-a15d0166506a" containerID="36b3137d9ca6e06cc3219915fbc6f89c8dee653fd452c2acfa47720af1e82a3a" exitCode=1
May 27 17:58:05.508739 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508685    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"ec52a9f474122e442c39249e95f9e3b366eac5f90c09a6e8f90c537eb4650c66"}
May 27 17:58:05.508739 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508706    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"d4afcf0f077f6dfac9700901a37fdeb166875851099cae54fe8085e2b8ff2f29"}
May 27 17:58:05.508739 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508721    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"40c380c7ecfcc3ceb721126de06413790b1ce936de5e0d18a320a44fc7eb156c"}
May 27 17:58:05.508739 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508734    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"8b781e323c1ad1895e818cb170b5141479cae28fde09e3cef6a1cc3f915766cc"}
May 27 17:58:05.508957 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508746    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerDied","Data":"36b3137d9ca6e06cc3219915fbc6f89c8dee653fd452c2acfa47720af1e82a3a"}
May 27 17:58:05.508957 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.508759    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"6bbb6d5822c2eca1ad7616f56d54379346004dd506df6a64148decd87b7487f2"}
May 27 17:58:05.510191 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.510160    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w" event={"ID":"cf666ebc-7c3a-494c-9115-9aea111c75b3","Type":"ContainerStarted","Data":"079274015d11a97e9192e336f7cf425e99bbcca5a6606f33ebea9fd1ca1e6551"}
May 27 17:58:05.511686 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.511653    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chctj" event={"ID":"e8fed2bd-8f58-4021-b8c6-f355e2f010d7","Type":"ContainerStarted","Data":"02bf333fd50f2561b1ca7c144593f2e22f6615a98c20df2259ba43464b5fa1ec"}
May 27 17:58:05.513097 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.513070    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-th6cd" event={"ID":"22286faa-e5de-4229-b9cd-737f501cd9b6","Type":"ContainerStarted","Data":"d46913852bbc7dbf61957bf29d242acc3acf67431df086c256383ceac9ac09f0"}
May 27 17:58:05.514336 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.514314    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xf46r" event={"ID":"f8dd8761-fff9-4435-aaa9-d197bdde86c6","Type":"ContainerStarted","Data":"10ec95dd81a5960508bc89510acde5bba031ed0ed81fc59d356bf59df844bbb3"}
May 27 17:58:05.515335 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.515277    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" podStartSLOduration=21.515267625 podStartE2EDuration="21.515267625s" podCreationTimestamp="2026-05-27 17:57:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:57:48.487939603 +0000 UTC m=+5.711572353" watchObservedRunningTime="2026-05-27 17:58:05.515267625 +0000 UTC m=+22.738900375"
May 27 17:58:05.515649 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.515625    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4vzsh" podStartSLOduration=4.146222991 podStartE2EDuration="22.515618476s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.239028246 +0000 UTC m=+3.462660976" lastFinishedPulling="2026-05-27 17:58:04.608423715 +0000 UTC m=+21.832056461" observedRunningTime="2026-05-27 17:58:05.515142028 +0000 UTC m=+22.738774788" watchObservedRunningTime="2026-05-27 17:58:05.515618476 +0000 UTC m=+22.739251226"
May 27 17:58:05.553018 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.552959    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vkxfg" podStartSLOduration=4.061634243 podStartE2EDuration="22.552940116s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.237873712 +0000 UTC m=+3.461506440" lastFinishedPulling="2026-05-27 17:58:04.729179586 +0000 UTC m=+21.952812313" observedRunningTime="2026-05-27 17:58:05.532787361 +0000 UTC m=+22.756420109" watchObservedRunningTime="2026-05-27 17:58:05.552940116 +0000 UTC m=+22.776572868"
May 27 17:58:05.553320 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.553294    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xf46r" podStartSLOduration=4.08875331 podStartE2EDuration="22.553286872s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.242896377 +0000 UTC m=+3.466529106" lastFinishedPulling="2026-05-27 17:58:04.707429929 +0000 UTC m=+21.931062668" observedRunningTime="2026-05-27 17:58:05.552559329 +0000 UTC m=+22.776192083" watchObservedRunningTime="2026-05-27 17:58:05.553286872 +0000 UTC m=+22.776919623"
May 27 17:58:05.568552 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.568492    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-chctj" podStartSLOduration=4.206243267 podStartE2EDuration="22.568474539s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.246187254 +0000 UTC m=+3.469819982" lastFinishedPulling="2026-05-27 17:58:04.608418527 +0000 UTC m=+21.832051254" observedRunningTime="2026-05-27 17:58:05.566926754 +0000 UTC m=+22.790559492" watchObservedRunningTime="2026-05-27 17:58:05.568474539 +0000 UTC m=+22.792107295"
May 27 17:58:05.916115 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:05.916090    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 17:58:06.378519 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.378380    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:58:05.916110659Z","UUID":"bc33ae44-6adb-4dc1-a825-f2337eabe900","Handler":null,"Name":"","Endpoint":""}
May 27 17:58:06.380367 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.380339    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 17:58:06.380367 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.380379    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 17:58:06.417727 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.417689    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:06.417945 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:06.417814    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:06.518631 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.518561    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w" event={"ID":"cf666ebc-7c3a-494c-9115-9aea111c75b3","Type":"ContainerStarted","Data":"bd10ce2976236681873c321e600bbbc1f34b8d49e160129df26b7fcafdff2fd5"}
May 27 17:58:06.521366 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.520502    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g86lf" event={"ID":"8df6f0e0-e1a9-4e3f-ae81-5fab7e07767f","Type":"ContainerStarted","Data":"609dcaea5c0ab99fd2302b8c043c2f3982b329f5b9970a3704cd70ca24d8cc5c"}
May 27 17:58:06.536450 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.536396    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-th6cd" podStartSLOduration=5.091997202 podStartE2EDuration="23.536378657s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.242981807 +0000 UTC m=+3.466614539" lastFinishedPulling="2026-05-27 17:58:04.687363252 +0000 UTC m=+21.910995994" observedRunningTime="2026-05-27 17:58:05.61755221 +0000 UTC m=+22.841184961" watchObservedRunningTime="2026-05-27 17:58:06.536378657 +0000 UTC m=+23.760011410"
May 27 17:58:06.537058 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:06.536901    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g86lf" podStartSLOduration=5.056588197 podStartE2EDuration="23.536890213s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.233361809 +0000 UTC m=+3.456994536" lastFinishedPulling="2026-05-27 17:58:04.713663816 +0000 UTC m=+21.937296552" observedRunningTime="2026-05-27 17:58:06.536199683 +0000 UTC m=+23.759832435" watchObservedRunningTime="2026-05-27 17:58:06.536890213 +0000 UTC m=+23.760522965"
May 27 17:58:07.418776 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.418252    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:07.418776 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:07.418392    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:07.418776 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.418446    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:07.418776 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:07.418575    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:07.525665 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.525631    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 17:58:07.526131 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.526104    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"1e8f85414af67b42d4553d1b8d8c342496fddbb704bd5ab38ed8fe6142f5fb49"}
May 27 17:58:07.528302 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.528272    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w" event={"ID":"cf666ebc-7c3a-494c-9115-9aea111c75b3","Type":"ContainerStarted","Data":"19613af142e92a79452bc244a653f044d5333d13a4c327ac1f18c3594ee96c5a"}
May 27 17:58:07.548326 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:07.548100    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2tj9w" podStartSLOduration=3.987511279 podStartE2EDuration="24.54808562s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.242359917 +0000 UTC m=+3.465992648" lastFinishedPulling="2026-05-27 17:58:06.802934258 +0000 UTC m=+24.026566989" observedRunningTime="2026-05-27 17:58:07.546310129 +0000 UTC m=+24.769942878" watchObservedRunningTime="2026-05-27 17:58:07.54808562 +0000 UTC m=+24.771718369"
May 27 17:58:08.418127 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:08.417917    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:08.418295 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:08.418212    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:09.418132 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:09.418096    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:09.418132 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:09.418123    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:09.418615 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:09.418231    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:09.418615 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:09.418372    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:10.247664 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.247463    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:58:10.248081 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.248061    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:58:10.418196 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.418084    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:10.418913 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:10.418192    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:10.535679 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.535643    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="6d51d5f3d4b80a2ecf9efaf380bfd11b40d5d06e5913912bc2e52b7f71cf0c2c" exitCode=0
May 27 17:58:10.535821 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.535718    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"6d51d5f3d4b80a2ecf9efaf380bfd11b40d5d06e5913912bc2e52b7f71cf0c2c"}
May 27 17:58:10.538826 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.538802    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 17:58:10.541020 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.540275    2558 scope.go:117] "RemoveContainer" containerID="36b3137d9ca6e06cc3219915fbc6f89c8dee653fd452c2acfa47720af1e82a3a"
May 27 17:58:10.541020 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.540684    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"ca5809b487d8a692b648bcc9fa08fc27316ca95846d61af989fbbeb038e6b017"}
May 27 17:58:10.541020 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.540954    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:10.541020 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.540979    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:10.541020 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.540989    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:10.559948 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.558172    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:10.559948 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:10.558577    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:11.418052 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.418022    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:11.418238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.418033    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:11.418238 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:11.418129    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:11.418515 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:11.418247    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:11.544616 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.544590    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 17:58:11.544926 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.544900    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" event={"ID":"ad910420-8c30-4666-83f6-a15d0166506a","Type":"ContainerStarted","Data":"56d3080bff3f2d3606f4a4fd60875d27661ec6bc3eee94ef00553bba30b74c5b"}
May 27 17:58:11.575655 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.575607    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4" podStartSLOduration=10.09923491 podStartE2EDuration="28.575592793s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.244968118 +0000 UTC m=+3.468600859" lastFinishedPulling="2026-05-27 17:58:04.721326009 +0000 UTC m=+21.944958742" observedRunningTime="2026-05-27 17:58:11.57522734 +0000 UTC m=+28.798860106" watchObservedRunningTime="2026-05-27 17:58:11.575592793 +0000 UTC m=+28.799225554"
May 27 17:58:11.832314 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.832280    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gjwwm"]
May 27 17:58:11.832501 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.832385    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:11.832501 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:11.832486    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:11.835585 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.835550    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bb9km"]
May 27 17:58:11.835725 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.835673    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:11.835789 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:11.835769    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:11.848361 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.848331    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dw7lr"]
May 27 17:58:11.848495 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:11.848458    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:11.848590 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:11.848570    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:12.549119 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:12.549092    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="eead3da7d732022aff6579383d5da95441798f2d68da30482f2579685507489e" exitCode=0
May 27 17:58:12.549436 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:12.549162    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"eead3da7d732022aff6579383d5da95441798f2d68da30482f2579685507489e"}
May 27 17:58:13.418344 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:13.418312    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:13.418507 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:13.418317    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:13.418507 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:13.418439    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:13.418507 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:13.418478    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:13.418507 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:13.418316    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:13.418643 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:13.418556    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:14.555575 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:14.555388    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="2e01e684f4488b7fab32ea8e60acd8ad623affcefd94b6f4eede07186e8df910" exitCode=0
May 27 17:58:14.555575 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:14.555481    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"2e01e684f4488b7fab32ea8e60acd8ad623affcefd94b6f4eede07186e8df910"}
May 27 17:58:15.287349 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.287307    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:58:15.287520 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.287488    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 17:58:15.287949 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.287926    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-th6cd"
May 27 17:58:15.418610 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.418573    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:15.418610 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.418600    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:15.418610 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:15.418620    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:15.418919 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:15.418736    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:15.418919 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:15.418890    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:15.419018 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:15.418982    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:17.062801 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.062769    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:17.063183 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.062930    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:58:17.063183 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.062987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.06297005 +0000 UTC m=+66.286602795 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:58:17.163501 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.163470    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:17.163693 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.163510    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:17.163693 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163627    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:58:17.163693 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163648    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:58:17.163693 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163671    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:58:17.163693 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163683    2558 projected.go:194] Error preparing data for projected volume kube-api-access-xp252 for pod openshift-network-diagnostics/network-check-target-bb9km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:58:17.163933 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163684    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret podName:2ef9f41d-2569-48c2-9edf-4eec3cc66bc9 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.163664684 +0000 UTC m=+66.387297412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret") pod "global-pull-secret-syncer-gjwwm" (UID: "2ef9f41d-2569-48c2-9edf-4eec3cc66bc9") : object "kube-system"/"original-pull-secret" not registered
May 27 17:58:17.163933 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.163744    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252 podName:7be451f3-be23-4f28-8bcc-8d1fa9697ac0 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.163725954 +0000 UTC m=+66.387358684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp252" (UniqueName: "kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252") pod "network-check-target-bb9km" (UID: "7be451f3-be23-4f28-8bcc-8d1fa9697ac0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:58:17.417856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.417809    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:17.417856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.417848    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:17.418094 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.417974    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dw7lr" podUID="7e68f161-aaa9-4d2e-8321-635538a4a777"
May 27 17:58:17.418094 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.417998    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:17.418188 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.418094    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bb9km" podUID="7be451f3-be23-4f28-8bcc-8d1fa9697ac0"
May 27 17:58:17.418188 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.418156    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gjwwm" podUID="2ef9f41d-2569-48c2-9edf-4eec3cc66bc9"
May 27 17:58:17.564684 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.564646    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeReady"
May 27 17:58:17.564892 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.564804    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 17:58:17.599696 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.599655    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b9dfb59d-5zc8r"]
May 27 17:58:17.624062 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.623973    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nphn2"]
May 27 17:58:17.624062 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.624054    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.627686 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.627660    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 17:58:17.628240 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.628219    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vt8dw\""
May 27 17:58:17.628357 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.628224    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 17:58:17.628492 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.628474    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 17:58:17.640101 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.640073    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g7jgg"]
May 27 17:58:17.640266 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.640248    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.643171 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.643144    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfkw\""
May 27 17:58:17.643389 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.643367    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 17:58:17.643615 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.643598    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 17:58:17.647354 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.647154    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 17:58:17.658889 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.658857    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b9dfb59d-5zc8r"]
May 27 17:58:17.658889 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.658891    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nphn2"]
May 27 17:58:17.659056 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.658904    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7jgg"]
May 27 17:58:17.659056 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.659019    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:17.661754 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.661735    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 17:58:17.661916 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.661789    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 17:58:17.661992 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.661861    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mszw7\""
May 27 17:58:17.662070 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.661862    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 17:58:17.767274 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjbm\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767274 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767278    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.767511 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767511 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767511 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767511 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd976\" (UniqueName: \"kubernetes.io/projected/77d7593e-e39a-40a4-be4c-6c4a3df2d792-kube-api-access-nd976\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:17.767511 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjfs\" (UniqueName: \"kubernetes.io/projected/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-kube-api-access-qdjfs\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-config-volume\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.767761 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.767703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-tmp-dir\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.868726 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.868678    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.868726 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.868731    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869010 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.868874    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd976\" (UniqueName: \"kubernetes.io/projected/77d7593e-e39a-40a4-be4c-6c4a3df2d792-kube-api-access-nd976\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:17.869010 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.868917    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:17.869010 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869000    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:17.869153 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869055    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869153 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869071    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:18.369051651 +0000 UTC m=+35.592684394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:17.869153 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869107    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869153 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869135    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869309 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869207    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:17.869309 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869227    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:17.869309 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869267    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjfs\" (UniqueName: \"kubernetes.io/projected/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-kube-api-access-qdjfs\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.869309 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869287    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:18.369268559 +0000 UTC m=+35.592901288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:17.869505 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869327    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-config-volume\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.869505 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869359    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869505 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869384    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-tmp-dir\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.869505 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869457    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjbm\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869505 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869497    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.869737 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869530    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869737 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869715    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-tmp-dir\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.869856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869776    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869856 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869789    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.869967 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869880    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:17.869967 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:17.869946    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:18.369930336 +0000 UTC m=+35.593563078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:17.869967 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869942    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-config-volume\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.870112 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.869987    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.874416 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.874356    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.874416 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.874403    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.878326 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.878300    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjfs\" (UniqueName: \"kubernetes.io/projected/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-kube-api-access-qdjfs\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:17.878426 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.878406    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.879173 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.879152    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjbm\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:17.879644 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:17.879624    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd976\" (UniqueName: \"kubernetes.io/projected/77d7593e-e39a-40a4-be4c-6c4a3df2d792-kube-api-access-nd976\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:18.372999 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:18.372961    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:18.373030    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:18.373052    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373129    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373153    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373162    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373180    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373201    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:19.373180581 +0000 UTC m=+36.596813314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373221    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:19.37320982 +0000 UTC m=+36.596842549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:18.373818 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:18.373237    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:19.373228953 +0000 UTC m=+36.596861684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:19.382259 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.382222    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.382279    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.382356    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382388    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382458    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:21.382441571 +0000 UTC m=+38.606074299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382467    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382509    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:21.382497742 +0000 UTC m=+38.606130471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382569    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382581    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:19.382829 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:19.382613    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:21.382605593 +0000 UTC m=+38.606238320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:19.418262 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.418229    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:19.418454 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.418229    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:19.418454 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.418229    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:19.421468 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.421437    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:58:19.421612 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.421490    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6v4b\""
May 27 17:58:19.421612 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.421525    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 17:58:19.422746 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.422722    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 17:58:19.422920 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.422770    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-snwzs\""
May 27 17:58:19.423000 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:19.422921    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 17:58:21.399553 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:21.399525    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:21.399566    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399669    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399679    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399681    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399731    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:25.399717502 +0000 UTC m=+42.623350230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:21.399756    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399820    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399819    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:25.399798655 +0000 UTC m=+42.623431385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:21.399877 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:21.399875    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:25.399864056 +0000 UTC m=+42.623496785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:21.571525 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:21.571492    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="8291124000fbe8d4c62b1c76e9766f62e31ddf1a8aba187d12bf5c5e73ed1fa8" exitCode=0
May 27 17:58:21.571776 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:21.571558    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"8291124000fbe8d4c62b1c76e9766f62e31ddf1a8aba187d12bf5c5e73ed1fa8"}
May 27 17:58:22.575594 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:22.575560    2558 generic.go:358] "Generic (PLEG): container finished" podID="5d24cbac-10d6-4c32-9045-3ce79030de11" containerID="395cbf79fa8608a2dece343163f6869c0c64229a0ccc6528a1795b0133abeb3b" exitCode=0
May 27 17:58:22.576082 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:22.575617    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerDied","Data":"395cbf79fa8608a2dece343163f6869c0c64229a0ccc6528a1795b0133abeb3b"}
May 27 17:58:23.580740 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:23.580531    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lczsm" event={"ID":"5d24cbac-10d6-4c32-9045-3ce79030de11","Type":"ContainerStarted","Data":"1ecd1839848a9bbffb36197477fc2e4da2107ffa4eb8e7afe8e339d3fc3081e7"}
May 27 17:58:23.607941 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:23.607888    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lczsm" podStartSLOduration=5.98009262 podStartE2EDuration="40.607874267s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:57:46.245306784 +0000 UTC m=+3.468939523" lastFinishedPulling="2026-05-27 17:58:20.873088439 +0000 UTC m=+38.096721170" observedRunningTime="2026-05-27 17:58:23.607385702 +0000 UTC m=+40.831018451" watchObservedRunningTime="2026-05-27 17:58:23.607874267 +0000 UTC m=+40.831507038"
May 27 17:58:25.431281 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:25.431241    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:25.431303    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:25.431331    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431374    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431433    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:33.431418463 +0000 UTC m=+50.655051190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431433    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431441    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431457    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431479    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:33.431467148 +0000 UTC m=+50.655099876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:25.431710 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:25.431497    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:33.431484941 +0000 UTC m=+50.655117673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:33.492493 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:33.492457    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:33.492522    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:33.492574    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492630    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492680    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492692    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492730    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492693    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.492671531 +0000 UTC m=+66.716304273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492934    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.492918695 +0000 UTC m=+66.716551430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:33.493089 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:33.492955    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:49.492948826 +0000 UTC m=+66.716581553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:42.571341 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:42.571314    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvnx4"
May 27 17:58:49.101455 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.101415    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:58:49.104326 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.104307    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:58:49.112549 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.112529    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 17:58:49.112608 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.112598    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs podName:7e68f161-aaa9-4d2e-8321-635538a4a777 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:53.11257432 +0000 UTC m=+130.336207048 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs") pod "network-metrics-daemon-dw7lr" (UID: "7e68f161-aaa9-4d2e-8321-635538a4a777") : secret "metrics-daemon-secret" not found
May 27 17:58:49.202099 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.202050    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:49.202099 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.202107    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:49.205213 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.205192    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 17:58:49.205298 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.205191    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 17:58:49.215848 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.215804    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 17:58:49.216238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.216219    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ef9f41d-2569-48c2-9edf-4eec3cc66bc9-original-pull-secret\") pod \"global-pull-secret-syncer-gjwwm\" (UID: \"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9\") " pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:49.225629 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.225607    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp252\" (UniqueName: \"kubernetes.io/projected/7be451f3-be23-4f28-8bcc-8d1fa9697ac0-kube-api-access-xp252\") pod \"network-check-target-bb9km\" (UID: \"7be451f3-be23-4f28-8bcc-8d1fa9697ac0\") " pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:49.440531 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.440451    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6v4b\""
May 27 17:58:49.443659 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.443644    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gjwwm"
May 27 17:58:49.448330 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.448313    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:49.504701 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.504664    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:58:49.504847 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.504720    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:58:49.504847 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.504782    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506276    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506389    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.506347509 +0000 UTC m=+98.729980259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506548    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506562    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506615    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.506600029 +0000 UTC m=+98.730232767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506669    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:58:49.506788 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:58:49.506699    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.506688393 +0000 UTC m=+98.730321120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:58:49.607157 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.607125    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bb9km"]
May 27 17:58:49.610813 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:58:49.610786    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be451f3_be23_4f28_8bcc_8d1fa9697ac0.slice/crio-8a82d66e9d33639dda085bd3dd02270969370e131db7976bd852f0abf53c4e01 WatchSource:0}: Error finding container 8a82d66e9d33639dda085bd3dd02270969370e131db7976bd852f0abf53c4e01: Status 404 returned error can't find the container with id 8a82d66e9d33639dda085bd3dd02270969370e131db7976bd852f0abf53c4e01
May 27 17:58:49.617389 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.617364    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gjwwm"]
May 27 17:58:49.620712 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:58:49.620687    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef9f41d_2569_48c2_9edf_4eec3cc66bc9.slice/crio-e194f204ba815e0f9d344e6c6d1e543f1f4db79beae308c23a82ee7e55c4e01e WatchSource:0}: Error finding container e194f204ba815e0f9d344e6c6d1e543f1f4db79beae308c23a82ee7e55c4e01e: Status 404 returned error can't find the container with id e194f204ba815e0f9d344e6c6d1e543f1f4db79beae308c23a82ee7e55c4e01e
May 27 17:58:49.628291 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.628265    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bb9km" event={"ID":"7be451f3-be23-4f28-8bcc-8d1fa9697ac0","Type":"ContainerStarted","Data":"8a82d66e9d33639dda085bd3dd02270969370e131db7976bd852f0abf53c4e01"}
May 27 17:58:49.629250 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:49.629224    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gjwwm" event={"ID":"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9","Type":"ContainerStarted","Data":"e194f204ba815e0f9d344e6c6d1e543f1f4db79beae308c23a82ee7e55c4e01e"}
May 27 17:58:53.639207 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:53.639168    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bb9km" event={"ID":"7be451f3-be23-4f28-8bcc-8d1fa9697ac0","Type":"ContainerStarted","Data":"5f78286756b8606c69c62ead8d1e4a8b33150af6b0e171656ce0d64abc5990cc"}
May 27 17:58:53.639615 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:53.639395    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:58:54.641881 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:54.641821    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gjwwm" event={"ID":"2ef9f41d-2569-48c2-9edf-4eec3cc66bc9","Type":"ContainerStarted","Data":"5ead9d7fae312e8aaddc0f37b89a688a779bd78c9daa1340e4ea3be5782f8184"}
May 27 17:58:54.657946 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:58:54.657887    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bb9km" podStartSLOduration=68.615685622 podStartE2EDuration="1m11.657869597s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:58:49.613017971 +0000 UTC m=+66.836650702" lastFinishedPulling="2026-05-27 17:58:52.655201949 +0000 UTC m=+69.878834677" observedRunningTime="2026-05-27 17:58:53.666060219 +0000 UTC m=+70.889692969" watchObservedRunningTime="2026-05-27 17:58:54.657869597 +0000 UTC m=+71.881502343"
May 27 17:59:20.335532 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.335483    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gjwwm" podStartSLOduration=90.765448484 podStartE2EDuration="1m35.335469673s" podCreationTimestamp="2026-05-27 17:57:45 +0000 UTC" firstStartedPulling="2026-05-27 17:58:49.622388956 +0000 UTC m=+66.846021683" lastFinishedPulling="2026-05-27 17:58:54.192410141 +0000 UTC m=+71.416042872" observedRunningTime="2026-05-27 17:58:54.657761077 +0000 UTC m=+71.881393826" watchObservedRunningTime="2026-05-27 17:59:20.335469673 +0000 UTC m=+97.559102401"
May 27 17:59:20.336016 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.335872    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"]
May 27 17:59:20.338425 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.338406    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"
May 27 17:59:20.340571 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.340543    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"]
May 27 17:59:20.342359 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.342340    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xqqn7"]
May 27 17:59:20.342473 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.342449    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.342634 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.342610    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g77tc\""
May 27 17:59:20.343075 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.343055    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 27 17:59:20.343075 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.343057    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 27 17:59:20.344596 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.344576    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.345970 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.345945    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2z9v6\""
May 27 17:59:20.346344 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.346323    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 27 17:59:20.346412 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.346383    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 27 17:59:20.346412 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.346390    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 27 17:59:20.347631 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.347307    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 27 17:59:20.347631 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.347549    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 17:59:20.348096 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.348074    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 27 17:59:20.351903 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.351882    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 27 17:59:20.352014 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.351916    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 17:59:20.352014 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.351967    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-26vkl\""
May 27 17:59:20.353648 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.353626    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"]
May 27 17:59:20.355485 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.355464    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 27 17:59:20.362819 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.362795    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"]
May 27 17:59:20.372162 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.372144    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xqqn7"]
May 27 17:59:20.431319 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/999c1733-2fc5-4319-8cde-955d271cf188-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.431546 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-serving-cert\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.431546 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85l7m\" (UniqueName: \"kubernetes.io/projected/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-kube-api-access-85l7m\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.431546 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjx9h\" (UniqueName: \"kubernetes.io/projected/bcaba486-dbd5-4230-a847-e2971815c966-kube-api-access-hjx9h\") pod \"volume-data-source-validator-5cf8c89d64-gbm9m\" (UID: \"bcaba486-dbd5-4230-a847-e2971815c966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"
May 27 17:59:20.431546 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rnp7\" (UniqueName: \"kubernetes.io/projected/999c1733-2fc5-4319-8cde-955d271cf188-kube-api-access-9rnp7\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.431699 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-tmp\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.431699 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/999c1733-2fc5-4319-8cde-955d271cf188-config\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.431699 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-snapshots\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.431787 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.431787 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.431725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.438354 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.438324    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"]
May 27 17:59:20.440097 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.440083    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"]
May 27 17:59:20.440242 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.440226    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.441743 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.441725    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"
May 27 17:59:20.443044 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.443022    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zmx5d\""
May 27 17:59:20.443161 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.443051    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 17:59:20.443226 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.443162    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 17:59:20.443567 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.443548    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 27 17:59:20.444580 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.444562    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 27 17:59:20.444683 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.444586    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7fqdf\""
May 27 17:59:20.444683 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.444563    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-576c4d95bd-kk54b"]
May 27 17:59:20.446287 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.446270    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.446881 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.446860    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"]
May 27 17:59:20.448915 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.448896    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.452680 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.452659    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 27 17:59:20.452680 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.452672    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 27 17:59:20.452862 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.452751    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 27 17:59:20.452928 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.452919    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fbgcr\""
May 27 17:59:20.453492 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.453111    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 27 17:59:20.453710 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.453696    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 27 17:59:20.454581 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.454567    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 27 17:59:20.455307 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.455295    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 27 17:59:20.455506 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.455494    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 27 17:59:20.455828 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.455813    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 17:59:20.456498 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.456482    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 17:59:20.461205 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.461189    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gspwg\""
May 27 17:59:20.465769 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.465747    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"]
May 27 17:59:20.466556 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.466537    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"]
May 27 17:59:20.478082 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.477970    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"]
May 27 17:59:20.478935 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.478907    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-576c4d95bd-kk54b"]
May 27 17:59:20.532771 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-stats-auth\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.532771 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-serving-cert\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.533006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.533006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532897    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-snapshots\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532938    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-default-certificate\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.533006 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.532991    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rnp7\" (UniqueName: \"kubernetes.io/projected/999c1733-2fc5-4319-8cde-955d271cf188-kube-api-access-9rnp7\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.533193 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfhqk\" (UniqueName: \"kubernetes.io/projected/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-kube-api-access-bfhqk\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.533193 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.533193 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533178    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85l7m\" (UniqueName: \"kubernetes.io/projected/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-kube-api-access-85l7m\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533325 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfh4v\" (UniqueName: \"kubernetes.io/projected/7de997e9-6306-4519-897b-c34205c5fdb9-kube-api-access-cfh4v\") pod \"network-check-source-7f44b6dd87-cptst\" (UID: \"7de997e9-6306-4519-897b-c34205c5fdb9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"
May 27 17:59:20.533325 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2c136c-6046-40e6-88ee-051e55696395-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.533409 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533342    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/999c1733-2fc5-4319-8cde-955d271cf188-config\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.533682 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533653    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533770 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533712    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-tmp\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533821 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533754    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/999c1733-2fc5-4319-8cde-955d271cf188-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.533821 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-config\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.533950 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533878    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-serving-cert\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.533998 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.533970    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjx9h\" (UniqueName: \"kubernetes.io/projected/bcaba486-dbd5-4230-a847-e2971815c966-kube-api-access-hjx9h\") pod \"volume-data-source-validator-5cf8c89d64-gbm9m\" (UID: \"bcaba486-dbd5-4230-a847-e2971815c966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"
May 27 17:59:20.534048 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.534102 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2r9k\" (UniqueName: \"kubernetes.io/projected/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-kube-api-access-m2r9k\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.534102 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4n6\" (UniqueName: \"kubernetes.io/projected/4a2c136c-6046-40e6-88ee-051e55696395-kube-api-access-2m4n6\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.534213 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534142    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/999c1733-2fc5-4319-8cde-955d271cf188-config\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.534271 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534214    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-snapshots\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.534528 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534492    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-tmp\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.534810 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.534789    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.536018 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.535981    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.537447 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.537416    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-serving-cert\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.537800 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.537773    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/999c1733-2fc5-4319-8cde-955d271cf188-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.542403 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.542359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rnp7\" (UniqueName: \"kubernetes.io/projected/999c1733-2fc5-4319-8cde-955d271cf188-kube-api-access-9rnp7\") pod \"kube-storage-version-migrator-operator-565644f49-66psp\" (UID: \"999c1733-2fc5-4319-8cde-955d271cf188\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.542705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.542663    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjx9h\" (UniqueName: \"kubernetes.io/projected/bcaba486-dbd5-4230-a847-e2971815c966-kube-api-access-hjx9h\") pod \"volume-data-source-validator-5cf8c89d64-gbm9m\" (UID: \"bcaba486-dbd5-4230-a847-e2971815c966\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"
May 27 17:59:20.543874 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.543827    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85l7m\" (UniqueName: \"kubernetes.io/projected/e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7-kube-api-access-85l7m\") pod \"insights-operator-78bdfb888c-xqqn7\" (UID: \"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7\") " pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.635083 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.634985    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.635083 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635029    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2r9k\" (UniqueName: \"kubernetes.io/projected/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-kube-api-access-m2r9k\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.635083 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635048    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4n6\" (UniqueName: \"kubernetes.io/projected/4a2c136c-6046-40e6-88ee-051e55696395-kube-api-access-2m4n6\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.635083 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635068    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-stats-auth\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635128    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-serving-cert\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:20.635143    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635191    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-default-certificate\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:20.635232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.135210262 +0000 UTC m=+98.358843030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:20.635288    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:20.635356    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.135338329 +0000 UTC m=+98.358971057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:20.635404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfhqk\" (UniqueName: \"kubernetes.io/projected/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-kube-api-access-bfhqk\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.635777 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635421    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.635777 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635476    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfh4v\" (UniqueName: \"kubernetes.io/projected/7de997e9-6306-4519-897b-c34205c5fdb9-kube-api-access-cfh4v\") pod \"network-check-source-7f44b6dd87-cptst\" (UID: \"7de997e9-6306-4519-897b-c34205c5fdb9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"
May 27 17:59:20.635777 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635503    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2c136c-6046-40e6-88ee-051e55696395-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.635777 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.635556    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-config\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.635777 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:20.635619    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.135602973 +0000 UTC m=+98.359235726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:20.636217 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.636140    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-config\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.636280 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.636262    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2c136c-6046-40e6-88ee-051e55696395-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.637718 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.637687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-serving-cert\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.637973 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.637953    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-default-certificate\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.638019 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.637974    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-stats-auth\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.646599 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.646577    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfhqk\" (UniqueName: \"kubernetes.io/projected/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-kube-api-access-bfhqk\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:20.647854 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.647807    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfh4v\" (UniqueName: \"kubernetes.io/projected/7de997e9-6306-4519-897b-c34205c5fdb9-kube-api-access-cfh4v\") pod \"network-check-source-7f44b6dd87-cptst\" (UID: \"7de997e9-6306-4519-897b-c34205c5fdb9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"
May 27 17:59:20.647945 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.647921    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4n6\" (UniqueName: \"kubernetes.io/projected/4a2c136c-6046-40e6-88ee-051e55696395-kube-api-access-2m4n6\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:20.648172 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.648156    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2r9k\" (UniqueName: \"kubernetes.io/projected/8921d9e6-033c-4afd-b0ad-46c8ec5c48df-kube-api-access-m2r9k\") pod \"service-ca-operator-57b5b68b8-wcshv\" (UID: \"8921d9e6-033c-4afd-b0ad-46c8ec5c48df\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.651603 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.651588    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"
May 27 17:59:20.657913 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.657894    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"
May 27 17:59:20.662464 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.662437    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7"
May 27 17:59:20.757383 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.756778    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"
May 27 17:59:20.767768 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.767302    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"
May 27 17:59:20.829005 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.828949    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m"]
May 27 17:59:20.833439 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:20.833402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaba486_dbd5_4230_a847_e2971815c966.slice/crio-057f4e330b29584794cbf977b7f1ba87c056cc435ced6661ee6a17afd270bcc8 WatchSource:0}: Error finding container 057f4e330b29584794cbf977b7f1ba87c056cc435ced6661ee6a17afd270bcc8: Status 404 returned error can't find the container with id 057f4e330b29584794cbf977b7f1ba87c056cc435ced6661ee6a17afd270bcc8
May 27 17:59:20.838162 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.838136    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp"]
May 27 17:59:20.841481 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:20.841452    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999c1733_2fc5_4319_8cde_955d271cf188.slice/crio-57f0bcea1e19a67b727e3ff4d5da2ebf6a0ed418bb80207babcb69a8f97c03a2 WatchSource:0}: Error finding container 57f0bcea1e19a67b727e3ff4d5da2ebf6a0ed418bb80207babcb69a8f97c03a2: Status 404 returned error can't find the container with id 57f0bcea1e19a67b727e3ff4d5da2ebf6a0ed418bb80207babcb69a8f97c03a2
May 27 17:59:20.898412 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.898339    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst"]
May 27 17:59:20.901703 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:20.901671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de997e9_6306_4519_897b_c34205c5fdb9.slice/crio-cfc8f081caffa2a6f54e7b03a093ebc8170cd254c1863748ac3a0b85aad75855 WatchSource:0}: Error finding container cfc8f081caffa2a6f54e7b03a093ebc8170cd254c1863748ac3a0b85aad75855: Status 404 returned error can't find the container with id cfc8f081caffa2a6f54e7b03a093ebc8170cd254c1863748ac3a0b85aad75855
May 27 17:59:20.915239 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:20.915220    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv"]
May 27 17:59:20.917593 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:20.917534    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8921d9e6_033c_4afd_b0ad_46c8ec5c48df.slice/crio-3b3de85e906b449ecaa749024a9708b5e3229bc789737185bc3f87f950f59569 WatchSource:0}: Error finding container 3b3de85e906b449ecaa749024a9708b5e3229bc789737185bc3f87f950f59569: Status 404 returned error can't find the container with id 3b3de85e906b449ecaa749024a9708b5e3229bc789737185bc3f87f950f59569
May 27 17:59:21.032075 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.032042    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xqqn7"]
May 27 17:59:21.037747 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:21.037717    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b9de70_cd43_4c74_9d73_1f6e0eeb62d7.slice/crio-4bc404e61453ee41802c4e522996b0f68fd63033aa0ff0d11e7c510230dc435e WatchSource:0}: Error finding container 4bc404e61453ee41802c4e522996b0f68fd63033aa0ff0d11e7c510230dc435e: Status 404 returned error can't find the container with id 4bc404e61453ee41802c4e522996b0f68fd63033aa0ff0d11e7c510230dc435e
May 27 17:59:21.140527 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.140477    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:21.140703 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.140538    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:21.140703 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.140569    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:21.140703 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.140638    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:21.140703 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.140676    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:21.140703 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.140691    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:22.140673474 +0000 UTC m=+99.364306224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:21.140883 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.140706    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:22.140699979 +0000 UTC m=+99.364332707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:21.140883 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.140717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:22.14071208 +0000 UTC m=+99.364344808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.544136    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.544232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") pod \"image-registry-9b9dfb59d-5zc8r\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") " pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.544302    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.544445    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.544503    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert podName:77d7593e-e39a-40a4-be4c-6c4a3df2d792 nodeName:}" failed. No retries permitted until 2026-05-27 18:00:25.544485184 +0000 UTC m=+162.768117915 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert") pod "ingress-canary-g7jgg" (UID: "77d7593e-e39a-40a4-be4c-6c4a3df2d792") : secret "canary-serving-cert" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.544965    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.545019    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls podName:13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be nodeName:}" failed. No retries permitted until 2026-05-27 18:00:25.545003016 +0000 UTC m=+162.768635746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls") pod "dns-default-nphn2" (UID: "13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be") : secret "dns-default-metrics-tls" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.545080    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.545091    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b9dfb59d-5zc8r: secret "image-registry-tls" not found
May 27 17:59:21.545167 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:21.545122    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls podName:dc611577-b07f-417e-b699-84ca6e3f7d2f nodeName:}" failed. No retries permitted until 2026-05-27 18:00:25.545112132 +0000 UTC m=+162.768744863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls") pod "image-registry-9b9dfb59d-5zc8r" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f") : secret "image-registry-tls" not found
May 27 17:59:21.701613 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.701579    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7" event={"ID":"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7","Type":"ContainerStarted","Data":"4bc404e61453ee41802c4e522996b0f68fd63033aa0ff0d11e7c510230dc435e"}
May 27 17:59:21.703775 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.703747    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m" event={"ID":"bcaba486-dbd5-4230-a847-e2971815c966","Type":"ContainerStarted","Data":"057f4e330b29584794cbf977b7f1ba87c056cc435ced6661ee6a17afd270bcc8"}
May 27 17:59:21.705800 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.705774    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv" event={"ID":"8921d9e6-033c-4afd-b0ad-46c8ec5c48df","Type":"ContainerStarted","Data":"3b3de85e906b449ecaa749024a9708b5e3229bc789737185bc3f87f950f59569"}
May 27 17:59:21.707317 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.707293    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp" event={"ID":"999c1733-2fc5-4319-8cde-955d271cf188","Type":"ContainerStarted","Data":"57f0bcea1e19a67b727e3ff4d5da2ebf6a0ed418bb80207babcb69a8f97c03a2"}
May 27 17:59:21.709390 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.709349    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst" event={"ID":"7de997e9-6306-4519-897b-c34205c5fdb9","Type":"ContainerStarted","Data":"8ce60d9384c36ad0e3edc98e2b8ca555404178e4afcdd7eb40c6071a46f60aaf"}
May 27 17:59:21.709390 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.709378    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst" event={"ID":"7de997e9-6306-4519-897b-c34205c5fdb9","Type":"ContainerStarted","Data":"cfc8f081caffa2a6f54e7b03a093ebc8170cd254c1863748ac3a0b85aad75855"}
May 27 17:59:21.725577 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:21.725521    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cptst" podStartSLOduration=1.72550261 podStartE2EDuration="1.72550261s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:59:21.724780287 +0000 UTC m=+98.948413039" watchObservedRunningTime="2026-05-27 17:59:21.72550261 +0000 UTC m=+98.949135361"
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:22.149898    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:22.150016    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:22.150077    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:22.150174    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:22.150232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:24.15021713 +0000 UTC m=+101.373849862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:22.150369    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:24.150348946 +0000 UTC m=+101.373981680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:22.150458    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:22.150681 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:22.150497    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:24.150485214 +0000 UTC m=+101.374117945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:24.171046 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.171014    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.171124    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.171176    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:24.171179    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:24.171262    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:24.171270    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:28.171248215 +0000 UTC m=+105.394880963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:24.171322    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:28.171304443 +0000 UTC m=+105.394937174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:24.171404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:24.171336    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:28.171328516 +0000 UTC m=+105.394961244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:24.644608 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.644580    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bb9km"
May 27 17:59:24.718345 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.718294    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m" event={"ID":"bcaba486-dbd5-4230-a847-e2971815c966","Type":"ContainerStarted","Data":"5190bab1b109e37ba4109a03f66cfe205b2519f444fde458fbb7051c9c5b9b1a"}
May 27 17:59:24.719805 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.719773    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv" event={"ID":"8921d9e6-033c-4afd-b0ad-46c8ec5c48df","Type":"ContainerStarted","Data":"5f9a78aabdb029ede7f05b28066bd0986678000084221efe5fd0752a633f779a"}
May 27 17:59:24.721152 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.721126    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp" event={"ID":"999c1733-2fc5-4319-8cde-955d271cf188","Type":"ContainerStarted","Data":"6c08889b41b32789b2827b709cf8a2c434e61d044b99bea16bbad7d5aa7bb950"}
May 27 17:59:24.722348 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.722328    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7" event={"ID":"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7","Type":"ContainerStarted","Data":"6c8e6cf0496e9c960c1c48648759dd75ce1d581f39e8ac78e15d7fc6d48e47b1"}
May 27 17:59:24.740463 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.740411    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gbm9m" podStartSLOduration=1.462897342 podStartE2EDuration="4.740395878s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:20.835846687 +0000 UTC m=+98.059479443" lastFinishedPulling="2026-05-27 17:59:24.113345232 +0000 UTC m=+101.336977979" observedRunningTime="2026-05-27 17:59:24.739321073 +0000 UTC m=+101.962953824" watchObservedRunningTime="2026-05-27 17:59:24.740395878 +0000 UTC m=+101.964028623"
May 27 17:59:24.754444 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.754382    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv" podStartSLOduration=1.532806345 podStartE2EDuration="4.754363114s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:20.919515463 +0000 UTC m=+98.143148205" lastFinishedPulling="2026-05-27 17:59:24.141072231 +0000 UTC m=+101.364704974" observedRunningTime="2026-05-27 17:59:24.754282288 +0000 UTC m=+101.977915037" watchObservedRunningTime="2026-05-27 17:59:24.754363114 +0000 UTC m=+101.977995865"
May 27 17:59:24.808680 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.808611    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp" podStartSLOduration=1.520451731 podStartE2EDuration="4.808591557s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:20.844800998 +0000 UTC m=+98.068433725" lastFinishedPulling="2026-05-27 17:59:24.132940804 +0000 UTC m=+101.356573551" observedRunningTime="2026-05-27 17:59:24.776996784 +0000 UTC m=+102.000629535" watchObservedRunningTime="2026-05-27 17:59:24.808591557 +0000 UTC m=+102.032224309"
May 27 17:59:24.808915 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:24.808751    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7" podStartSLOduration=1.7303742199999999 podStartE2EDuration="4.808741255s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:21.040002859 +0000 UTC m=+98.263635586" lastFinishedPulling="2026-05-27 17:59:24.118369878 +0000 UTC m=+101.342002621" observedRunningTime="2026-05-27 17:59:24.801255048 +0000 UTC m=+102.024887800" watchObservedRunningTime="2026-05-27 17:59:24.808741255 +0000 UTC m=+102.032374005"
May 27 17:59:27.836668 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:27.836640    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chctj_e8fed2bd-8f58-4021-b8c6-f355e2f010d7/dns-node-resolver/0.log"
May 27 17:59:28.208238 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:28.208203    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:28.208404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:28.208263    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:28.208404 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:28.208294    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:28.208404 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:28.208363    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:28.208514 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:28.208416    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:36.208399746 +0000 UTC m=+113.432032474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:28.208514 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:28.208418    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:28.208514 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:28.208437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:36.208423949 +0000 UTC m=+113.432056682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:28.208514 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:28.208473    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:36.208462192 +0000 UTC m=+113.432094920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:28.636571 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:28.636499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vzsh_44a4e941-9d7a-4d64-95aa-87f828ef665e/node-ca/0.log"
May 27 17:59:36.274227 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:36.274163    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:36.274248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:36.274279    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:36.274333    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:36.274384    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:36.274397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls podName:4a2c136c-6046-40e6-88ee-051e55696395 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:52.274382437 +0000 UTC m=+129.498015168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-227ph" (UID: "4a2c136c-6046-40e6-88ee-051e55696395") : secret "cluster-monitoring-operator-tls" not found
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:36.274442    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:52.274429761 +0000 UTC m=+129.498062488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : configmap references non-existent config key: service-ca.crt
May 27 17:59:36.274633 ip-10-0-139-141 kubenswrapper[2558]: E0527 17:59:36.274453    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs podName:38d7a435-d88e-4129-bd3c-9dd8b6500cd8 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:52.27444665 +0000 UTC m=+129.498079378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs") pod "router-default-576c4d95bd-kk54b" (UID: "38d7a435-d88e-4129-bd3c-9dd8b6500cd8") : secret "router-metrics-certs-default" not found
May 27 17:59:46.629506 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.629472    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tr2v9"]
May 27 17:59:46.631734 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.631718    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.635567 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.635543    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 17:59:46.635708 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.635571    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4jcs\""
May 27 17:59:46.635708 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.635581    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 17:59:46.646344 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.646321    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tr2v9"]
May 27 17:59:46.664782 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.664754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvmn\" (UniqueName: \"kubernetes.io/projected/992b30e0-2759-4130-87af-6a775a43ec19-kube-api-access-ldvmn\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.664948 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.664847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/992b30e0-2759-4130-87af-6a775a43ec19-data-volume\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.664948 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.664926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/992b30e0-2759-4130-87af-6a775a43ec19-crio-socket\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.665039 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.664951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/992b30e0-2759-4130-87af-6a775a43ec19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.665039 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.664975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/992b30e0-2759-4130-87af-6a775a43ec19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765437 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765394    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/992b30e0-2759-4130-87af-6a775a43ec19-crio-socket\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765437 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765438    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/992b30e0-2759-4130-87af-6a775a43ec19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765695 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765458    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/992b30e0-2759-4130-87af-6a775a43ec19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765695 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765522    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvmn\" (UniqueName: \"kubernetes.io/projected/992b30e0-2759-4130-87af-6a775a43ec19-kube-api-access-ldvmn\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765695 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/992b30e0-2759-4130-87af-6a775a43ec19-crio-socket\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765695 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765583    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/992b30e0-2759-4130-87af-6a775a43ec19-data-volume\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.765962 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.765942    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/992b30e0-2759-4130-87af-6a775a43ec19-data-volume\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.766015 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.766006    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/992b30e0-2759-4130-87af-6a775a43ec19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.768661 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.768640    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/992b30e0-2759-4130-87af-6a775a43ec19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.775418 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.775395    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvmn\" (UniqueName: \"kubernetes.io/projected/992b30e0-2759-4130-87af-6a775a43ec19-kube-api-access-ldvmn\") pod \"insights-runtime-extractor-tr2v9\" (UID: \"992b30e0-2759-4130-87af-6a775a43ec19\") " pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:46.940851 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:46.940751    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tr2v9"
May 27 17:59:47.070205 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:47.070169    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tr2v9"]
May 27 17:59:47.073266 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:47.073231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992b30e0_2759_4130_87af_6a775a43ec19.slice/crio-e52f5611dea4266e72b34ef6c7a5cab4a745171256aad4ce4ee5646d378b98d4 WatchSource:0}: Error finding container e52f5611dea4266e72b34ef6c7a5cab4a745171256aad4ce4ee5646d378b98d4: Status 404 returned error can't find the container with id e52f5611dea4266e72b34ef6c7a5cab4a745171256aad4ce4ee5646d378b98d4
May 27 17:59:47.778974 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:47.778937    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr2v9" event={"ID":"992b30e0-2759-4130-87af-6a775a43ec19","Type":"ContainerStarted","Data":"096f7d6f09bd88adc31bb7a1950255729aaae6a3ce5e097c317495fc18d52b9f"}
May 27 17:59:47.779352 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:47.778981    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr2v9" event={"ID":"992b30e0-2759-4130-87af-6a775a43ec19","Type":"ContainerStarted","Data":"e52f5611dea4266e72b34ef6c7a5cab4a745171256aad4ce4ee5646d378b98d4"}
May 27 17:59:48.785959 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:48.785923    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr2v9" event={"ID":"992b30e0-2759-4130-87af-6a775a43ec19","Type":"ContainerStarted","Data":"aad92cbe0a57f559cd2edca04d382fc1215aee12645fc88a261b11ac320cb658"}
May 27 17:59:49.790205 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:49.790161    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr2v9" event={"ID":"992b30e0-2759-4130-87af-6a775a43ec19","Type":"ContainerStarted","Data":"1501f938917b24dbaac376039bd409fcb7ddea7c8ab168d2f1ce45d5d1038e20"}
May 27 17:59:49.808518 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:49.808469    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tr2v9" podStartSLOduration=1.866330362 podStartE2EDuration="3.808456397s" podCreationTimestamp="2026-05-27 17:59:46 +0000 UTC" firstStartedPulling="2026-05-27 17:59:47.126338606 +0000 UTC m=+124.349971336" lastFinishedPulling="2026-05-27 17:59:49.06846464 +0000 UTC m=+126.292097371" observedRunningTime="2026-05-27 17:59:49.808083317 +0000 UTC m=+127.031716068" watchObservedRunningTime="2026-05-27 17:59:49.808456397 +0000 UTC m=+127.032089147"
May 27 17:59:52.318116 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.318067    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:52.318525 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.318134    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:52.318525 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.318209    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:52.318878 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.318857    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-service-ca-bundle\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:52.320570 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.320551    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38d7a435-d88e-4129-bd3c-9dd8b6500cd8-metrics-certs\") pod \"router-default-576c4d95bd-kk54b\" (UID: \"38d7a435-d88e-4129-bd3c-9dd8b6500cd8\") " pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:52.320706 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.320685    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2c136c-6046-40e6-88ee-051e55696395-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-227ph\" (UID: \"4a2c136c-6046-40e6-88ee-051e55696395\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:52.553329 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.553293    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zmx5d\""
May 27 17:59:52.561384 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.561363    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"
May 27 17:59:52.565050 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.565030    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gspwg\""
May 27 17:59:52.573927 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.573900    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:52.698646 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.698616    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph"]
May 27 17:59:52.701573 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:52.701546    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2c136c_6046_40e6_88ee_051e55696395.slice/crio-f37d37ae9d27097ea284d9a02a85a14589079ef499f533eb123b68c9d6c8dd3f WatchSource:0}: Error finding container f37d37ae9d27097ea284d9a02a85a14589079ef499f533eb123b68c9d6c8dd3f: Status 404 returned error can't find the container with id f37d37ae9d27097ea284d9a02a85a14589079ef499f533eb123b68c9d6c8dd3f
May 27 17:59:52.714175 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.714144    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-576c4d95bd-kk54b"]
May 27 17:59:52.718519 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:52.718494    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d7a435_d88e_4129_bd3c_9dd8b6500cd8.slice/crio-d394b7b1d58af095e56d59a94f0e984031d4ea8ffd0feb508825c4ff1738c58e WatchSource:0}: Error finding container d394b7b1d58af095e56d59a94f0e984031d4ea8ffd0feb508825c4ff1738c58e: Status 404 returned error can't find the container with id d394b7b1d58af095e56d59a94f0e984031d4ea8ffd0feb508825c4ff1738c58e
May 27 17:59:52.799737 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.799700    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-576c4d95bd-kk54b" event={"ID":"38d7a435-d88e-4129-bd3c-9dd8b6500cd8","Type":"ContainerStarted","Data":"2db2f5a952231823fde71de7dee31fae1bbc5e96d0d52f230ebbeedad78ff79d"}
May 27 17:59:52.799737 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.799743    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-576c4d95bd-kk54b" event={"ID":"38d7a435-d88e-4129-bd3c-9dd8b6500cd8","Type":"ContainerStarted","Data":"d394b7b1d58af095e56d59a94f0e984031d4ea8ffd0feb508825c4ff1738c58e"}
May 27 17:59:52.800680 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.800660    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph" event={"ID":"4a2c136c-6046-40e6-88ee-051e55696395","Type":"ContainerStarted","Data":"f37d37ae9d27097ea284d9a02a85a14589079ef499f533eb123b68c9d6c8dd3f"}
May 27 17:59:52.819934 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:52.819805    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-576c4d95bd-kk54b" podStartSLOduration=32.819786379 podStartE2EDuration="32.819786379s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:59:52.819499644 +0000 UTC m=+130.043132395" watchObservedRunningTime="2026-05-27 17:59:52.819786379 +0000 UTC m=+130.043419131"
May 27 17:59:53.124772 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.124684    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:59:53.127642 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.127613    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e68f161-aaa9-4d2e-8321-635538a4a777-metrics-certs\") pod \"network-metrics-daemon-dw7lr\" (UID: \"7e68f161-aaa9-4d2e-8321-635538a4a777\") " pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:59:53.354111 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.354078    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-snwzs\""
May 27 17:59:53.360919 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.360893    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dw7lr"
May 27 17:59:53.503600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.503562    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dw7lr"]
May 27 17:59:53.507276 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:53.507244    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e68f161_aaa9_4d2e_8321_635538a4a777.slice/crio-b5552bb0817bfba478f2102b0765eedd44eb4427bec5dff36cb3a30df3f7b7b2 WatchSource:0}: Error finding container b5552bb0817bfba478f2102b0765eedd44eb4427bec5dff36cb3a30df3f7b7b2: Status 404 returned error can't find the container with id b5552bb0817bfba478f2102b0765eedd44eb4427bec5dff36cb3a30df3f7b7b2
May 27 17:59:53.528589 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.528561    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 17:59:53.531874 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.531826    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.534722 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.534691    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cwmsm\""
May 27 17:59:53.534927 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.534904    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 27 17:59:53.535121 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535099    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 27 17:59:53.535705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535472    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 27 17:59:53.535705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535498    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 27 17:59:53.535705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535514    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 27 17:59:53.535705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535560    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 27 17:59:53.535705 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.535629    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 27 17:59:53.540350 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.540323    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 17:59:53.574873 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.574824    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:53.577873 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.577849    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:53.627572 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.627759 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.627759 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.627759 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.627965 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.627965 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.627905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9b6\" (UniqueName: \"kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729128 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729034    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729128 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9b6\" (UniqueName: \"kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729362 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729277    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729362 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729321    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729476 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729373    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.729476 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.729398    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.730042 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.730015    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.730201 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.730174    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.730329 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.730268    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.731764 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.731742    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.731933 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.731916    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.741621 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.741560    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9b6\" (UniqueName: \"kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6\") pod \"console-84b6fc67bf-cg8b4\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") " pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:53.804561 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.804521    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dw7lr" event={"ID":"7e68f161-aaa9-4d2e-8321-635538a4a777","Type":"ContainerStarted","Data":"b5552bb0817bfba478f2102b0765eedd44eb4427bec5dff36cb3a30df3f7b7b2"}
May 27 17:59:53.804820 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.804788    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:53.806212 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.806140    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-576c4d95bd-kk54b"
May 27 17:59:53.844863 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:53.844681    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 17:59:54.298711 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.298671    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 17:59:54.302352 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:54.302308    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b9005f_9b05_43d4_b64e_a777696e3b58.slice/crio-c6a084e4c1a94ad82fdbc785003fae01c40a024bb34c33a0dd1bb479986a5b09 WatchSource:0}: Error finding container c6a084e4c1a94ad82fdbc785003fae01c40a024bb34c33a0dd1bb479986a5b09: Status 404 returned error can't find the container with id c6a084e4c1a94ad82fdbc785003fae01c40a024bb34c33a0dd1bb479986a5b09
May 27 17:59:54.727134 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.727094    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"]
May 27 17:59:54.731994 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.731971    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:54.734409 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.734383    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 27 17:59:54.734409 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.734391    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lvw6p\""
May 27 17:59:54.737600 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.737140    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"]
May 27 17:59:54.808011 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.807978    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph" event={"ID":"4a2c136c-6046-40e6-88ee-051e55696395","Type":"ContainerStarted","Data":"408bbe3de6288ecd64bb73b40930ba388e2ff4d934bf7c7986449a287f5f36a5"}
May 27 17:59:54.809045 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.809020    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b6fc67bf-cg8b4" event={"ID":"42b9005f-9b05-43d4-b64e-a777696e3b58","Type":"ContainerStarted","Data":"c6a084e4c1a94ad82fdbc785003fae01c40a024bb34c33a0dd1bb479986a5b09"}
May 27 17:59:54.824667 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.824616    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-227ph" podStartSLOduration=33.336987352 podStartE2EDuration="34.82460209s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:52.703371812 +0000 UTC m=+129.927004540" lastFinishedPulling="2026-05-27 17:59:54.190986535 +0000 UTC m=+131.414619278" observedRunningTime="2026-05-27 17:59:54.823521924 +0000 UTC m=+132.047154676" watchObservedRunningTime="2026-05-27 17:59:54.82460209 +0000 UTC m=+132.048234863"
May 27 17:59:54.841029 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.840994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb\" (UID: \"b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:54.941803 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.941770    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb\" (UID: \"b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:54.944604 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:54.944586    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb\" (UID: \"b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:55.043496 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.043459    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:55.217113 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.217081    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"]
May 27 17:59:55.220608 ip-10-0-139-141 kubenswrapper[2558]: W0527 17:59:55.220580    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81bfaf5_f7e7_4a42_b09f_83e7c1c1cba8.slice/crio-341056c8d63ff2e15bb94ec45c57d459728d77a56ff77b6ae6eddcfab0184dc8 WatchSource:0}: Error finding container 341056c8d63ff2e15bb94ec45c57d459728d77a56ff77b6ae6eddcfab0184dc8: Status 404 returned error can't find the container with id 341056c8d63ff2e15bb94ec45c57d459728d77a56ff77b6ae6eddcfab0184dc8
May 27 17:59:55.814606 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.814568    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dw7lr" event={"ID":"7e68f161-aaa9-4d2e-8321-635538a4a777","Type":"ContainerStarted","Data":"7ebf2c116e2dcb8f01f358814fc38ebe103bebbb3d217e2f682f45686eea71bb"}
May 27 17:59:55.814606 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.814609    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dw7lr" event={"ID":"7e68f161-aaa9-4d2e-8321-635538a4a777","Type":"ContainerStarted","Data":"63926d26201d0542532d7d3ea05bc9b91d3d2cf6f2b5a3e62229da7d2ecb4740"}
May 27 17:59:55.816442 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.816408    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb" event={"ID":"b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8","Type":"ContainerStarted","Data":"341056c8d63ff2e15bb94ec45c57d459728d77a56ff77b6ae6eddcfab0184dc8"}
May 27 17:59:55.830145 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:55.830088    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dw7lr" podStartSLOduration=131.470890716 podStartE2EDuration="2m12.83007195s" podCreationTimestamp="2026-05-27 17:57:43 +0000 UTC" firstStartedPulling="2026-05-27 17:59:53.509616301 +0000 UTC m=+130.733249037" lastFinishedPulling="2026-05-27 17:59:54.868797535 +0000 UTC m=+132.092430271" observedRunningTime="2026-05-27 17:59:55.829673886 +0000 UTC m=+133.053306640" watchObservedRunningTime="2026-05-27 17:59:55.83007195 +0000 UTC m=+133.053704704"
May 27 17:59:57.824526 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.824491    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb" event={"ID":"b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8","Type":"ContainerStarted","Data":"6ccd2ebf2214a850cbd95c896a8ede8e802b06ebe7ee5838fc3e132ccca77437"}
May 27 17:59:57.824982 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.824683    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:57.826061 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.826032    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b6fc67bf-cg8b4" event={"ID":"42b9005f-9b05-43d4-b64e-a777696e3b58","Type":"ContainerStarted","Data":"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"}
May 27 17:59:57.830318 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.830296    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb"
May 27 17:59:57.846562 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.846518    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb" podStartSLOduration=1.428631725 podStartE2EDuration="3.84650549s" podCreationTimestamp="2026-05-27 17:59:54 +0000 UTC" firstStartedPulling="2026-05-27 17:59:55.222900358 +0000 UTC m=+132.446533104" lastFinishedPulling="2026-05-27 17:59:57.640774142 +0000 UTC m=+134.864406869" observedRunningTime="2026-05-27 17:59:57.846166805 +0000 UTC m=+135.069799578" watchObservedRunningTime="2026-05-27 17:59:57.84650549 +0000 UTC m=+135.070138240"
May 27 17:59:57.865056 ip-10-0-139-141 kubenswrapper[2558]: I0527 17:59:57.865009    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84b6fc67bf-cg8b4" podStartSLOduration=1.5237107619999999 podStartE2EDuration="4.864994434s" podCreationTimestamp="2026-05-27 17:59:53 +0000 UTC" firstStartedPulling="2026-05-27 17:59:54.304805291 +0000 UTC m=+131.528438018" lastFinishedPulling="2026-05-27 17:59:57.646088962 +0000 UTC m=+134.869721690" observedRunningTime="2026-05-27 17:59:57.864219911 +0000 UTC m=+135.087852655" watchObservedRunningTime="2026-05-27 17:59:57.864994434 +0000 UTC m=+135.088627185"
May 27 18:00:03.845939 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:03.845893    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:03.845939 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:03.845948    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:03.850581 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:03.850554    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:04.852279 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:04.852250    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:06.043638 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:06.043600    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 18:00:08.444434 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.444397    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b9dfb59d-5zc8r"]
May 27 18:00:08.444878 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:08.444619    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r" podUID="dc611577-b07f-417e-b699-84ca6e3f7d2f"
May 27 18:00:08.856563 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.856526    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 18:00:08.862059 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.862029    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 18:00:08.963502 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963465    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963684 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963513    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963684 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963555    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963684 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963588    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963684 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963609    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963684 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963638    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963964 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963719    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rjbm\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm\") pod \"dc611577-b07f-417e-b699-84ca6e3f7d2f\" (UID: \"dc611577-b07f-417e-b699-84ca6e3f7d2f\") "
May 27 18:00:08.963964 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963903    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:00:08.963964 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.963959    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:00:08.964116 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.964001    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc611577-b07f-417e-b699-84ca6e3f7d2f-ca-trust-extracted\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:08.964116 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.964064    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:00:08.966173 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.966151    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:00:08.966298 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.966172    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:00:08.966298 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.966201    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm" (OuterVolumeSpecName: "kube-api-access-5rjbm") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "kube-api-access-5rjbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:00:08.966298 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:08.966245    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dc611577-b07f-417e-b699-84ca6e3f7d2f" (UID: "dc611577-b07f-417e-b699-84ca6e3f7d2f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:00:09.065208 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065171    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-installation-pull-secrets\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.065208 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065204    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-trusted-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.065208 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065214    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc611577-b07f-417e-b699-84ca6e3f7d2f-image-registry-private-configuration\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.065448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065224    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rjbm\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-kube-api-access-5rjbm\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.065448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065235    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-bound-sa-token\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.065448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.065243    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-certificates\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:09.246893 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.246857    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"]
May 27 18:00:09.251356 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.251335    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.259215 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.259195    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 27 18:00:09.259351 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.259195    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 27 18:00:09.260157 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.260134    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 18:00:09.260270 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.260157    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2x2db\""
May 27 18:00:09.277763 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.277738    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"]
May 27 18:00:09.364745 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.364713    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7fqgq"]
May 27 18:00:09.367878 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.367854    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.367878 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.367865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.368036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.367944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.368036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.367974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8n6t\" (UniqueName: \"kubernetes.io/projected/53059369-5fb3-4d12-af95-2af32b324c3f-kube-api-access-g8n6t\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.368036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.368002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53059369-5fb3-4d12-af95-2af32b324c3f-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.376675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.376648    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8dlgx\""
May 27 18:00:09.377343 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.377324    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 18:00:09.380296 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.380278    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 18:00:09.381104 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.381088    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 18:00:09.469075 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469037    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53059369-5fb3-4d12-af95-2af32b324c3f-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.469075 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-root\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-metrics-client-ca\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2tp\" (UniqueName: \"kubernetes.io/projected/a5f51887-7daa-486a-90f6-13fd42bb0753-kube-api-access-gd2tp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469292    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-wtmp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-tls\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469506    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.469560 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-sys\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.470042 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469631    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8n6t\" (UniqueName: \"kubernetes.io/projected/53059369-5fb3-4d12-af95-2af32b324c3f-kube-api-access-g8n6t\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.470042 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-textfile\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.470042 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.469802    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53059369-5fb3-4d12-af95-2af32b324c3f-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.471869 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.471825    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.472033 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.472012    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53059369-5fb3-4d12-af95-2af32b324c3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.487035 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.487010    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8n6t\" (UniqueName: \"kubernetes.io/projected/53059369-5fb3-4d12-af95-2af32b324c3f-kube-api-access-g8n6t\") pod \"openshift-state-metrics-9c959559f-ddmqz\" (UID: \"53059369-5fb3-4d12-af95-2af32b324c3f\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.560959 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.560870    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"
May 27 18:00:09.571025 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.570994    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-textfile\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571102 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571047    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-root\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571102 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571067    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-metrics-client-ca\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571170 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571131    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-root\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571221 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571204    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2tp\" (UniqueName: \"kubernetes.io/projected/a5f51887-7daa-486a-90f6-13fd42bb0753-kube-api-access-gd2tp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571271 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571261    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-wtmp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571313 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571290    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571352 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571330    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571400 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571355    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-tls\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571400 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571384    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-sys\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571497 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571404    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-wtmp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571497 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571474    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f51887-7daa-486a-90f6-13fd42bb0753-sys\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571497 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571474    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-textfile\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571642 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571544    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-metrics-client-ca\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.571906 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.571885    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.573705 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.573681    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.573823 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.573807    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f51887-7daa-486a-90f6-13fd42bb0753-node-exporter-tls\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.582271 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.582235    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2tp\" (UniqueName: \"kubernetes.io/projected/a5f51887-7daa-486a-90f6-13fd42bb0753-kube-api-access-gd2tp\") pod \"node-exporter-7fqgq\" (UID: \"a5f51887-7daa-486a-90f6-13fd42bb0753\") " pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.676228 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.676196    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7fqgq"
May 27 18:00:09.685898 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:09.685867    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f51887_7daa_486a_90f6_13fd42bb0753.slice/crio-f346ac131b2ddd42615a9fcb92c5727c85b5b9dd87284bc2f96b56e93fca43b3 WatchSource:0}: Error finding container f346ac131b2ddd42615a9fcb92c5727c85b5b9dd87284bc2f96b56e93fca43b3: Status 404 returned error can't find the container with id f346ac131b2ddd42615a9fcb92c5727c85b5b9dd87284bc2f96b56e93fca43b3
May 27 18:00:09.699486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.699402    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz"]
May 27 18:00:09.701770 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:09.701745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53059369_5fb3_4d12_af95_2af32b324c3f.slice/crio-8c0f08d1a16a10e08d5c0eb60a5e8b5b0bebbba4567d60f8d9c2d0c0b43a8ac1 WatchSource:0}: Error finding container 8c0f08d1a16a10e08d5c0eb60a5e8b5b0bebbba4567d60f8d9c2d0c0b43a8ac1: Status 404 returned error can't find the container with id 8c0f08d1a16a10e08d5c0eb60a5e8b5b0bebbba4567d60f8d9c2d0c0b43a8ac1
May 27 18:00:09.860612 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.860571    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fqgq" event={"ID":"a5f51887-7daa-486a-90f6-13fd42bb0753","Type":"ContainerStarted","Data":"f346ac131b2ddd42615a9fcb92c5727c85b5b9dd87284bc2f96b56e93fca43b3"}
May 27 18:00:09.862213 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.862185    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz" event={"ID":"53059369-5fb3-4d12-af95-2af32b324c3f","Type":"ContainerStarted","Data":"be2d60bbb906d5c292da2bcbe59c4a891ef7c878190671958b3912b4100633b9"}
May 27 18:00:09.862333 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.862220    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz" event={"ID":"53059369-5fb3-4d12-af95-2af32b324c3f","Type":"ContainerStarted","Data":"faee37c8f40ba40a331038220a88ed7d0b0c661813e980d42507ea8dcca53087"}
May 27 18:00:09.862333 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.862229    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz" event={"ID":"53059369-5fb3-4d12-af95-2af32b324c3f","Type":"ContainerStarted","Data":"8c0f08d1a16a10e08d5c0eb60a5e8b5b0bebbba4567d60f8d9c2d0c0b43a8ac1"}
May 27 18:00:09.862333 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.862232    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b9dfb59d-5zc8r"
May 27 18:00:09.919026 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.918976    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b9dfb59d-5zc8r"]
May 27 18:00:09.924195 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:09.924161    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9b9dfb59d-5zc8r"]
May 27 18:00:10.076219 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.076132    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc611577-b07f-417e-b699-84ca6e3f7d2f-registry-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:10.436316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.436243    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 18:00:10.440014 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.439990    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.444249 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.444220    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 27 18:00:10.444419 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.444400    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 27 18:00:10.444595 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.444559    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-498p8\""
May 27 18:00:10.444992 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.444912    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 27 18:00:10.445100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445009    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 27 18:00:10.445437 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445385    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 27 18:00:10.445437 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445409    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 27 18:00:10.445862 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445676    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 27 18:00:10.445862 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445705    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 27 18:00:10.445862 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.445742    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 27 18:00:10.463543 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.463479    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 18:00:10.581406 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-out\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-volume\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-web-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkwj\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-kube-api-access-4jkwj\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.581889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.581800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683470 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683437    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683526    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683548    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkwj\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-kube-api-access-4jkwj\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683572    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683596    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683637    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-out\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.683675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683664    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.683699    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-volume\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684489    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684520    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-web-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684567    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684609    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.684809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.684637    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.686008 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.685978    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.687019 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.686965    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-out\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.687398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.687372    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.687473 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.687414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.688735 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.688712    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.688856 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.688749    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-config-volume\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.688924 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.688818    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.689078 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.689057    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-web-config\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.689169 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.689062    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.689379 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.689358    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.692723 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.692699    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkwj\" (UniqueName: \"kubernetes.io/projected/73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab-kube-api-access-4jkwj\") pod \"alertmanager-main-0\" (UID: \"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:10.753623 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:10.753586    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 18:00:11.137040 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.137004    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 18:00:11.140815 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:11.140779    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c6d907_7fe2_4bf0_bcd7_d4b1aa9cabab.slice/crio-857a6a25bdfcfd6216c1b0568c19e6111dc57eb813008dac83364897dab0266c WatchSource:0}: Error finding container 857a6a25bdfcfd6216c1b0568c19e6111dc57eb813008dac83364897dab0266c: Status 404 returned error can't find the container with id 857a6a25bdfcfd6216c1b0568c19e6111dc57eb813008dac83364897dab0266c
May 27 18:00:11.426388 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.426304    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc611577-b07f-417e-b699-84ca6e3f7d2f" path="/var/lib/kubelet/pods/dc611577-b07f-417e-b699-84ca6e3f7d2f/volumes"
May 27 18:00:11.869445 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.869393    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"857a6a25bdfcfd6216c1b0568c19e6111dc57eb813008dac83364897dab0266c"}
May 27 18:00:11.871205 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.871175    2558 generic.go:358] "Generic (PLEG): container finished" podID="a5f51887-7daa-486a-90f6-13fd42bb0753" containerID="99cf204c6d2127243ee19580e1ab04d7c788d5e9d9842493e16e08a1e7fa825c" exitCode=0
May 27 18:00:11.871358 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.871262    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fqgq" event={"ID":"a5f51887-7daa-486a-90f6-13fd42bb0753","Type":"ContainerDied","Data":"99cf204c6d2127243ee19580e1ab04d7c788d5e9d9842493e16e08a1e7fa825c"}
May 27 18:00:11.873616 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.873589    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz" event={"ID":"53059369-5fb3-4d12-af95-2af32b324c3f","Type":"ContainerStarted","Data":"6f7bcf3db7f110d267db355c646aba623a10f3c81253961f2b5578041db47cd9"}
May 27 18:00:11.917122 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:11.916621    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ddmqz" podStartSLOduration=1.764169829 podStartE2EDuration="2.916602074s" podCreationTimestamp="2026-05-27 18:00:09 +0000 UTC" firstStartedPulling="2026-05-27 18:00:09.821527597 +0000 UTC m=+147.045160329" lastFinishedPulling="2026-05-27 18:00:10.973959836 +0000 UTC m=+148.197592574" observedRunningTime="2026-05-27 18:00:11.914438253 +0000 UTC m=+149.138071003" watchObservedRunningTime="2026-05-27 18:00:11.916602074 +0000 UTC m=+149.140234828"
May 27 18:00:12.878143 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:12.878110    2558 generic.go:358] "Generic (PLEG): container finished" podID="73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab" containerID="3497545dab760a6955468b17b67ab692f35e4a5c5cca0b4cad2a75654fcfbfd8" exitCode=0
May 27 18:00:12.878578 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:12.878206    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerDied","Data":"3497545dab760a6955468b17b67ab692f35e4a5c5cca0b4cad2a75654fcfbfd8"}
May 27 18:00:12.880242 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:12.880207    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fqgq" event={"ID":"a5f51887-7daa-486a-90f6-13fd42bb0753","Type":"ContainerStarted","Data":"bbf763b5648333a43b38d45d8e206f556377d57d5d2f61eb8a67920c146d8d0a"}
May 27 18:00:12.880242 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:12.880239    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fqgq" event={"ID":"a5f51887-7daa-486a-90f6-13fd42bb0753","Type":"ContainerStarted","Data":"90873a6b85a6028506c523c61fc144eef02975987b0730ab352c542d8a18f3e3"}
May 27 18:00:12.959632 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:12.959572    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7fqgq" podStartSLOduration=2.675300637 podStartE2EDuration="3.959552761s" podCreationTimestamp="2026-05-27 18:00:09 +0000 UTC" firstStartedPulling="2026-05-27 18:00:09.68743459 +0000 UTC m=+146.911067318" lastFinishedPulling="2026-05-27 18:00:10.971686709 +0000 UTC m=+148.195319442" observedRunningTime="2026-05-27 18:00:12.959371952 +0000 UTC m=+150.183004705" watchObservedRunningTime="2026-05-27 18:00:12.959552761 +0000 UTC m=+150.183185512"
May 27 18:00:13.615955 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.615926    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"]
May 27 18:00:13.619009 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.618994    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.621929 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.621904    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 27 18:00:13.623031 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.623006    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 27 18:00:13.623162 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.623095    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fvelvt5b4prtj\""
May 27 18:00:13.623162 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.623122    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 18:00:13.623259 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.623122    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 27 18:00:13.623259 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.623091    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-prtjc\""
May 27 18:00:13.630853 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.629420    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"]
May 27 18:00:13.712281 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-metrics-server-audit-profiles\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712440 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-tls\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712440 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsg8c\" (UniqueName: \"kubernetes.io/projected/b8b8d875-c900-4afd-855c-cb90b65a4d9e-kube-api-access-zsg8c\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712552 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-client-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712613 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712613 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8b8d875-c900-4afd-855c-cb90b65a4d9e-audit-log\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.712710 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.712658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-client-certs\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813459 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813425    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-client-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813467    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813488    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8b8d875-c900-4afd-855c-cb90b65a4d9e-audit-log\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813521    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-client-certs\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813544    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-metrics-server-audit-profiles\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813597    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-tls\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.813643 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.813623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsg8c\" (UniqueName: \"kubernetes.io/projected/b8b8d875-c900-4afd-855c-cb90b65a4d9e-kube-api-access-zsg8c\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.814223 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.814196    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8b8d875-c900-4afd-855c-cb90b65a4d9e-audit-log\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.814586 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.814560    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.815220 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.815196    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8b8d875-c900-4afd-855c-cb90b65a4d9e-metrics-server-audit-profiles\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.816149 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.816123    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-client-certs\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.816233 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.816214    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-client-ca-bundle\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.816269 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.816237    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8b8d875-c900-4afd-855c-cb90b65a4d9e-secret-metrics-server-tls\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.823117 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.823093    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsg8c\" (UniqueName: \"kubernetes.io/projected/b8b8d875-c900-4afd-855c-cb90b65a4d9e-kube-api-access-zsg8c\") pod \"metrics-server-5dcc4446d6-l6xj2\" (UID: \"b8b8d875-c900-4afd-855c-cb90b65a4d9e\") " pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.928781 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.928638    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:13.978160 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.978127    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:00:13.983230 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.983204    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:13.992358 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:13.992291    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 27 18:00:14.001730 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.001693    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:00:14.012056 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.012026    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"]
May 27 18:00:14.015120 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.015099    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:14.019777 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.019693    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 27 18:00:14.019980 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.019969    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-q25ws\""
May 27 18:00:14.031745 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.031717    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"]
May 27 18:00:14.082538 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.082516    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"]
May 27 18:00:14.084453 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:14.084423    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b8d875_c900_4afd_855c_cb90b65a4d9e.slice/crio-3d4ea6977ba7e22785450b28e56cdd18666644466223f08c3348b2db100e908c WatchSource:0}: Error finding container 3d4ea6977ba7e22785450b28e56cdd18666644466223f08c3348b2db100e908c: Status 404 returned error can't find the container with id 3d4ea6977ba7e22785450b28e56cdd18666644466223f08c3348b2db100e908c
May 27 18:00:14.116144 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116296 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116296 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116296 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6ffxh\" (UID: \"3130bae5-9a58-4fad-b498-ca7d04996324\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:14.116296 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116431 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vhw2\" (UniqueName: \"kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116431 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.116431 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.116375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.217621 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217587    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.217766 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217702    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.217766 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217730    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.217766 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217760    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6ffxh\" (UID: \"3130bae5-9a58-4fad-b498-ca7d04996324\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:14.217958 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217791    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.217958 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:14.217898    2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 27 18:00:14.217958 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.217932    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vhw2\" (UniqueName: \"kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.218089 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:14.217980    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert podName:3130bae5-9a58-4fad-b498-ca7d04996324 nodeName:}" failed. No retries permitted until 2026-05-27 18:00:14.7179602 +0000 UTC m=+151.941592928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-6ffxh" (UID: "3130bae5-9a58-4fad-b498-ca7d04996324") : secret "monitoring-plugin-cert" not found
May 27 18:00:14.218089 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.218003    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.218089 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.218053    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.218460 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.218433    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.218460 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.218433    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.218596 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.218535    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.219145 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.219123    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.220590 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.220568    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.220669 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.220618    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.226940 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.226913    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vhw2\" (UniqueName: \"kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2\") pod \"console-57f4d547dd-lwx6v\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") " pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.297628 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.297591    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:14.717117 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.717099    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:00:14.719105 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:14.719067    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2fd1ce_14ac_4d10_a22e_f20f5cc9ca9c.slice/crio-1e4c13d0deb71c1104cc5b7b64158a22789277c23254219c7c6278807ee35e19 WatchSource:0}: Error finding container 1e4c13d0deb71c1104cc5b7b64158a22789277c23254219c7c6278807ee35e19: Status 404 returned error can't find the container with id 1e4c13d0deb71c1104cc5b7b64158a22789277c23254219c7c6278807ee35e19
May 27 18:00:14.722223 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.721975    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6ffxh\" (UID: \"3130bae5-9a58-4fad-b498-ca7d04996324\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:14.724999 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.724975    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3130bae5-9a58-4fad-b498-ca7d04996324-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6ffxh\" (UID: \"3130bae5-9a58-4fad-b498-ca7d04996324\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:14.889889 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.889847    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2" event={"ID":"b8b8d875-c900-4afd-855c-cb90b65a4d9e","Type":"ContainerStarted","Data":"3d4ea6977ba7e22785450b28e56cdd18666644466223f08c3348b2db100e908c"}
May 27 18:00:14.892417 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.892345    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"5d3ac826cd7ad722a580f39b4ef57d059f037ec89cd4da73bd0244b7dd37a193"}
May 27 18:00:14.892417 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.892374    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"1028ed15f9f2e5bf4abcc1e8a866866c4bf5f041a1ed9182c722b020e458a0cf"}
May 27 18:00:14.892417 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.892384    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"1fea3c7d9d03ee55aa04c24b332454d2d16cb7e20c4c48396d97c7e7ef1144dc"}
May 27 18:00:14.894148 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.894098    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4d547dd-lwx6v" event={"ID":"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c","Type":"ContainerStarted","Data":"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"}
May 27 18:00:14.894148 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.894128    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4d547dd-lwx6v" event={"ID":"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c","Type":"ContainerStarted","Data":"1e4c13d0deb71c1104cc5b7b64158a22789277c23254219c7c6278807ee35e19"}
May 27 18:00:14.917424 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.917355    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57f4d547dd-lwx6v" podStartSLOduration=1.917341921 podStartE2EDuration="1.917341921s" podCreationTimestamp="2026-05-27 18:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:00:14.915827616 +0000 UTC m=+152.139460378" watchObservedRunningTime="2026-05-27 18:00:14.917341921 +0000 UTC m=+152.140974673"
May 27 18:00:14.928824 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:14.928703    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:15.105499 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.105466    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"]
May 27 18:00:15.108626 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:15.108452    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3130bae5_9a58_4fad_b498_ca7d04996324.slice/crio-47cc32d9e311ad418dfe618a0f97845ff3547b320d748610c26e3df3b23011b5 WatchSource:0}: Error finding container 47cc32d9e311ad418dfe618a0f97845ff3547b320d748610c26e3df3b23011b5: Status 404 returned error can't find the container with id 47cc32d9e311ad418dfe618a0f97845ff3547b320d748610c26e3df3b23011b5
May 27 18:00:15.540160 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.540124    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 18:00:15.544932 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.544908    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.548384 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.548327    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 27 18:00:15.548384 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.548365    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 27 18:00:15.548690 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.548674    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 27 18:00:15.549030 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549014    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549352    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549362    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549405    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549422    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549470    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 27 18:00:15.549525 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549490    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dbcq2c1g85cq7\""
May 27 18:00:15.549884 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549541    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 27 18:00:15.549951 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.549911    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 27 18:00:15.550155 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.550126    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z8vxb\""
May 27 18:00:15.552222 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.552201    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 27 18:00:15.558181 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.558150    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 18:00:15.632359 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632555 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632555 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632555 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632555 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632555 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.632774 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.633100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26zx8\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-kube-api-access-26zx8\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.633100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.633100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.633100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.632991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.633100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.633013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.733874 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.733810    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.733898    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.733920    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.733945    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734001    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734029    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734061 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734053    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734088    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734112    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734168    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734213    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734261    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26zx8\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-kube-api-access-26zx8\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734279    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734353    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734421    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734446    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734487    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.734559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.734512    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.735822 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.735503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.735822 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.735740    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.737513 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.737482    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.737611 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.737567    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51e33e-c539-4288-beba-a67df7deccc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.737716 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.737683    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.738329 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.737975    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.739472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.739009    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.739472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.739024    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.739472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.739114    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.739472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.739292    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51e33e-c539-4288-beba-a67df7deccc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.739910 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.739887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.740314 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.740292    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.740418 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.740332    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.740718 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.740692    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.741886 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.741823    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.742520 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.742496    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f51e33e-c539-4288-beba-a67df7deccc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.744642 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.744623    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26zx8\" (UniqueName: \"kubernetes.io/projected/9f51e33e-c539-4288-beba-a67df7deccc3-kube-api-access-26zx8\") pod \"prometheus-k8s-0\" (UID: \"9f51e33e-c539-4288-beba-a67df7deccc3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.858825 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.858796    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:15.899763 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.899720    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2" event={"ID":"b8b8d875-c900-4afd-855c-cb90b65a4d9e","Type":"ContainerStarted","Data":"e657dead1f090004e91cde3d96943e0f455a69eae8baa7b58ace1239992b3036"}
May 27 18:00:15.902700 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.902642    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"c01dc976b1aa90ca437e9468a95ce32d0de2b7648083f1149862014b3c5a630e"}
May 27 18:00:15.902700 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.902667    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"bb0d8ad2f7c505b12fe128e87f0cb6a0941e3dd9978c5eaafbf90be0b9846acb"}
May 27 18:00:15.904088 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.904043    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh" event={"ID":"3130bae5-9a58-4fad-b498-ca7d04996324","Type":"ContainerStarted","Data":"47cc32d9e311ad418dfe618a0f97845ff3547b320d748610c26e3df3b23011b5"}
May 27 18:00:15.923171 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:15.923066    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2" podStartSLOduration=1.189146164 podStartE2EDuration="2.923045582s" podCreationTimestamp="2026-05-27 18:00:13 +0000 UTC" firstStartedPulling="2026-05-27 18:00:14.086246202 +0000 UTC m=+151.309878929" lastFinishedPulling="2026-05-27 18:00:15.820145616 +0000 UTC m=+153.043778347" observedRunningTime="2026-05-27 18:00:15.920915088 +0000 UTC m=+153.144547844" watchObservedRunningTime="2026-05-27 18:00:15.923045582 +0000 UTC m=+153.146678317"
May 27 18:00:16.006908 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.006870    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 18:00:16.011449 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:16.011409    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f51e33e_c539_4288_beba_a67df7deccc3.slice/crio-e553d55271866f48746401de9ba499750014f5112c8a8b4028e1685a94472ca1 WatchSource:0}: Error finding container e553d55271866f48746401de9ba499750014f5112c8a8b4028e1685a94472ca1: Status 404 returned error can't find the container with id e553d55271866f48746401de9ba499750014f5112c8a8b4028e1685a94472ca1
May 27 18:00:16.912392 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.912349    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab","Type":"ContainerStarted","Data":"7dc0824adffcfbf4abfa36256d7428a81a46bb0fb443fd87c5cd3875e30e2de1"}
May 27 18:00:16.913689 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.913664    2558 generic.go:358] "Generic (PLEG): container finished" podID="9f51e33e-c539-4288-beba-a67df7deccc3" containerID="2e4d40f857f10dbdc3da03e6635ee7aa78e6646b352e442f23dac7a76044e49d" exitCode=0
May 27 18:00:16.913807 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.913744    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerDied","Data":"2e4d40f857f10dbdc3da03e6635ee7aa78e6646b352e442f23dac7a76044e49d"}
May 27 18:00:16.913807 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.913774    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"e553d55271866f48746401de9ba499750014f5112c8a8b4028e1685a94472ca1"}
May 27 18:00:16.944747 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:16.944379    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.748453327 podStartE2EDuration="6.944361777s" podCreationTimestamp="2026-05-27 18:00:10 +0000 UTC" firstStartedPulling="2026-05-27 18:00:11.143165819 +0000 UTC m=+148.366798560" lastFinishedPulling="2026-05-27 18:00:16.339074278 +0000 UTC m=+153.562707010" observedRunningTime="2026-05-27 18:00:16.942959681 +0000 UTC m=+154.166592432" watchObservedRunningTime="2026-05-27 18:00:16.944361777 +0000 UTC m=+154.167994530"
May 27 18:00:17.918118 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:17.918087    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh" event={"ID":"3130bae5-9a58-4fad-b498-ca7d04996324","Type":"ContainerStarted","Data":"98483d6c6ad9821e70a088be9f5429adedba1e44a8084c8d233bb41ec78560a2"}
May 27 18:00:17.918589 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:17.918277    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:17.923094 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:17.923066    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh"
May 27 18:00:17.938552 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:17.938500    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6ffxh" podStartSLOduration=3.107209621 podStartE2EDuration="4.938484319s" podCreationTimestamp="2026-05-27 18:00:13 +0000 UTC" firstStartedPulling="2026-05-27 18:00:15.110477603 +0000 UTC m=+152.334110332" lastFinishedPulling="2026-05-27 18:00:16.941752301 +0000 UTC m=+154.165385030" observedRunningTime="2026-05-27 18:00:17.937105096 +0000 UTC m=+155.160737846" watchObservedRunningTime="2026-05-27 18:00:17.938484319 +0000 UTC m=+155.162117069"
May 27 18:00:20.651383 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:20.651344    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nphn2" podUID="13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be"
May 27 18:00:20.669514 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:20.669468    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-g7jgg" podUID="77d7593e-e39a-40a4-be4c-6c4a3df2d792"
May 27 18:00:20.928897 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:20.928808    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"11243ee57f22fac962a40e495f80e5b09497636996cc0bd351c59b4edfdad0cf"}
May 27 18:00:20.928897 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:20.928863    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"0d4c80237b32beda84f18bd94c7d49f2216f46591c01829fe69a5fb91579960d"}
May 27 18:00:20.929070 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:20.928915    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nphn2"
May 27 18:00:22.938390 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:22.938349    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"7be30aaa04b1d19e25c2cb44389d7a1ad34b7d40ce1a5520d99ee7fd00ab98b8"}
May 27 18:00:22.938390 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:22.938394    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"ffa20f71d13e1404202c8e25f3e7f35710015d8cc7dd95c0c9b6085962addbda"}
May 27 18:00:22.938914 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:22.938409    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"02cce0d6847ab3b8ab93b769fd16f52755f4f6ebcb49f7ae9ee9c598b5299ea0"}
May 27 18:00:22.938914 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:22.938421    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f51e33e-c539-4288-beba-a67df7deccc3","Type":"ContainerStarted","Data":"38a89c5e74324604facdc09328e28fe6f4ae9196d53f9adf88c88d2bb04a7426"}
May 27 18:00:22.974806 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:22.974760    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.006770959 podStartE2EDuration="7.974744106s" podCreationTimestamp="2026-05-27 18:00:15 +0000 UTC" firstStartedPulling="2026-05-27 18:00:16.937974082 +0000 UTC m=+154.161606811" lastFinishedPulling="2026-05-27 18:00:21.90594723 +0000 UTC m=+159.129579958" observedRunningTime="2026-05-27 18:00:22.972260284 +0000 UTC m=+160.195893034" watchObservedRunningTime="2026-05-27 18:00:22.974744106 +0000 UTC m=+160.198376853"
May 27 18:00:24.298479 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:24.298439    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:24.298479 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:24.298490    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:24.303419 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:24.303398    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:24.947757 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:24.947729    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:00:25.629024 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.628987    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 18:00:25.629505 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.629046    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 18:00:25.631533 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.631502    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be-metrics-tls\") pod \"dns-default-nphn2\" (UID: \"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be\") " pod="openshift-dns/dns-default-nphn2"
May 27 18:00:25.631681 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.631662    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77d7593e-e39a-40a4-be4c-6c4a3df2d792-cert\") pod \"ingress-canary-g7jgg\" (UID: \"77d7593e-e39a-40a4-be4c-6c4a3df2d792\") " pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 18:00:25.732067 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.732036    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfkw\""
May 27 18:00:25.740293 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.740255    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nphn2"
May 27 18:00:25.859356 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.859322    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:00:25.874406 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.874374    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nphn2"]
May 27 18:00:25.877881 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:25.877850    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d4ce4d_dddc_46f0_94fa_8c21bcd8b0be.slice/crio-3a03599fc6f98ec8db44bdfeea9241d00c28a2075dab705cf3d1468479912f78 WatchSource:0}: Error finding container 3a03599fc6f98ec8db44bdfeea9241d00c28a2075dab705cf3d1468479912f78: Status 404 returned error can't find the container with id 3a03599fc6f98ec8db44bdfeea9241d00c28a2075dab705cf3d1468479912f78
May 27 18:00:25.947967 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:25.947930    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nphn2" event={"ID":"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be","Type":"ContainerStarted","Data":"3a03599fc6f98ec8db44bdfeea9241d00c28a2075dab705cf3d1468479912f78"}
May 27 18:00:27.956266 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:27.956224    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nphn2" event={"ID":"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be","Type":"ContainerStarted","Data":"5d794692ceb56a351c3cacd01eed82950a2f756065d08c511aeca1a261e2dc30"}
May 27 18:00:27.956266 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:27.956262    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nphn2" event={"ID":"13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be","Type":"ContainerStarted","Data":"f2f09a3db82d3ed435614da873ade2aeff67233c8c9b309b03c6c643852216b4"}
May 27 18:00:27.956693 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:27.956356    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nphn2"
May 27 18:00:27.976126 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:27.976079    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nphn2" podStartSLOduration=129.716668207 podStartE2EDuration="2m10.976063939s" podCreationTimestamp="2026-05-27 17:58:17 +0000 UTC" firstStartedPulling="2026-05-27 18:00:25.879747854 +0000 UTC m=+163.103380585" lastFinishedPulling="2026-05-27 18:00:27.139143406 +0000 UTC m=+164.362776317" observedRunningTime="2026-05-27 18:00:27.974789871 +0000 UTC m=+165.198422634" watchObservedRunningTime="2026-05-27 18:00:27.976063939 +0000 UTC m=+165.199696700"
May 27 18:00:31.870303 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:31.870211    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84b6fc67bf-cg8b4" podUID="42b9005f-9b05-43d4-b64e-a777696e3b58" containerName="console" containerID="cri-o://fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5" gracePeriod=15
May 27 18:00:32.112679 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.112656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84b6fc67bf-cg8b4_42b9005f-9b05-43d4-b64e-a777696e3b58/console/0.log"
May 27 18:00:32.112794 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.112717    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:32.188472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188386    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188429    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188472 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188452    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188742 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188477    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh9b6\" (UniqueName: \"kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188742 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188536    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188742 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188596    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca\") pod \"42b9005f-9b05-43d4-b64e-a777696e3b58\" (UID: \"42b9005f-9b05-43d4-b64e-a777696e3b58\") "
May 27 18:00:32.188930 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188827    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config" (OuterVolumeSpecName: "console-config") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:00:32.188930 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.188864    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:00:32.189062 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.189043    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca" (OuterVolumeSpecName: "service-ca") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:00:32.190932 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.190902    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:00:32.191041 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.190945    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:00:32.191041 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.190962    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6" (OuterVolumeSpecName: "kube-api-access-xh9b6") pod "42b9005f-9b05-43d4-b64e-a777696e3b58" (UID: "42b9005f-9b05-43d4-b64e-a777696e3b58"). InnerVolumeSpecName "kube-api-access-xh9b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:00:32.289490 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289456    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.289490 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289485    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.289490 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289495    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.289715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289504    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9005f-9b05-43d4-b64e-a777696e3b58-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.289715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289513    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9005f-9b05-43d4-b64e-a777696e3b58-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.289715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.289522    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh9b6\" (UniqueName: \"kubernetes.io/projected/42b9005f-9b05-43d4-b64e-a777696e3b58-kube-api-access-xh9b6\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:00:32.975497 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975468    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84b6fc67bf-cg8b4_42b9005f-9b05-43d4-b64e-a777696e3b58/console/0.log"
May 27 18:00:32.975916 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975508    2558 generic.go:358] "Generic (PLEG): container finished" podID="42b9005f-9b05-43d4-b64e-a777696e3b58" containerID="fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5" exitCode=2
May 27 18:00:32.975916 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975573    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b6fc67bf-cg8b4" event={"ID":"42b9005f-9b05-43d4-b64e-a777696e3b58","Type":"ContainerDied","Data":"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"}
May 27 18:00:32.975916 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975577    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b6fc67bf-cg8b4"
May 27 18:00:32.975916 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975597    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b6fc67bf-cg8b4" event={"ID":"42b9005f-9b05-43d4-b64e-a777696e3b58","Type":"ContainerDied","Data":"c6a084e4c1a94ad82fdbc785003fae01c40a024bb34c33a0dd1bb479986a5b09"}
May 27 18:00:32.975916 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.975611    2558 scope.go:117] "RemoveContainer" containerID="fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"
May 27 18:00:32.984938 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.984910    2558 scope.go:117] "RemoveContainer" containerID="fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"
May 27 18:00:32.985205 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:00:32.985179    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5\": container with ID starting with fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5 not found: ID does not exist" containerID="fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"
May 27 18:00:32.985263 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.985216    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5"} err="failed to get container status \"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5\": rpc error: code = NotFound desc = could not find container \"fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5\": container with ID starting with fec1def422eb182d121a9dea4e06b8014d68db6b9dc7f5c4809b2de3be9b41f5 not found: ID does not exist"
May 27 18:00:32.998854 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:32.998802    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 18:00:33.004481 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:33.004454    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b6fc67bf-cg8b4"]
May 27 18:00:33.422567 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:33.422485    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b9005f-9b05-43d4-b64e-a777696e3b58" path="/var/lib/kubelet/pods/42b9005f-9b05-43d4-b64e-a777696e3b58/volumes"
May 27 18:00:33.928978 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:33.928919    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:33.928978 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:33.928994    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:34.417975 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:34.417926    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 18:00:34.420807 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:34.420787    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mszw7\""
May 27 18:00:34.428977 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:34.428960    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7jgg"
May 27 18:00:34.561815 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:34.561788    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7jgg"]
May 27 18:00:34.563691 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:00:34.563666    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d7593e_e39a_40a4_be4c_6c4a3df2d792.slice/crio-bde3648020a07d7c474b5d1470a106aec3b66efd6a6653a4421c0ac499271cdf WatchSource:0}: Error finding container bde3648020a07d7c474b5d1470a106aec3b66efd6a6653a4421c0ac499271cdf: Status 404 returned error can't find the container with id bde3648020a07d7c474b5d1470a106aec3b66efd6a6653a4421c0ac499271cdf
May 27 18:00:34.983349 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:34.983305    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7jgg" event={"ID":"77d7593e-e39a-40a4-be4c-6c4a3df2d792","Type":"ContainerStarted","Data":"bde3648020a07d7c474b5d1470a106aec3b66efd6a6653a4421c0ac499271cdf"}
May 27 18:00:36.990759 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:36.990717    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7jgg" event={"ID":"77d7593e-e39a-40a4-be4c-6c4a3df2d792","Type":"ContainerStarted","Data":"58a8cab05cc59039b8e4aa01344c02818f3470b60032b3f96af85786e472bfa9"}
May 27 18:00:37.007516 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:37.007468    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g7jgg" podStartSLOduration=138.461032975 podStartE2EDuration="2m20.007453144s" podCreationTimestamp="2026-05-27 17:58:17 +0000 UTC" firstStartedPulling="2026-05-27 18:00:34.56569896 +0000 UTC m=+171.789331696" lastFinishedPulling="2026-05-27 18:00:36.112119134 +0000 UTC m=+173.335751865" observedRunningTime="2026-05-27 18:00:37.006348254 +0000 UTC m=+174.229981029" watchObservedRunningTime="2026-05-27 18:00:37.007453144 +0000 UTC m=+174.231085905"
May 27 18:00:37.963895 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:37.963867    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nphn2"
May 27 18:00:40.000894 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.000862    2558 generic.go:358] "Generic (PLEG): container finished" podID="8921d9e6-033c-4afd-b0ad-46c8ec5c48df" containerID="5f9a78aabdb029ede7f05b28066bd0986678000084221efe5fd0752a633f779a" exitCode=0
May 27 18:00:40.001252 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.000935    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv" event={"ID":"8921d9e6-033c-4afd-b0ad-46c8ec5c48df","Type":"ContainerDied","Data":"5f9a78aabdb029ede7f05b28066bd0986678000084221efe5fd0752a633f779a"}
May 27 18:00:40.001328 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.001268    2558 scope.go:117] "RemoveContainer" containerID="5f9a78aabdb029ede7f05b28066bd0986678000084221efe5fd0752a633f779a"
May 27 18:00:40.002283 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.002260    2558 generic.go:358] "Generic (PLEG): container finished" podID="999c1733-2fc5-4319-8cde-955d271cf188" containerID="6c08889b41b32789b2827b709cf8a2c434e61d044b99bea16bbad7d5aa7bb950" exitCode=0
May 27 18:00:40.002384 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.002368    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp" event={"ID":"999c1733-2fc5-4319-8cde-955d271cf188","Type":"ContainerDied","Data":"6c08889b41b32789b2827b709cf8a2c434e61d044b99bea16bbad7d5aa7bb950"}
May 27 18:00:40.002719 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:40.002671    2558 scope.go:117] "RemoveContainer" containerID="6c08889b41b32789b2827b709cf8a2c434e61d044b99bea16bbad7d5aa7bb950"
May 27 18:00:41.006744 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:41.006702    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wcshv" event={"ID":"8921d9e6-033c-4afd-b0ad-46c8ec5c48df","Type":"ContainerStarted","Data":"2dc9586a7ed30fcc8b656e5e04d8501233fdb8f0e8f28e139d9d42d055b9fa42"}
May 27 18:00:41.008457 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:41.008437    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-66psp" event={"ID":"999c1733-2fc5-4319-8cde-955d271cf188","Type":"ContainerStarted","Data":"3367db601a15f87a81842b9b5e03b8a1261e3045563c0340a690092e91827157"}
May 27 18:00:53.935665 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:53.935637    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:00:53.939380 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:00:53.939353    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dcc4446d6-l6xj2"
May 27 18:01:01.073272 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:01.073234    2558 generic.go:358] "Generic (PLEG): container finished" podID="e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7" containerID="6c8e6cf0496e9c960c1c48648759dd75ce1d581f39e8ac78e15d7fc6d48e47b1" exitCode=0
May 27 18:01:01.073634 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:01.073312    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7" event={"ID":"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7","Type":"ContainerDied","Data":"6c8e6cf0496e9c960c1c48648759dd75ce1d581f39e8ac78e15d7fc6d48e47b1"}
May 27 18:01:01.073693 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:01.073668    2558 scope.go:117] "RemoveContainer" containerID="6c8e6cf0496e9c960c1c48648759dd75ce1d581f39e8ac78e15d7fc6d48e47b1"
May 27 18:01:02.077709 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:02.077666    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xqqn7" event={"ID":"e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7","Type":"ContainerStarted","Data":"0c41ef1336105039b160d55f95b9e1869f5fa0428d5ede57690d4cf271b804dd"}
May 27 18:01:15.859972 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:15.859933    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:01:15.877273 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:15.877241    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:01:16.142629 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:16.142541    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 18:01:58.429086 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:01:58.429047    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:02:23.450521 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.450482    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57f4d547dd-lwx6v" podUID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" containerName="console" containerID="cri-o://280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca" gracePeriod=15
May 27 18:02:23.704952 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.704889    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57f4d547dd-lwx6v_ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c/console/0.log"
May 27 18:02:23.705067 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.704954    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:02:23.869799 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869759    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.869799 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869810    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869825    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869867    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869892    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869932    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vhw2\" (UniqueName: \"kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.869962    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle\") pod \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\" (UID: \"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c\") "
May 27 18:02:23.870337 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.870313    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:02:23.870446 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.870326    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:02:23.870507 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.870452    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:02:23.870507 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.870490    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config" (OuterVolumeSpecName: "console-config") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:02:23.872225 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.872202    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:02:23.872382 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.872359    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:02:23.872445 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.872428    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2" (OuterVolumeSpecName: "kube-api-access-4vhw2") pod "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" (UID: "ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c"). InnerVolumeSpecName "kube-api-access-4vhw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970503    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vhw2\" (UniqueName: \"kubernetes.io/projected/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-kube-api-access-4vhw2\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970537    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970546    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970558    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970568    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970576    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:23.970593 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:23.970587    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:02:24.339398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339315    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57f4d547dd-lwx6v_ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c/console/0.log"
May 27 18:02:24.339398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339351    2558 generic.go:358] "Generic (PLEG): container finished" podID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" containerID="280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca" exitCode=2
May 27 18:02:24.339574 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339431    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4d547dd-lwx6v"
May 27 18:02:24.339574 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339448    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4d547dd-lwx6v" event={"ID":"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c","Type":"ContainerDied","Data":"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"}
May 27 18:02:24.339574 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339498    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4d547dd-lwx6v" event={"ID":"ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c","Type":"ContainerDied","Data":"1e4c13d0deb71c1104cc5b7b64158a22789277c23254219c7c6278807ee35e19"}
May 27 18:02:24.339574 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.339515    2558 scope.go:117] "RemoveContainer" containerID="280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"
May 27 18:02:24.349138 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.349117    2558 scope.go:117] "RemoveContainer" containerID="280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"
May 27 18:02:24.349447 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:02:24.349428    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca\": container with ID starting with 280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca not found: ID does not exist" containerID="280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"
May 27 18:02:24.349552 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.349458    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca"} err="failed to get container status \"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca\": rpc error: code = NotFound desc = could not find container \"280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca\": container with ID starting with 280d57f821c4bf585e3eec8985d61872e06788aa40a95c89779997307901f6ca not found: ID does not exist"
May 27 18:02:24.361475 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.361444    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:02:24.363481 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:24.363457    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f4d547dd-lwx6v"]
May 27 18:02:25.422433 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:25.422396    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" path="/var/lib/kubelet/pods/ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c/volumes"
May 27 18:02:43.322679 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:43.322651    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:02:43.323109 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:43.322663    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:02:43.327332 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:02:43.327313    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 27 18:03:53.827130 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827045    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"]
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827359    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b9005f-9b05-43d4-b64e-a777696e3b58" containerName="console"
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827369    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b9005f-9b05-43d4-b64e-a777696e3b58" containerName="console"
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827389    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" containerName="console"
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827406    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" containerName="console"
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827466    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff2fd1ce-14ac-4d10-a22e-f20f5cc9ca9c" containerName="console"
May 27 18:03:53.827582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.827478    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="42b9005f-9b05-43d4-b64e-a777696e3b58" containerName="console"
May 27 18:03:53.830477 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.830458    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:53.833715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.833689    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 18:03:53.833715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.833703    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 18:03:53.833938 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.833740    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zjbrd\""
May 27 18:03:53.834071 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.834058    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 18:03:53.834527 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.834508    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 18:03:53.854678 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.854650    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"]
May 27 18:03:53.968299 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.968256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:53.968462 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.968347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhx7l\" (UniqueName: \"kubernetes.io/projected/4b9108ed-27c7-4088-b829-4189581f9ef6-kube-api-access-xhx7l\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:53.968462 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:53.968373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.069576 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.069533    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhx7l\" (UniqueName: \"kubernetes.io/projected/4b9108ed-27c7-4088-b829-4189581f9ef6-kube-api-access-xhx7l\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.069576 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.069577    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.069790 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.069637    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.072211 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.072185    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.072335 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.072254    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b9108ed-27c7-4088-b829-4189581f9ef6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.083993 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.083937    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhx7l\" (UniqueName: \"kubernetes.io/projected/4b9108ed-27c7-4088-b829-4189581f9ef6-kube-api-access-xhx7l\") pod \"opendatahub-operator-controller-manager-667cd477ff-zb4zv\" (UID: \"4b9108ed-27c7-4088-b829-4189581f9ef6\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.141747 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.141707    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:54.279038 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.279008    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"]
May 27 18:03:54.281958 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:03:54.281930    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9108ed_27c7_4088_b829_4189581f9ef6.slice/crio-29320e1d9b182fc2334b6ec15f7f949e3d319a702f72b567c9baa61cee5648df WatchSource:0}: Error finding container 29320e1d9b182fc2334b6ec15f7f949e3d319a702f72b567c9baa61cee5648df: Status 404 returned error can't find the container with id 29320e1d9b182fc2334b6ec15f7f949e3d319a702f72b567c9baa61cee5648df
May 27 18:03:54.283706 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.283690    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:03:54.606241 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:54.606199    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv" event={"ID":"4b9108ed-27c7-4088-b829-4189581f9ef6","Type":"ContainerStarted","Data":"29320e1d9b182fc2334b6ec15f7f949e3d319a702f72b567c9baa61cee5648df"}
May 27 18:03:57.617255 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:57.617219    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv" event={"ID":"4b9108ed-27c7-4088-b829-4189581f9ef6","Type":"ContainerStarted","Data":"4ff08ffa1eadbe5d572a37cd6e0a96b7e48794b27626acd4d0cbf40e5f81fd5c"}
May 27 18:03:57.617641 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:57.617331    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:03:57.639468 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:03:57.639414    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv" podStartSLOduration=2.039740076 podStartE2EDuration="4.639399747s" podCreationTimestamp="2026-05-27 18:03:53 +0000 UTC" firstStartedPulling="2026-05-27 18:03:54.283808838 +0000 UTC m=+371.507441566" lastFinishedPulling="2026-05-27 18:03:56.883468508 +0000 UTC m=+374.107101237" observedRunningTime="2026-05-27 18:03:57.638673296 +0000 UTC m=+374.862306046" watchObservedRunningTime="2026-05-27 18:03:57.639399747 +0000 UTC m=+374.863032493"
May 27 18:04:08.623860 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:08.623797    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-zb4zv"
May 27 18:04:09.566517 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.566475    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"]
May 27 18:04:09.569869 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.569825    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.572536 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.572511    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 27 18:04:09.572536 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.572513    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 27 18:04:09.573672 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.573654    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 27 18:04:09.573773 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.573753    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5pdzm\""
May 27 18:04:09.573859 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.573819    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 27 18:04:09.573924 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.573852    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 27 18:04:09.578448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.578427    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"]
May 27 18:04:09.713986 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.713942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6lv\" (UniqueName: \"kubernetes.io/projected/ec80af94-7488-44a7-952d-ea5602a69a7e-kube-api-access-sk6lv\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.713986 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.713990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.714398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.714079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec80af94-7488-44a7-952d-ea5602a69a7e-manager-config\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.714398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.714122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.814814 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.814774    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6lv\" (UniqueName: \"kubernetes.io/projected/ec80af94-7488-44a7-952d-ea5602a69a7e-kube-api-access-sk6lv\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.814814 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.814814    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.815075 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.814893    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec80af94-7488-44a7-952d-ea5602a69a7e-manager-config\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.815075 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.814930    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.815597 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.815573    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec80af94-7488-44a7-952d-ea5602a69a7e-manager-config\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.817660 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.817596    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.817746 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.817672    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec80af94-7488-44a7-952d-ea5602a69a7e-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.830378 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.830349    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6lv\" (UniqueName: \"kubernetes.io/projected/ec80af94-7488-44a7-952d-ea5602a69a7e-kube-api-access-sk6lv\") pod \"lws-controller-manager-5c49b9c978-lkxq5\" (UID: \"ec80af94-7488-44a7-952d-ea5602a69a7e\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:09.880378 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:09.880345    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:10.021926 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:10.021901    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"]
May 27 18:04:10.024604 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:04:10.024576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec80af94_7488_44a7_952d_ea5602a69a7e.slice/crio-fad172538daed0a5412d97643abab5a5e3cc6564a8d6bc79eb7af788f048d001 WatchSource:0}: Error finding container fad172538daed0a5412d97643abab5a5e3cc6564a8d6bc79eb7af788f048d001: Status 404 returned error can't find the container with id fad172538daed0a5412d97643abab5a5e3cc6564a8d6bc79eb7af788f048d001
May 27 18:04:10.666899 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:10.666864    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5" event={"ID":"ec80af94-7488-44a7-952d-ea5602a69a7e","Type":"ContainerStarted","Data":"fad172538daed0a5412d97643abab5a5e3cc6564a8d6bc79eb7af788f048d001"}
May 27 18:04:12.675543 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.675499    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5" event={"ID":"ec80af94-7488-44a7-952d-ea5602a69a7e","Type":"ContainerStarted","Data":"282966718f3ce48a36b9e3f150a26cf2d4cba80ac93cdd4c69b15610cbeacd42"}
May 27 18:04:12.676058 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.675633    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:04:12.691044 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.691013    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"]
May 27 18:04:12.694522 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.694497    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.694876 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.694820    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5" podStartSLOduration=1.212360637 podStartE2EDuration="3.694806184s" podCreationTimestamp="2026-05-27 18:04:09 +0000 UTC" firstStartedPulling="2026-05-27 18:04:10.026444853 +0000 UTC m=+387.250077584" lastFinishedPulling="2026-05-27 18:04:12.508890389 +0000 UTC m=+389.732523131" observedRunningTime="2026-05-27 18:04:12.693493046 +0000 UTC m=+389.917125795" watchObservedRunningTime="2026-05-27 18:04:12.694806184 +0000 UTC m=+389.918438935"
May 27 18:04:12.697221 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.697201    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 27 18:04:12.697340 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.697221    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 27 18:04:12.697340 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.697275    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s4wnx\""
May 27 18:04:12.704130 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.704109    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"]
May 27 18:04:12.842864 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.842753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tmp\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.842864 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.842793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2pcn\" (UniqueName: \"kubernetes.io/projected/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-kube-api-access-z2pcn\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.843063 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.842981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tls-certs\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.943610 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.943562    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tls-certs\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.943777 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.943665    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tmp\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.943777 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.943696    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2pcn\" (UniqueName: \"kubernetes.io/projected/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-kube-api-access-z2pcn\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.945989 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.945963    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tmp\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.946298 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.946275    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-tls-certs\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:12.955003 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:12.954977    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2pcn\" (UniqueName: \"kubernetes.io/projected/40218cbb-cff0-4a8a-804c-6bdc9dfbd267-kube-api-access-z2pcn\") pod \"kube-auth-proxy-65b5844854-zjwfq\" (UID: \"40218cbb-cff0-4a8a-804c-6bdc9dfbd267\") " pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:13.006786 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:13.006747    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"
May 27 18:04:13.137192 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:13.137165    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b5844854-zjwfq"]
May 27 18:04:13.139722 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:04:13.139689    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40218cbb_cff0_4a8a_804c_6bdc9dfbd267.slice/crio-b4faa77d5c363be7e27614863ed3fb9e2aa9911342fb62c2a6c38b6a344128e2 WatchSource:0}: Error finding container b4faa77d5c363be7e27614863ed3fb9e2aa9911342fb62c2a6c38b6a344128e2: Status 404 returned error can't find the container with id b4faa77d5c363be7e27614863ed3fb9e2aa9911342fb62c2a6c38b6a344128e2
May 27 18:04:13.684901 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:13.684863    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq" event={"ID":"40218cbb-cff0-4a8a-804c-6bdc9dfbd267","Type":"ContainerStarted","Data":"b4faa77d5c363be7e27614863ed3fb9e2aa9911342fb62c2a6c38b6a344128e2"}
May 27 18:04:17.703430 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:17.703388    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq" event={"ID":"40218cbb-cff0-4a8a-804c-6bdc9dfbd267","Type":"ContainerStarted","Data":"f9fbae7664a1d0b17315dfa0ff42fc49556db6b2c1eacdb0b4324b30ece7130e"}
May 27 18:04:17.744523 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:17.744464    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65b5844854-zjwfq" podStartSLOduration=1.66952704 podStartE2EDuration="5.744449061s" podCreationTimestamp="2026-05-27 18:04:12 +0000 UTC" firstStartedPulling="2026-05-27 18:04:13.141632806 +0000 UTC m=+390.365265533" lastFinishedPulling="2026-05-27 18:04:17.216554824 +0000 UTC m=+394.440187554" observedRunningTime="2026-05-27 18:04:17.740123129 +0000 UTC m=+394.963755880" watchObservedRunningTime="2026-05-27 18:04:17.744449061 +0000 UTC m=+394.968081812"
May 27 18:04:23.687197 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:04:23.687168    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-lkxq5"
May 27 18:05:58.675034 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.674993    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"]
May 27 18:05:58.677527 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.677505    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.679914 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.679890    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 27 18:05:58.680095 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.680081    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 18:05:58.680190 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.680171    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 27 18:05:58.680990 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.680976    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-79k9d\""
May 27 18:05:58.681037 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.680987    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 18:05:58.685535 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.685516    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"]
May 27 18:05:58.865926 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.865887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f33d95da-bbb1-41a0-a087-c61f247502b7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.866102 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.865973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f33d95da-bbb1-41a0-a087-c61f247502b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.866102 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.866007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlcp\" (UniqueName: \"kubernetes.io/projected/f33d95da-bbb1-41a0-a087-c61f247502b7-kube-api-access-cwlcp\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.967176 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.967143    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f33d95da-bbb1-41a0-a087-c61f247502b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.967348 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.967192    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlcp\" (UniqueName: \"kubernetes.io/projected/f33d95da-bbb1-41a0-a087-c61f247502b7-kube-api-access-cwlcp\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.967348 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.967239    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f33d95da-bbb1-41a0-a087-c61f247502b7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.967881 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.967858    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f33d95da-bbb1-41a0-a087-c61f247502b7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.969783 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.969760    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f33d95da-bbb1-41a0-a087-c61f247502b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.975413 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.975396    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlcp\" (UniqueName: \"kubernetes.io/projected/f33d95da-bbb1-41a0-a087-c61f247502b7-kube-api-access-cwlcp\") pod \"kuadrant-console-plugin-6cb54b5c86-78h4z\" (UID: \"f33d95da-bbb1-41a0-a087-c61f247502b7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:58.997294 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:58.997265    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"
May 27 18:05:59.131517 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:05:59.131484    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z"]
May 27 18:05:59.134442 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:05:59.134410    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf33d95da_bbb1_41a0_a087_c61f247502b7.slice/crio-11ba99fa9172b34df9b22b4b4ca772c14b159ed2f6326330fd9ead250011a70f WatchSource:0}: Error finding container 11ba99fa9172b34df9b22b4b4ca772c14b159ed2f6326330fd9ead250011a70f: Status 404 returned error can't find the container with id 11ba99fa9172b34df9b22b4b4ca772c14b159ed2f6326330fd9ead250011a70f
May 27 18:06:00.047979 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:00.047925    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z" event={"ID":"f33d95da-bbb1-41a0-a087-c61f247502b7","Type":"ContainerStarted","Data":"11ba99fa9172b34df9b22b4b4ca772c14b159ed2f6326330fd9ead250011a70f"}
May 27 18:06:08.164867 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.164818    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"]
May 27 18:06:08.168559 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.168530    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.173317 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.173294    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lml4s\""
May 27 18:06:08.201185 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.201149    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"]
May 27 18:06:08.254238 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.254196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzq52\" (UniqueName: \"kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.254409 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.254273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.355480 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.355444    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.355661 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.355572    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzq52\" (UniqueName: \"kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.355936 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.355903    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.371489 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.371459    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzq52\" (UniqueName: \"kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.482032 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.481985    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:08.627539 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.627513    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"]
May 27 18:06:08.630512 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:06:08.630483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddb2fa0_28fb_46f6_952a_2bf3ec4695ec.slice/crio-290aee915e4873047a41947413a1701f16c7aa1509e724337c53e1b689fc4f55 WatchSource:0}: Error finding container 290aee915e4873047a41947413a1701f16c7aa1509e724337c53e1b689fc4f55: Status 404 returned error can't find the container with id 290aee915e4873047a41947413a1701f16c7aa1509e724337c53e1b689fc4f55
May 27 18:06:08.821359 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.821280    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"]
May 27 18:06:08.835260 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.835224    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"]
May 27 18:06:08.864520 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.864491    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:08.869815 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.869765    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:08.887733 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.887702    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:08.963042 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.963006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mskd\" (UniqueName: \"kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:08.963224 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:08.963081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.064604 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.064566    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mskd\" (UniqueName: \"kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.064788 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.064617    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.065004 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.064988    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.076582 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.076522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mskd\" (UniqueName: \"kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.183131 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.183094    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:09.355994 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:09.355956    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:09.362694 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:06:09.362658    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33b3d61_cfb8_4a50_922d_aea493db1cdb.slice/crio-a286d1995f8f6c5aa8a7948f1e9350705e7cd360b7bfa63ede2adc7747ba2a56 WatchSource:0}: Error finding container a286d1995f8f6c5aa8a7948f1e9350705e7cd360b7bfa63ede2adc7747ba2a56: Status 404 returned error can't find the container with id a286d1995f8f6c5aa8a7948f1e9350705e7cd360b7bfa63ede2adc7747ba2a56
May 27 18:06:10.094927 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:10.094882    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" event={"ID":"f33b3d61-cfb8-4a50-922d-aea493db1cdb","Type":"ContainerStarted","Data":"a286d1995f8f6c5aa8a7948f1e9350705e7cd360b7bfa63ede2adc7747ba2a56"}
May 27 18:06:26.166545 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.166512    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z" event={"ID":"f33d95da-bbb1-41a0-a087-c61f247502b7","Type":"ContainerStarted","Data":"f79470ff1eff916b8695714bce2c3e121c58fa538810514b936de0b8e17ccb95"}
May 27 18:06:26.168131 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.168098    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" containerName="manager" containerID="cri-o://317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393" gracePeriod=2
May 27 18:06:26.169549 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.169522    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" event={"ID":"f33b3d61-cfb8-4a50-922d-aea493db1cdb","Type":"ContainerStarted","Data":"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"}
May 27 18:06:26.169677 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.169665    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:26.183452 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.183298    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-78h4z" podStartSLOduration=1.6741897730000002 podStartE2EDuration="28.183281183s" podCreationTimestamp="2026-05-27 18:05:58 +0000 UTC" firstStartedPulling="2026-05-27 18:05:59.135876862 +0000 UTC m=+496.359509605" lastFinishedPulling="2026-05-27 18:06:25.644968287 +0000 UTC m=+522.868601015" observedRunningTime="2026-05-27 18:06:26.183119099 +0000 UTC m=+523.406751849" watchObservedRunningTime="2026-05-27 18:06:26.183281183 +0000 UTC m=+523.406913935"
May 27 18:06:26.185311 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.185282    2558 status_manager.go:895] "Failed to get status for pod" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object"
May 27 18:06:26.211237 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.211163    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" podStartSLOduration=1.8625827130000001 podStartE2EDuration="18.211141027s" podCreationTimestamp="2026-05-27 18:06:08 +0000 UTC" firstStartedPulling="2026-05-27 18:06:09.365324767 +0000 UTC m=+506.588957495" lastFinishedPulling="2026-05-27 18:06:25.713883082 +0000 UTC m=+522.937515809" observedRunningTime="2026-05-27 18:06:26.210122668 +0000 UTC m=+523.433755413" watchObservedRunningTime="2026-05-27 18:06:26.211141027 +0000 UTC m=+523.434773777"
May 27 18:06:26.392170 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.392145    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:26.394402 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.394376    2558 status_manager.go:895] "Failed to get status for pod" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object"
May 27 18:06:26.541551 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.541513    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzq52\" (UniqueName: \"kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52\") pod \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") "
May 27 18:06:26.541708 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.541664    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume\") pod \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\" (UID: \"fddb2fa0-28fb-46f6-952a-2bf3ec4695ec\") "
May 27 18:06:26.541990 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.541968    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" (UID: "fddb2fa0-28fb-46f6-952a-2bf3ec4695ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:06:26.543878 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.543858    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52" (OuterVolumeSpecName: "kube-api-access-hzq52") pod "fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" (UID: "fddb2fa0-28fb-46f6-952a-2bf3ec4695ec"). InnerVolumeSpecName "kube-api-access-hzq52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:06:26.642675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.642636    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:06:26.642675 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:26.642669    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzq52\" (UniqueName: \"kubernetes.io/projected/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec-kube-api-access-hzq52\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:06:27.174086 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.174044    2558 generic.go:358] "Generic (PLEG): container finished" podID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" containerID="317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393" exitCode=2
May 27 18:06:27.174551 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.174098    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7"
May 27 18:06:27.174551 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.174142    2558 scope.go:117] "RemoveContainer" containerID="317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393"
May 27 18:06:27.176502 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.176474    2558 status_manager.go:895] "Failed to get status for pod" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object"
May 27 18:06:27.182925 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.182906    2558 scope.go:117] "RemoveContainer" containerID="317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393"
May 27 18:06:27.183170 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:06:27.183151    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393\": container with ID starting with 317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393 not found: ID does not exist" containerID="317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393"
May 27 18:06:27.183224 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.183180    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393"} err="failed to get container status \"317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393\": rpc error: code = NotFound desc = could not find container \"317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393\": container with ID starting with 317cc613011ae10d20763d2f3823255e23005609dcc1963a691b13165f821393 not found: ID does not exist"
May 27 18:06:27.184036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.184008    2558 status_manager.go:895] "Failed to get status for pod" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-8x7v7\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object"
May 27 18:06:27.423263 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:27.423228    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" path="/var/lib/kubelet/pods/fddb2fa0-28fb-46f6-952a-2bf3ec4695ec/volumes"
May 27 18:06:37.176557 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:37.176476    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:49.423517 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.423484    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:49.423944 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.423713    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" podUID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" containerName="manager" containerID="cri-o://0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94" gracePeriod=10
May 27 18:06:49.680413 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.680344    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:49.757210 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.757154    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume\") pod \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") "
May 27 18:06:49.757401 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.757230    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mskd\" (UniqueName: \"kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd\") pod \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\" (UID: \"f33b3d61-cfb8-4a50-922d-aea493db1cdb\") "
May 27 18:06:49.757605 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.757573    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f33b3d61-cfb8-4a50-922d-aea493db1cdb" (UID: "f33b3d61-cfb8-4a50-922d-aea493db1cdb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:06:49.759431 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.759404    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd" (OuterVolumeSpecName: "kube-api-access-9mskd") pod "f33b3d61-cfb8-4a50-922d-aea493db1cdb" (UID: "f33b3d61-cfb8-4a50-922d-aea493db1cdb"). InnerVolumeSpecName "kube-api-access-9mskd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:06:49.858847 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.858794    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f33b3d61-cfb8-4a50-922d-aea493db1cdb-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:06:49.859040 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:49.858869    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mskd\" (UniqueName: \"kubernetes.io/projected/f33b3d61-cfb8-4a50-922d-aea493db1cdb-kube-api-access-9mskd\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:06:50.257192 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.257152    2558 generic.go:358] "Generic (PLEG): container finished" podID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" containerID="0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94" exitCode=0
May 27 18:06:50.257355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.257212    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"
May 27 18:06:50.257355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.257228    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" event={"ID":"f33b3d61-cfb8-4a50-922d-aea493db1cdb","Type":"ContainerDied","Data":"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"}
May 27 18:06:50.257355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.257267    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f" event={"ID":"f33b3d61-cfb8-4a50-922d-aea493db1cdb","Type":"ContainerDied","Data":"a286d1995f8f6c5aa8a7948f1e9350705e7cd360b7bfa63ede2adc7747ba2a56"}
May 27 18:06:50.257355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.257284    2558 scope.go:117] "RemoveContainer" containerID="0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"
May 27 18:06:50.266233 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.266216    2558 scope.go:117] "RemoveContainer" containerID="0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"
May 27 18:06:50.266488 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:06:50.266469    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94\": container with ID starting with 0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94 not found: ID does not exist" containerID="0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"
May 27 18:06:50.266529 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.266498    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94"} err="failed to get container status \"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94\": rpc error: code = NotFound desc = could not find container \"0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94\": container with ID starting with 0cdc9665bbf1dfeed07b76a7e3d3c64d63f0ffa39a825f9c7e3e8ed081291f94 not found: ID does not exist"
May 27 18:06:50.279983 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.279953    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:50.283891 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:50.283872    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jjv8f"]
May 27 18:06:51.422724 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:51.422687    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" path="/var/lib/kubelet/pods/f33b3d61-cfb8-4a50-922d-aea493db1cdb/volumes"
May 27 18:06:58.203749 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.203708    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:06:58.204272 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204252    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" containerName="manager"
May 27 18:06:58.204344 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204275    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" containerName="manager"
May 27 18:06:58.204344 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204292    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" containerName="manager"
May 27 18:06:58.204344 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204300    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" containerName="manager"
May 27 18:06:58.204485 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204396    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f33b3d61-cfb8-4a50-922d-aea493db1cdb" containerName="manager"
May 27 18:06:58.204485 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.204412    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="fddb2fa0-28fb-46f6-952a-2bf3ec4695ec" containerName="manager"
May 27 18:06:58.296689 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.296658    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:06:58.296879 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.296787    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.300413 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.300379    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 27 18:06:58.301635 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.301597    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:06:58.435934 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.435899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.436124 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.435958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr58m\" (UniqueName: \"kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.537363 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.537271    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr58m\" (UniqueName: \"kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.537536 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.537408    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.538095 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.538076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.545131 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.545103    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr58m\" (UniqueName: \"kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m\") pod \"limitador-limitador-7d549b5b-md8l4\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") " pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.609307 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.609264    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:06:58.741823 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:58.741797    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:06:58.744237 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:06:58.744205    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24eab7e5_fefe_45af_97ab_1f8aebb39657.slice/crio-8011ec070c84364791b9877b43aa9c09f99ecf169bf0187718964b65e391d454 WatchSource:0}: Error finding container 8011ec070c84364791b9877b43aa9c09f99ecf169bf0187718964b65e391d454: Status 404 returned error can't find the container with id 8011ec070c84364791b9877b43aa9c09f99ecf169bf0187718964b65e391d454
May 27 18:06:59.111285 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.111244    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:06:59.114398 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.114377    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:06:59.116522 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.116502    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dxxkf\""
May 27 18:06:59.120254 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.120235    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:06:59.243787 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.243758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kw2s\" (UniqueName: \"kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s\") pod \"authorino-f99f4b5cd-4wwcf\" (UID: \"3b8391e0-2344-4d07-ad76-4e46212c1fe1\") " pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:06:59.289641 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.289600    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" event={"ID":"24eab7e5-fefe-45af-97ab-1f8aebb39657","Type":"ContainerStarted","Data":"8011ec070c84364791b9877b43aa9c09f99ecf169bf0187718964b65e391d454"}
May 27 18:06:59.345316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.345278    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kw2s\" (UniqueName: \"kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s\") pod \"authorino-f99f4b5cd-4wwcf\" (UID: \"3b8391e0-2344-4d07-ad76-4e46212c1fe1\") " pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:06:59.353737 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.353713    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kw2s\" (UniqueName: \"kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s\") pod \"authorino-f99f4b5cd-4wwcf\" (UID: \"3b8391e0-2344-4d07-ad76-4e46212c1fe1\") " pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:06:59.425757 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.425687    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:06:59.573635 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:06:59.573606    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:06:59.576582 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:06:59.576550    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b8391e0_2344_4d07_ad76_4e46212c1fe1.slice/crio-7bfe2d86e555c6127b2dc7a7686f3ae6769222694271f97bae8c39e2a242c6bd WatchSource:0}: Error finding container 7bfe2d86e555c6127b2dc7a7686f3ae6769222694271f97bae8c39e2a242c6bd: Status 404 returned error can't find the container with id 7bfe2d86e555c6127b2dc7a7686f3ae6769222694271f97bae8c39e2a242c6bd
May 27 18:07:00.294950 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:00.294898    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" event={"ID":"3b8391e0-2344-4d07-ad76-4e46212c1fe1","Type":"ContainerStarted","Data":"7bfe2d86e555c6127b2dc7a7686f3ae6769222694271f97bae8c39e2a242c6bd"}
May 27 18:07:03.498531 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:03.498495    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:07:04.312390 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:04.312348    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" event={"ID":"3b8391e0-2344-4d07-ad76-4e46212c1fe1","Type":"ContainerStarted","Data":"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"}
May 27 18:07:04.313611 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:04.313580    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" event={"ID":"24eab7e5-fefe-45af-97ab-1f8aebb39657","Type":"ContainerStarted","Data":"26d5909cd58981e30ca5fe90b0bccb144fade7cd5e3e435de474a1f960b549d2"}
May 27 18:07:04.314046 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:04.313732    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:07:04.332036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:04.331983    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" podStartSLOduration=1.5077081570000002 podStartE2EDuration="5.331964879s" podCreationTimestamp="2026-05-27 18:06:59 +0000 UTC" firstStartedPulling="2026-05-27 18:06:59.579045686 +0000 UTC m=+556.802678428" lastFinishedPulling="2026-05-27 18:07:03.403302231 +0000 UTC m=+560.626935150" observedRunningTime="2026-05-27 18:07:04.330947237 +0000 UTC m=+561.554579979" watchObservedRunningTime="2026-05-27 18:07:04.331964879 +0000 UTC m=+561.555597629"
May 27 18:07:04.347396 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:04.347336    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" podStartSLOduration=1.703614946 podStartE2EDuration="6.347320332s" podCreationTimestamp="2026-05-27 18:06:58 +0000 UTC" firstStartedPulling="2026-05-27 18:06:58.745867219 +0000 UTC m=+555.969499948" lastFinishedPulling="2026-05-27 18:07:03.389572596 +0000 UTC m=+560.613205334" observedRunningTime="2026-05-27 18:07:04.345579078 +0000 UTC m=+561.569211850" watchObservedRunningTime="2026-05-27 18:07:04.347320332 +0000 UTC m=+561.570953173"
May 27 18:07:05.316448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:05.316403    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" podUID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" containerName="authorino" containerID="cri-o://3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e" gracePeriod=30
May 27 18:07:05.564815 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:05.564792    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:07:05.709654 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:05.709621    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kw2s\" (UniqueName: \"kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s\") pod \"3b8391e0-2344-4d07-ad76-4e46212c1fe1\" (UID: \"3b8391e0-2344-4d07-ad76-4e46212c1fe1\") "
May 27 18:07:05.711881 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:05.711827    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s" (OuterVolumeSpecName: "kube-api-access-5kw2s") pod "3b8391e0-2344-4d07-ad76-4e46212c1fe1" (UID: "3b8391e0-2344-4d07-ad76-4e46212c1fe1"). InnerVolumeSpecName "kube-api-access-5kw2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:07:05.810846 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:05.810807    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kw2s\" (UniqueName: \"kubernetes.io/projected/3b8391e0-2344-4d07-ad76-4e46212c1fe1-kube-api-access-5kw2s\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:07:06.320453 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.320417    2558 generic.go:358] "Generic (PLEG): container finished" podID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" containerID="3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e" exitCode=0
May 27 18:07:06.320884 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.320472    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf"
May 27 18:07:06.320884 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.320507    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" event={"ID":"3b8391e0-2344-4d07-ad76-4e46212c1fe1","Type":"ContainerDied","Data":"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"}
May 27 18:07:06.320884 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.320541    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4wwcf" event={"ID":"3b8391e0-2344-4d07-ad76-4e46212c1fe1","Type":"ContainerDied","Data":"7bfe2d86e555c6127b2dc7a7686f3ae6769222694271f97bae8c39e2a242c6bd"}
May 27 18:07:06.320884 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.320556    2558 scope.go:117] "RemoveContainer" containerID="3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"
May 27 18:07:06.329006 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.328990    2558 scope.go:117] "RemoveContainer" containerID="3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"
May 27 18:07:06.329250 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:07:06.329230    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e\": container with ID starting with 3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e not found: ID does not exist" containerID="3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"
May 27 18:07:06.329291 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.329260    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e"} err="failed to get container status \"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e\": rpc error: code = NotFound desc = could not find container \"3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e\": container with ID starting with 3ddc1918727922493375af4a3e390b5004c877090b864fef4ab5fa756167730e not found: ID does not exist"
May 27 18:07:06.340311 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.340285    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:07:06.345490 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:06.345468    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4wwcf"]
May 27 18:07:07.422989 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:07.422956    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" path="/var/lib/kubelet/pods/3b8391e0-2344-4d07-ad76-4e46212c1fe1/volumes"
May 27 18:07:12.851971 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:12.851935    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:07:12.852467 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:12.852181    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" podUID="24eab7e5-fefe-45af-97ab-1f8aebb39657" containerName="limitador" containerID="cri-o://26d5909cd58981e30ca5fe90b0bccb144fade7cd5e3e435de474a1f960b549d2" gracePeriod=30
May 27 18:07:12.852850 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:12.852752    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:07:13.348571 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.348531    2558 generic.go:358] "Generic (PLEG): container finished" podID="24eab7e5-fefe-45af-97ab-1f8aebb39657" containerID="26d5909cd58981e30ca5fe90b0bccb144fade7cd5e3e435de474a1f960b549d2" exitCode=0
May 27 18:07:13.348942 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.348609    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" event={"ID":"24eab7e5-fefe-45af-97ab-1f8aebb39657","Type":"ContainerDied","Data":"26d5909cd58981e30ca5fe90b0bccb144fade7cd5e3e435de474a1f960b549d2"}
May 27 18:07:13.400714 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.400691    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:07:13.578348 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.578300    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr58m\" (UniqueName: \"kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m\") pod \"24eab7e5-fefe-45af-97ab-1f8aebb39657\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") "
May 27 18:07:13.578576 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.578400    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file\") pod \"24eab7e5-fefe-45af-97ab-1f8aebb39657\" (UID: \"24eab7e5-fefe-45af-97ab-1f8aebb39657\") "
May 27 18:07:13.578695 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.578677    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file" (OuterVolumeSpecName: "config-file") pod "24eab7e5-fefe-45af-97ab-1f8aebb39657" (UID: "24eab7e5-fefe-45af-97ab-1f8aebb39657"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:07:13.580585 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.580561    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m" (OuterVolumeSpecName: "kube-api-access-sr58m") pod "24eab7e5-fefe-45af-97ab-1f8aebb39657" (UID: "24eab7e5-fefe-45af-97ab-1f8aebb39657"). InnerVolumeSpecName "kube-api-access-sr58m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:07:13.679206 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.679156    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24eab7e5-fefe-45af-97ab-1f8aebb39657-config-file\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:07:13.679206 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:13.679204    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr58m\" (UniqueName: \"kubernetes.io/projected/24eab7e5-fefe-45af-97ab-1f8aebb39657-kube-api-access-sr58m\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:07:14.314716 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.314682    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7rjwp"]
May 27 18:07:14.315239 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315219    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" containerName="authorino"
May 27 18:07:14.315316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315242    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" containerName="authorino"
May 27 18:07:14.315316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315268    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24eab7e5-fefe-45af-97ab-1f8aebb39657" containerName="limitador"
May 27 18:07:14.315316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315277    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="24eab7e5-fefe-45af-97ab-1f8aebb39657" containerName="limitador"
May 27 18:07:14.315466 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315369    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="24eab7e5-fefe-45af-97ab-1f8aebb39657" containerName="limitador"
May 27 18:07:14.315466 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.315389    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b8391e0-2344-4d07-ad76-4e46212c1fe1" containerName="authorino"
May 27 18:07:14.318471 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.318449    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.321189 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.321166    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8s25v\""
May 27 18:07:14.321189 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.321179    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 27 18:07:14.328108 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.328081    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7rjwp"]
May 27 18:07:14.354385 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.354358    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4"
May 27 18:07:14.354385 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.354368    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-md8l4" event={"ID":"24eab7e5-fefe-45af-97ab-1f8aebb39657","Type":"ContainerDied","Data":"8011ec070c84364791b9877b43aa9c09f99ecf169bf0187718964b65e391d454"}
May 27 18:07:14.354576 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.354416    2558 scope.go:117] "RemoveContainer" containerID="26d5909cd58981e30ca5fe90b0bccb144fade7cd5e3e435de474a1f960b549d2"
May 27 18:07:14.375098 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.375071    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:07:14.380802 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.380774    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-md8l4"]
May 27 18:07:14.487138 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.487101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e30d32ad-1058-4a46-bdc8-c5730afec13d-data\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.487316 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.487150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4qc\" (UniqueName: \"kubernetes.io/projected/e30d32ad-1058-4a46-bdc8-c5730afec13d-kube-api-access-rd4qc\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.588184 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.588082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e30d32ad-1058-4a46-bdc8-c5730afec13d-data\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.588184 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.588147    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4qc\" (UniqueName: \"kubernetes.io/projected/e30d32ad-1058-4a46-bdc8-c5730afec13d-kube-api-access-rd4qc\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.588459 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.588437    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e30d32ad-1058-4a46-bdc8-c5730afec13d-data\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.596399 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.596372    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4qc\" (UniqueName: \"kubernetes.io/projected/e30d32ad-1058-4a46-bdc8-c5730afec13d-kube-api-access-rd4qc\") pod \"postgres-68c4fbbd6f-7rjwp\" (UID: \"e30d32ad-1058-4a46-bdc8-c5730afec13d\") " pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.632356 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.632315    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:14.782364 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:14.782330    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7rjwp"]
May 27 18:07:14.785555 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:07:14.785524    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30d32ad_1058_4a46_bdc8_c5730afec13d.slice/crio-e65d48e106bace2298cc0f86bfc5e3b7617932bf99e4b00aab1152e9ff04ea71 WatchSource:0}: Error finding container e65d48e106bace2298cc0f86bfc5e3b7617932bf99e4b00aab1152e9ff04ea71: Status 404 returned error can't find the container with id e65d48e106bace2298cc0f86bfc5e3b7617932bf99e4b00aab1152e9ff04ea71
May 27 18:07:15.359173 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:15.359135    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7rjwp" event={"ID":"e30d32ad-1058-4a46-bdc8-c5730afec13d","Type":"ContainerStarted","Data":"e65d48e106bace2298cc0f86bfc5e3b7617932bf99e4b00aab1152e9ff04ea71"}
May 27 18:07:15.422826 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:15.422792    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24eab7e5-fefe-45af-97ab-1f8aebb39657" path="/var/lib/kubelet/pods/24eab7e5-fefe-45af-97ab-1f8aebb39657/volumes"
May 27 18:07:21.380517 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:21.380479    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7rjwp" event={"ID":"e30d32ad-1058-4a46-bdc8-c5730afec13d","Type":"ContainerStarted","Data":"6fe88f3cb734ef0eeaac56f37f298ebc39191baf7ece435ecb4983f234b9b7e4"}
May 27 18:07:21.380938 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:21.380597    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:21.398147 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:21.398073    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-7rjwp" podStartSLOduration=0.93739061 podStartE2EDuration="7.398055261s" podCreationTimestamp="2026-05-27 18:07:14 +0000 UTC" firstStartedPulling="2026-05-27 18:07:14.786861421 +0000 UTC m=+572.010494161" lastFinishedPulling="2026-05-27 18:07:21.247526084 +0000 UTC m=+578.471158812" observedRunningTime="2026-05-27 18:07:21.39639395 +0000 UTC m=+578.620026701" watchObservedRunningTime="2026-05-27 18:07:21.398055261 +0000 UTC m=+578.621688012"
May 27 18:07:27.413310 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:27.413280    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-7rjwp"
May 27 18:07:27.926912 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:27.926878    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:27.932979 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:27.932959    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:27.935752 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:27.935729    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dxxkf\""
May 27 18:07:27.937038 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:27.937014    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:28.016083 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.016045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hvf5\" (UniqueName: \"kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5\") pod \"authorino-8b475cf9f-flxpw\" (UID: \"8ce02c85-743c-4e75-8037-9d0043eaeb85\") " pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:28.116984 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.116945    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hvf5\" (UniqueName: \"kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5\") pod \"authorino-8b475cf9f-flxpw\" (UID: \"8ce02c85-743c-4e75-8037-9d0043eaeb85\") " pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:28.125452 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.125419    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hvf5\" (UniqueName: \"kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5\") pod \"authorino-8b475cf9f-flxpw\" (UID: \"8ce02c85-743c-4e75-8037-9d0043eaeb85\") " pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:28.136325 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.136299    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:28.136557 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.136546    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:28.159461 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.159434    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:07:28.164699 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.164676    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.167543 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.167523    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 27 18:07:28.171713 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.171688    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:07:28.217956 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.217914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bl8x\" (UniqueName: \"kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.218136 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.217978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.274602 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.274570    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:28.277157 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:07:28.277130    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ce02c85_743c_4e75_8037_9d0043eaeb85.slice/crio-381f9dfd2a85e9702f05b19893f5ee3e0f73c8f0ed4f023bbf759a96586d2069 WatchSource:0}: Error finding container 381f9dfd2a85e9702f05b19893f5ee3e0f73c8f0ed4f023bbf759a96586d2069: Status 404 returned error can't find the container with id 381f9dfd2a85e9702f05b19893f5ee3e0f73c8f0ed4f023bbf759a96586d2069
May 27 18:07:28.319359 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.319326    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bl8x\" (UniqueName: \"kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.319569 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.319366    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.321978 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.321951    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.327089 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.327061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bl8x\" (UniqueName: \"kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x\") pod \"authorino-549c5cb954-b6bck\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") " pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.405313 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.405276    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-flxpw" event={"ID":"8ce02c85-743c-4e75-8037-9d0043eaeb85","Type":"ContainerStarted","Data":"381f9dfd2a85e9702f05b19893f5ee3e0f73c8f0ed4f023bbf759a96586d2069"}
May 27 18:07:28.475034 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.475003    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:07:28.610612 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:28.610578    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:07:28.614192 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:07:28.614162    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6d5c22_c6e3_4965_8b5e_6db6b5138ad6.slice/crio-d3796d45913436e5e5c2fef58226987aaf6a0894600bc83e792ba8f0d3c6d7cb WatchSource:0}: Error finding container d3796d45913436e5e5c2fef58226987aaf6a0894600bc83e792ba8f0d3c6d7cb: Status 404 returned error can't find the container with id d3796d45913436e5e5c2fef58226987aaf6a0894600bc83e792ba8f0d3c6d7cb
May 27 18:07:29.410036 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.409943    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-flxpw" event={"ID":"8ce02c85-743c-4e75-8037-9d0043eaeb85","Type":"ContainerStarted","Data":"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"}
May 27 18:07:29.410213 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.410044    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-flxpw" podUID="8ce02c85-743c-4e75-8037-9d0043eaeb85" containerName="authorino" containerID="cri-o://00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b" gracePeriod=30
May 27 18:07:29.411521 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.411494    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549c5cb954-b6bck" event={"ID":"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6","Type":"ContainerStarted","Data":"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"}
May 27 18:07:29.411620 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.411532    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549c5cb954-b6bck" event={"ID":"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6","Type":"ContainerStarted","Data":"d3796d45913436e5e5c2fef58226987aaf6a0894600bc83e792ba8f0d3c6d7cb"}
May 27 18:07:29.426709 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.426398    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-flxpw" podStartSLOduration=2.093709846 podStartE2EDuration="2.426380678s" podCreationTimestamp="2026-05-27 18:07:27 +0000 UTC" firstStartedPulling="2026-05-27 18:07:28.278419506 +0000 UTC m=+585.502052234" lastFinishedPulling="2026-05-27 18:07:28.611090328 +0000 UTC m=+585.834723066" observedRunningTime="2026-05-27 18:07:29.426370383 +0000 UTC m=+586.650003132" watchObservedRunningTime="2026-05-27 18:07:29.426380678 +0000 UTC m=+586.650013428"
May 27 18:07:29.442030 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.441986    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-549c5cb954-b6bck" podStartSLOduration=1.039824307 podStartE2EDuration="1.441972597s" podCreationTimestamp="2026-05-27 18:07:28 +0000 UTC" firstStartedPulling="2026-05-27 18:07:28.615553442 +0000 UTC m=+585.839186170" lastFinishedPulling="2026-05-27 18:07:29.017701732 +0000 UTC m=+586.241334460" observedRunningTime="2026-05-27 18:07:29.440428761 +0000 UTC m=+586.664061506" watchObservedRunningTime="2026-05-27 18:07:29.441972597 +0000 UTC m=+586.665605347"
May 27 18:07:29.663326 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.663253    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:29.734114 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.734081    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hvf5\" (UniqueName: \"kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5\") pod \"8ce02c85-743c-4e75-8037-9d0043eaeb85\" (UID: \"8ce02c85-743c-4e75-8037-9d0043eaeb85\") "
May 27 18:07:29.736408 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.736374    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5" (OuterVolumeSpecName: "kube-api-access-5hvf5") pod "8ce02c85-743c-4e75-8037-9d0043eaeb85" (UID: "8ce02c85-743c-4e75-8037-9d0043eaeb85"). InnerVolumeSpecName "kube-api-access-5hvf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:07:29.835339 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:29.835292    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hvf5\" (UniqueName: \"kubernetes.io/projected/8ce02c85-743c-4e75-8037-9d0043eaeb85-kube-api-access-5hvf5\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:07:30.416362 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.416326    2558 generic.go:358] "Generic (PLEG): container finished" podID="8ce02c85-743c-4e75-8037-9d0043eaeb85" containerID="00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b" exitCode=0
May 27 18:07:30.416554 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.416377    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-flxpw"
May 27 18:07:30.416554 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.416403    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-flxpw" event={"ID":"8ce02c85-743c-4e75-8037-9d0043eaeb85","Type":"ContainerDied","Data":"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"}
May 27 18:07:30.416554 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.416440    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-flxpw" event={"ID":"8ce02c85-743c-4e75-8037-9d0043eaeb85","Type":"ContainerDied","Data":"381f9dfd2a85e9702f05b19893f5ee3e0f73c8f0ed4f023bbf759a96586d2069"}
May 27 18:07:30.416554 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.416456    2558 scope.go:117] "RemoveContainer" containerID="00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"
May 27 18:07:30.424919 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.424897    2558 scope.go:117] "RemoveContainer" containerID="00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"
May 27 18:07:30.425163 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:07:30.425146    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b\": container with ID starting with 00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b not found: ID does not exist" containerID="00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"
May 27 18:07:30.425223 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.425183    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b"} err="failed to get container status \"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b\": rpc error: code = NotFound desc = could not find container \"00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b\": container with ID starting with 00ee21cd041b662fa9572c67e69e8b6d0baa2d37d754356aa085369ba44d460b not found: ID does not exist"
May 27 18:07:30.436381 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.436358    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:30.445092 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:30.445072    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-flxpw"]
May 27 18:07:31.422082 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:31.422049    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce02c85-743c-4e75-8037-9d0043eaeb85" path="/var/lib/kubelet/pods/8ce02c85-743c-4e75-8037-9d0043eaeb85/volumes"
May 27 18:07:43.350505 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:43.350476    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:07:43.351473 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:07:43.351445    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:08:41.272496 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.272460    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"]
May 27 18:08:41.275026 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.272884    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce02c85-743c-4e75-8037-9d0043eaeb85" containerName="authorino"
May 27 18:08:41.275026 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.272899    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce02c85-743c-4e75-8037-9d0043eaeb85" containerName="authorino"
May 27 18:08:41.275026 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.272957    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce02c85-743c-4e75-8037-9d0043eaeb85" containerName="authorino"
May 27 18:08:41.276218 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.276199    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.279466 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.279444    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-72bcn\""
May 27 18:08:41.279666 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.279648    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 18:08:41.280494 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.280473    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 27 18:08:41.280585 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.280510    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 18:08:41.290049 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.290023    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"]
May 27 18:08:41.393294 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz62v\" (UniqueName: \"kubernetes.io/projected/4ae610d7-c21e-452a-801c-a365bcc74b91-kube-api-access-pz62v\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.393486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.393486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.393486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.393486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.393486 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.393471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae610d7-c21e-452a-801c-a365bcc74b91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494406 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494363    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494406 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494408    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494616 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494425    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494616 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494568    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494692 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494645    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae610d7-c21e-452a-801c-a365bcc74b91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494763 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494743    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pz62v\" (UniqueName: \"kubernetes.io/projected/4ae610d7-c21e-452a-801c-a365bcc74b91-kube-api-access-pz62v\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494816 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494786    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494905 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494873    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.494960 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.494924    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.497027 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.497004    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ae610d7-c21e-452a-801c-a365bcc74b91-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.497228 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.497207    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae610d7-c21e-452a-801c-a365bcc74b91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.504016 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.503997    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz62v\" (UniqueName: \"kubernetes.io/projected/4ae610d7-c21e-452a-801c-a365bcc74b91-kube-api-access-pz62v\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tvl4h\" (UID: \"4ae610d7-c21e-452a-801c-a365bcc74b91\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.589514 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.589427    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:41.731982 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:41.731952    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"]
May 27 18:08:41.734816 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:08:41.734791    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae610d7_c21e_452a_801c_a365bcc74b91.slice/crio-5a6e1342505cf48463120dd49f026e23a62bf87cdeb8b4b42650686953f73709 WatchSource:0}: Error finding container 5a6e1342505cf48463120dd49f026e23a62bf87cdeb8b4b42650686953f73709: Status 404 returned error can't find the container with id 5a6e1342505cf48463120dd49f026e23a62bf87cdeb8b4b42650686953f73709
May 27 18:08:42.667149 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:42.667107    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h" event={"ID":"4ae610d7-c21e-452a-801c-a365bcc74b91","Type":"ContainerStarted","Data":"5a6e1342505cf48463120dd49f026e23a62bf87cdeb8b4b42650686953f73709"}
May 27 18:08:47.688286 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:47.688243    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h" event={"ID":"4ae610d7-c21e-452a-801c-a365bcc74b91","Type":"ContainerStarted","Data":"d233a014bee8c3a282bae608cd9011e8e00dbb05871031713436c8869e65834d"}
May 27 18:08:52.706909 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:52.706870    2558 generic.go:358] "Generic (PLEG): container finished" podID="4ae610d7-c21e-452a-801c-a365bcc74b91" containerID="d233a014bee8c3a282bae608cd9011e8e00dbb05871031713436c8869e65834d" exitCode=0
May 27 18:08:52.707312 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:52.706940    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h" event={"ID":"4ae610d7-c21e-452a-801c-a365bcc74b91","Type":"ContainerDied","Data":"d233a014bee8c3a282bae608cd9011e8e00dbb05871031713436c8869e65834d"}
May 27 18:08:54.715990 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:54.715950    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h" event={"ID":"4ae610d7-c21e-452a-801c-a365bcc74b91","Type":"ContainerStarted","Data":"ac6307a45064ecdefdf73951f24a28298ec33068d9d4ddf28334812714ff4316"}
May 27 18:08:54.716372 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:54.716164    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:08:54.734123 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:08:54.734065    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h" podStartSLOduration=1.6497205350000002 podStartE2EDuration="13.734043091s" podCreationTimestamp="2026-05-27 18:08:41 +0000 UTC" firstStartedPulling="2026-05-27 18:08:41.736586425 +0000 UTC m=+658.960219154" lastFinishedPulling="2026-05-27 18:08:53.820908978 +0000 UTC m=+671.044541710" observedRunningTime="2026-05-27 18:08:54.733355482 +0000 UTC m=+671.956988242" watchObservedRunningTime="2026-05-27 18:08:54.734043091 +0000 UTC m=+671.957675859"
May 27 18:09:05.732322 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:05.732291    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tvl4h"
May 27 18:09:22.774688 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.774644    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"]
May 27 18:09:22.796102 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.796061    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"]
May 27 18:09:22.796273 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.796203    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.799177 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.799153    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 27 18:09:22.982239 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.982239 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tfzp\" (UniqueName: \"kubernetes.io/projected/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kube-api-access-9tfzp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.982511 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.982511 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.982511 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:22.982511 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:22.982453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be62ddb4-9588-40e8-9abc-b64894c0b2d9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.083913 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.083774    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.083913 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.083820    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tfzp\" (UniqueName: \"kubernetes.io/projected/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kube-api-access-9tfzp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084163 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.083930    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084163 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.083956    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084163 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.083998    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084163 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.084025    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be62ddb4-9588-40e8-9abc-b64894c0b2d9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084367 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.084308    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084424 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.084373    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.084424 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.084410    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.086438 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.086413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be62ddb4-9588-40e8-9abc-b64894c0b2d9-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.086688 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.086669    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be62ddb4-9588-40e8-9abc-b64894c0b2d9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.092100 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.092076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tfzp\" (UniqueName: \"kubernetes.io/projected/be62ddb4-9588-40e8-9abc-b64894c0b2d9-kube-api-access-9tfzp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw\" (UID: \"be62ddb4-9588-40e8-9abc-b64894c0b2d9\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.107129 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.107102    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:23.243380 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.243352    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"]
May 27 18:09:23.245796 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:09:23.245769    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe62ddb4_9588_40e8_9abc_b64894c0b2d9.slice/crio-53e4313b929f96a281cf08af77e6a31fbd138ed4e560ed31afc300af2d477a76 WatchSource:0}: Error finding container 53e4313b929f96a281cf08af77e6a31fbd138ed4e560ed31afc300af2d477a76: Status 404 returned error can't find the container with id 53e4313b929f96a281cf08af77e6a31fbd138ed4e560ed31afc300af2d477a76
May 27 18:09:23.247601 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.247585    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:09:23.818435 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.818381    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw" event={"ID":"be62ddb4-9588-40e8-9abc-b64894c0b2d9","Type":"ContainerStarted","Data":"4e50693b089566b75b89097cfb9d9619473360ab152efc275ec2896a310db8ac"}
May 27 18:09:23.818435 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:23.818439    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw" event={"ID":"be62ddb4-9588-40e8-9abc-b64894c0b2d9","Type":"ContainerStarted","Data":"53e4313b929f96a281cf08af77e6a31fbd138ed4e560ed31afc300af2d477a76"}
May 27 18:09:29.841295 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:29.841195    2558 generic.go:358] "Generic (PLEG): container finished" podID="be62ddb4-9588-40e8-9abc-b64894c0b2d9" containerID="4e50693b089566b75b89097cfb9d9619473360ab152efc275ec2896a310db8ac" exitCode=0
May 27 18:09:29.841295 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:29.841276    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw" event={"ID":"be62ddb4-9588-40e8-9abc-b64894c0b2d9","Type":"ContainerDied","Data":"4e50693b089566b75b89097cfb9d9619473360ab152efc275ec2896a310db8ac"}
May 27 18:09:30.846524 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:30.846489    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw" event={"ID":"be62ddb4-9588-40e8-9abc-b64894c0b2d9","Type":"ContainerStarted","Data":"afca1180d4d021e84848891449cee93b57da66bda2578b9d68bba69e76f67bb4"}
May 27 18:09:30.846940 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:30.846706    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:30.866168 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:30.866125    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw" podStartSLOduration=8.551651181 podStartE2EDuration="8.866111191s" podCreationTimestamp="2026-05-27 18:09:22 +0000 UTC" firstStartedPulling="2026-05-27 18:09:29.84199997 +0000 UTC m=+707.065632697" lastFinishedPulling="2026-05-27 18:09:30.15645998 +0000 UTC m=+707.380092707" observedRunningTime="2026-05-27 18:09:30.864479623 +0000 UTC m=+708.088112373" watchObservedRunningTime="2026-05-27 18:09:30.866111191 +0000 UTC m=+708.089743950"
May 27 18:09:41.862857 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:41.862813    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw"
May 27 18:09:47.772034 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.772004    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"]
May 27 18:09:47.774753 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.774731    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.777390 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.777344    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 27 18:09:47.786557 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.786534    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"]
May 27 18:09:47.921674 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.921674 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.921935 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.921935 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snwh\" (UniqueName: \"kubernetes.io/projected/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kube-api-access-2snwh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.921935 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921903    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b2a380-f730-4fed-a39a-8ec4e87729e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:47.921935 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:47.921924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023138 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023138 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023092    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2snwh\" (UniqueName: \"kubernetes.io/projected/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kube-api-access-2snwh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023318 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023262    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b2a380-f730-4fed-a39a-8ec4e87729e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023318 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023291    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023384 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023371    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023442 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023392    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023491 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023437    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023682 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023658    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.023682 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.023673    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.025857 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.025821    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1b2a380-f730-4fed-a39a-8ec4e87729e3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.025939 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.025922    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b2a380-f730-4fed-a39a-8ec4e87729e3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.031504 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.031480    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snwh\" (UniqueName: \"kubernetes.io/projected/a1b2a380-f730-4fed-a39a-8ec4e87729e3-kube-api-access-2snwh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm\" (UID: \"a1b2a380-f730-4fed-a39a-8ec4e87729e3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.085639 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.085605    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:48.219032 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.219004    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"]
May 27 18:09:48.221476 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:09:48.221447    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b2a380_f730_4fed_a39a_8ec4e87729e3.slice/crio-9c15f4a1a58b9ea0e2c773d6dd09532bf6d9ee3e10608c84845b39831207a90b WatchSource:0}: Error finding container 9c15f4a1a58b9ea0e2c773d6dd09532bf6d9ee3e10608c84845b39831207a90b: Status 404 returned error can't find the container with id 9c15f4a1a58b9ea0e2c773d6dd09532bf6d9ee3e10608c84845b39831207a90b
May 27 18:09:48.913570 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.913524    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm" event={"ID":"a1b2a380-f730-4fed-a39a-8ec4e87729e3","Type":"ContainerStarted","Data":"00290e9be9b61076ae65a6d39c6c83ef5c9a3b04f7ebd1f142e673e7714e3cdd"}
May 27 18:09:48.913570 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:48.913571    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm" event={"ID":"a1b2a380-f730-4fed-a39a-8ec4e87729e3","Type":"ContainerStarted","Data":"9c15f4a1a58b9ea0e2c773d6dd09532bf6d9ee3e10608c84845b39831207a90b"}
May 27 18:09:53.933752 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:53.933713    2558 generic.go:358] "Generic (PLEG): container finished" podID="a1b2a380-f730-4fed-a39a-8ec4e87729e3" containerID="00290e9be9b61076ae65a6d39c6c83ef5c9a3b04f7ebd1f142e673e7714e3cdd" exitCode=0
May 27 18:09:53.934182 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:53.933783    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm" event={"ID":"a1b2a380-f730-4fed-a39a-8ec4e87729e3","Type":"ContainerDied","Data":"00290e9be9b61076ae65a6d39c6c83ef5c9a3b04f7ebd1f142e673e7714e3cdd"}
May 27 18:09:54.938613 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:54.938575    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm" event={"ID":"a1b2a380-f730-4fed-a39a-8ec4e87729e3","Type":"ContainerStarted","Data":"40c383989eba8c597915cbef2ebcac4fbe4457417bb874fce726e14aa1e3375d"}
May 27 18:09:54.939055 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:54.938803    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:09:54.958232 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:09:54.958167    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm" podStartSLOduration=7.4928422 podStartE2EDuration="7.95815273s" podCreationTimestamp="2026-05-27 18:09:47 +0000 UTC" firstStartedPulling="2026-05-27 18:09:53.934447754 +0000 UTC m=+731.158080482" lastFinishedPulling="2026-05-27 18:09:54.399758274 +0000 UTC m=+731.623391012" observedRunningTime="2026-05-27 18:09:54.955767674 +0000 UTC m=+732.179400437" watchObservedRunningTime="2026-05-27 18:09:54.95815273 +0000 UTC m=+732.181785490"
May 27 18:10:05.955985 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:05.955946    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm"
May 27 18:10:28.168083 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.168049    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85869cfb6c-4p4xx"]
May 27 18:10:28.170679 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.170660    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.178288 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.178265    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85869cfb6c-4p4xx"]
May 27 18:10:28.332540 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.332496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65xt2\" (UniqueName: \"kubernetes.io/projected/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-kube-api-access-65xt2\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.332742 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.332618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-tls-cert\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.433719 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.433618    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65xt2\" (UniqueName: \"kubernetes.io/projected/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-kube-api-access-65xt2\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.433905 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.433727    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-tls-cert\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.436288 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.436265    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-tls-cert\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.441805 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.441785    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65xt2\" (UniqueName: \"kubernetes.io/projected/ff5c07c8-24a9-49c4-9482-4d4850ca0bd9-kube-api-access-65xt2\") pod \"authorino-85869cfb6c-4p4xx\" (UID: \"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9\") " pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.480618 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.480588    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85869cfb6c-4p4xx"
May 27 18:10:28.613103 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:28.613078    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85869cfb6c-4p4xx"]
May 27 18:10:28.615525 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:10:28.615496    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff5c07c8_24a9_49c4_9482_4d4850ca0bd9.slice/crio-6b9b9c83b56ce91bb8facde352b7962034667ea0f6696350cdfccfc41e9b79fe WatchSource:0}: Error finding container 6b9b9c83b56ce91bb8facde352b7962034667ea0f6696350cdfccfc41e9b79fe: Status 404 returned error can't find the container with id 6b9b9c83b56ce91bb8facde352b7962034667ea0f6696350cdfccfc41e9b79fe
May 27 18:10:29.061183 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:29.061143    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85869cfb6c-4p4xx" event={"ID":"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9","Type":"ContainerStarted","Data":"6b9b9c83b56ce91bb8facde352b7962034667ea0f6696350cdfccfc41e9b79fe"}
May 27 18:10:30.067041 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.067003    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85869cfb6c-4p4xx" event={"ID":"ff5c07c8-24a9-49c4-9482-4d4850ca0bd9","Type":"ContainerStarted","Data":"98f7eb219481765a8c90a1d1d346a23b1c753939f897340cb06857a23080d053"}
May 27 18:10:30.082568 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.082518    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-85869cfb6c-4p4xx" podStartSLOduration=1.614516316 podStartE2EDuration="2.082503662s" podCreationTimestamp="2026-05-27 18:10:28 +0000 UTC" firstStartedPulling="2026-05-27 18:10:28.616691044 +0000 UTC m=+765.840323772" lastFinishedPulling="2026-05-27 18:10:29.084678383 +0000 UTC m=+766.308311118" observedRunningTime="2026-05-27 18:10:30.081094998 +0000 UTC m=+767.304727769" watchObservedRunningTime="2026-05-27 18:10:30.082503662 +0000 UTC m=+767.306136488"
May 27 18:10:30.109794 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.109760    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:10:30.109996 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.109973    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-549c5cb954-b6bck" podUID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" containerName="authorino" containerID="cri-o://027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a" gracePeriod=30
May 27 18:10:30.357466 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.357434    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:10:30.453262 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.453221    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert\") pod \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") "
May 27 18:10:30.453451 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.453320    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bl8x\" (UniqueName: \"kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x\") pod \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\" (UID: \"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6\") "
May 27 18:10:30.455450 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.455418    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x" (OuterVolumeSpecName: "kube-api-access-2bl8x") pod "3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" (UID: "3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6"). InnerVolumeSpecName "kube-api-access-2bl8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:10:30.466083 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.466058    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" (UID: "3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:10:30.554618 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.554565    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bl8x\" (UniqueName: \"kubernetes.io/projected/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-kube-api-access-2bl8x\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:10:30.554618 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:30.554608    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6-tls-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
May 27 18:10:31.071535 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.071492    2558 generic.go:358] "Generic (PLEG): container finished" podID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" containerID="027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a" exitCode=0
May 27 18:10:31.071969 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.071543    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549c5cb954-b6bck"
May 27 18:10:31.071969 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.071575    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549c5cb954-b6bck" event={"ID":"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6","Type":"ContainerDied","Data":"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"}
May 27 18:10:31.071969 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.071611    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549c5cb954-b6bck" event={"ID":"3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6","Type":"ContainerDied","Data":"d3796d45913436e5e5c2fef58226987aaf6a0894600bc83e792ba8f0d3c6d7cb"}
May 27 18:10:31.071969 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.071627    2558 scope.go:117] "RemoveContainer" containerID="027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"
May 27 18:10:31.081119 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.081093    2558 scope.go:117] "RemoveContainer" containerID="027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"
May 27 18:10:31.081458 ip-10-0-139-141 kubenswrapper[2558]: E0527 18:10:31.081438    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a\": container with ID starting with 027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a not found: ID does not exist" containerID="027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"
May 27 18:10:31.081512 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.081471    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a"} err="failed to get container status \"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a\": rpc error: code = NotFound desc = could not find container \"027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a\": container with ID starting with 027ad88013de105ac471142a1ebcd4cf9f36235d029f92ebe2a33332b7479a5a not found: ID does not exist"
May 27 18:10:31.094874 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.094848    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:10:31.097602 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.097579    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-549c5cb954-b6bck"]
May 27 18:10:31.428391 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:10:31.423563    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" path="/var/lib/kubelet/pods/3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6/volumes"
May 27 18:12:43.376736 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:12:43.376637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:12:43.379639 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:12:43.379617    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:17:43.412229 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:17:43.412196    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:17:43.414852 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:17:43.414819    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:22:43.437989 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:22:43.437959    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:22:43.440601 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:22:43.440580    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:27:43.466270 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:27:43.466239    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:27:43.469314 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:27:43.469298    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:32:43.492158 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:32:43.492037    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:32:43.495888 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:32:43.495866    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:33:27.966217 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:27.966186    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85869cfb6c-4p4xx_ff5c07c8-24a9-49c4-9482-4d4850ca0bd9/authorino/0.log"
May 27 18:33:34.179234 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:34.179149    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667cd477ff-zb4zv_4b9108ed-27c7-4088-b829-4189581f9ef6/manager/0.log"
May 27 18:33:34.294806 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:34.294774    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7rjwp_e30d32ad-1058-4a46-bdc8-c5730afec13d/postgres/0.log"
May 27 18:33:35.742882 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:35.742854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85869cfb6c-4p4xx_ff5c07c8-24a9-49c4-9482-4d4850ca0bd9/authorino/0.log"
May 27 18:33:36.155928 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:36.155853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-78h4z_f33d95da-bbb1-41a0-a087-c61f247502b7/kuadrant-console-plugin/0.log"
May 27 18:33:37.814320 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:37.814289    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b5844854-zjwfq_40218cbb-cff0-4a8a-804c-6bdc9dfbd267/kube-auth-proxy/0.log"
May 27 18:33:38.203120 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:38.203093    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-576c4d95bd-kk54b_38d7a435-d88e-4129-bd3c-9dd8b6500cd8/router/0.log"
May 27 18:33:38.711237 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:38.711208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm_a1b2a380-f730-4fed-a39a-8ec4e87729e3/main/0.log"
May 27 18:33:38.720537 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:38.720514    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-tdlhm_a1b2a380-f730-4fed-a39a-8ec4e87729e3/storage-initializer/0.log"
May 27 18:33:38.843377 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:38.843344    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-tvl4h_4ae610d7-c21e-452a-801c-a365bcc74b91/storage-initializer/0.log"
May 27 18:33:38.852121 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:38.852094    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-tvl4h_4ae610d7-c21e-452a-801c-a365bcc74b91/main/0.log"
May 27 18:33:39.118697 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:39.118618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw_be62ddb4-9588-40e8-9abc-b64894c0b2d9/storage-initializer/0.log"
May 27 18:33:39.127244 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:39.127219    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-jsgkw_be62ddb4-9588-40e8-9abc-b64894c0b2d9/main/0.log"
May 27 18:33:46.840572 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:46.840536    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gjwwm_2ef9f41d-2569-48c2-9edf-4eec3cc66bc9/global-pull-secret-syncer/0.log"
May 27 18:33:47.036825 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:47.036777    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-th6cd_22286faa-e5de-4229-b9cd-737f501cd9b6/konnectivity-agent/0.log"
May 27 18:33:47.093528 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:47.093436    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-141.ec2.internal_25fb5cb1f42738b5be23b63fef28578b/haproxy/0.log"
May 27 18:33:51.279448 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:51.279409    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85869cfb6c-4p4xx_ff5c07c8-24a9-49c4-9482-4d4850ca0bd9/authorino/0.log"
May 27 18:33:51.400789 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:51.400758    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-78h4z_f33d95da-bbb1-41a0-a087-c61f247502b7/kuadrant-console-plugin/0.log"
May 27 18:33:53.130788 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.130760    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/alertmanager/0.log"
May 27 18:33:53.202024 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.201995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/config-reloader/0.log"
May 27 18:33:53.231365 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.231340    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/kube-rbac-proxy-web/0.log"
May 27 18:33:53.260293 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.260270    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/kube-rbac-proxy/0.log"
May 27 18:33:53.284059 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.284028    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/kube-rbac-proxy-metric/0.log"
May 27 18:33:53.310039 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.310009    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/prom-label-proxy/0.log"
May 27 18:33:53.341233 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.341204    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73c6d907-7fe2-4bf0-bcd7-d4b1aa9cabab/init-config-reloader/0.log"
May 27 18:33:53.396359 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.396254    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-227ph_4a2c136c-6046-40e6-88ee-051e55696395/cluster-monitoring-operator/0.log"
May 27 18:33:53.532348 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.532322    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dcc4446d6-l6xj2_b8b8d875-c900-4afd-855c-cb90b65a4d9e/metrics-server/0.log"
May 27 18:33:53.560587 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.560545    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-6ffxh_3130bae5-9a58-4fad-b498-ca7d04996324/monitoring-plugin/0.log"
May 27 18:33:53.596726 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.596691    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fqgq_a5f51887-7daa-486a-90f6-13fd42bb0753/node-exporter/0.log"
May 27 18:33:53.624251 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.624211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fqgq_a5f51887-7daa-486a-90f6-13fd42bb0753/kube-rbac-proxy/0.log"
May 27 18:33:53.653466 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.653385    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fqgq_a5f51887-7daa-486a-90f6-13fd42bb0753/init-textfile/0.log"
May 27 18:33:53.910183 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.910120    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ddmqz_53059369-5fb3-4d12-af95-2af32b324c3f/kube-rbac-proxy-main/0.log"
May 27 18:33:53.940644 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.940615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ddmqz_53059369-5fb3-4d12-af95-2af32b324c3f/kube-rbac-proxy-self/0.log"
May 27 18:33:53.968855 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:53.968803    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ddmqz_53059369-5fb3-4d12-af95-2af32b324c3f/openshift-state-metrics/0.log"
May 27 18:33:54.014736 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.014702    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/prometheus/0.log"
May 27 18:33:54.039801 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.039768    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/config-reloader/0.log"
May 27 18:33:54.063193 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.063164    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/thanos-sidecar/0.log"
May 27 18:33:54.094715 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.094687    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/kube-rbac-proxy-web/0.log"
May 27 18:33:54.117945 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.117913    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/kube-rbac-proxy/0.log"
May 27 18:33:54.141179 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.141136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/kube-rbac-proxy-thanos/0.log"
May 27 18:33:54.163654 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.163571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9f51e33e-c539-4288-beba-a67df7deccc3/init-config-reloader/0.log"
May 27 18:33:54.244048 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:54.244022    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9d8gb_b81bfaf5-f7e7-4a42-b09f-83e7c1c1cba8/prometheus-operator-admission-webhook/0.log"
May 27 18:33:55.456982 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.456947    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"]
May 27 18:33:55.457403 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.457314    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" containerName="authorino"
May 27 18:33:55.457403 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.457325    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" containerName="authorino"
May 27 18:33:55.457514 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.457439    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c6d5c22-c6e3-4965-8b5e-6db6b5138ad6" containerName="authorino"
May 27 18:33:55.459847 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.459815    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.462369 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.462345    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-km28k\"/\"default-dockercfg-mxjbl\""
May 27 18:33:55.462481 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.462370    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km28k\"/\"openshift-service-ca.crt\""
May 27 18:33:55.462481 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.462449    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km28k\"/\"kube-root-ca.crt\""
May 27 18:33:55.467689 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.467649    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"]
May 27 18:33:55.534514 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.534473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-sys\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.534514 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.534515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwq2q\" (UniqueName: \"kubernetes.io/projected/1dc62a84-535a-48e5-9dbe-36dce54a6d31-kube-api-access-hwq2q\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.534785 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.534536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-proc\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.534785 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.534709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-lib-modules\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.534949 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.534900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-podres\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636281 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636221    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-podres\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636320    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-sys\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636340    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwq2q\" (UniqueName: \"kubernetes.io/projected/1dc62a84-535a-48e5-9dbe-36dce54a6d31-kube-api-access-hwq2q\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636360    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-proc\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636418    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-lib-modules\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636432    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-sys\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636474 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636416    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-podres\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636666 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636491    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-proc\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.636666 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.636538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc62a84-535a-48e5-9dbe-36dce54a6d31-lib-modules\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.644395 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.644358    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwq2q\" (UniqueName: \"kubernetes.io/projected/1dc62a84-535a-48e5-9dbe-36dce54a6d31-kube-api-access-hwq2q\") pod \"perf-node-gather-daemonset-gjlnn\" (UID: \"1dc62a84-535a-48e5-9dbe-36dce54a6d31\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.770494 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.770406    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:55.912443 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.912393    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"]
May 27 18:33:55.914477 ip-10-0-139-141 kubenswrapper[2558]: W0527 18:33:55.914453    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1dc62a84_535a_48e5_9dbe_36dce54a6d31.slice/crio-4c792148d432b53bd6f4dba5a7f2caecdecbe83c9010e8bb875e1e152c9af133 WatchSource:0}: Error finding container 4c792148d432b53bd6f4dba5a7f2caecdecbe83c9010e8bb875e1e152c9af133: Status 404 returned error can't find the container with id 4c792148d432b53bd6f4dba5a7f2caecdecbe83c9010e8bb875e1e152c9af133
May 27 18:33:55.916134 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.916117    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:33:55.967489 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:55.965051    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn" event={"ID":"1dc62a84-535a-48e5-9dbe-36dce54a6d31","Type":"ContainerStarted","Data":"4c792148d432b53bd6f4dba5a7f2caecdecbe83c9010e8bb875e1e152c9af133"}
May 27 18:33:56.969982 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:56.969947    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn" event={"ID":"1dc62a84-535a-48e5-9dbe-36dce54a6d31","Type":"ContainerStarted","Data":"402ac9b27d22210a162fed0886ec63462da1f9249d3b9d360af22d74185deddb"}
May 27 18:33:56.970355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:56.970069    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:33:56.990396 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:56.990339    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn" podStartSLOduration=1.9903231529999998 podStartE2EDuration="1.990323153s" podCreationTimestamp="2026-05-27 18:33:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:33:56.988474451 +0000 UTC m=+2174.212107201" watchObservedRunningTime="2026-05-27 18:33:56.990323153 +0000 UTC m=+2174.213956161"
May 27 18:33:57.217407 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:57.217377    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-gbm9m_bcaba486-dbd5-4230-a847-e2971815c966/volume-data-source-validator/0.log"
May 27 18:33:58.059996 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:58.059969    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nphn2_13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be/dns/0.log"
May 27 18:33:58.081567 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:58.081539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nphn2_13d4ce4d-dddc-46f0-94fa-8c21bcd8b0be/kube-rbac-proxy/0.log"
May 27 18:33:58.147678 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:58.147645    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chctj_e8fed2bd-8f58-4021-b8c6-f355e2f010d7/dns-node-resolver/0.log"
May 27 18:33:58.656571 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:58.656539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vzsh_44a4e941-9d7a-4d64-95aa-87f828ef665e/node-ca/0.log"
May 27 18:33:59.767695 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:59.767666    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b5844854-zjwfq_40218cbb-cff0-4a8a-804c-6bdc9dfbd267/kube-auth-proxy/0.log"
May 27 18:33:59.950426 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:33:59.950389    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-576c4d95bd-kk54b_38d7a435-d88e-4129-bd3c-9dd8b6500cd8/router/0.log"
May 27 18:34:00.478859 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:00.478803    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g7jgg_77d7593e-e39a-40a4-be4c-6c4a3df2d792/serve-healthcheck-canary/0.log"
May 27 18:34:00.939660 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:00.939569    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xqqn7_e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7/insights-operator/0.log"
May 27 18:34:00.940050 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:00.939708    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xqqn7_e2b9de70-cd43-4c74-9d73-1f6e0eeb62d7/insights-operator/1.log"
May 27 18:34:01.030603 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:01.030576    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr2v9_992b30e0-2759-4130-87af-6a775a43ec19/kube-rbac-proxy/0.log"
May 27 18:34:01.051950 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:01.051917    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr2v9_992b30e0-2759-4130-87af-6a775a43ec19/exporter/0.log"
May 27 18:34:01.075615 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:01.075585    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr2v9_992b30e0-2759-4130-87af-6a775a43ec19/extractor/0.log"
May 27 18:34:02.984170 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:02.984132    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-gjlnn"
May 27 18:34:03.371894 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:03.371791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667cd477ff-zb4zv_4b9108ed-27c7-4088-b829-4189581f9ef6/manager/0.log"
May 27 18:34:03.395175 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:03.395151    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7rjwp_e30d32ad-1058-4a46-bdc8-c5730afec13d/postgres/0.log"
May 27 18:34:04.703337 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:04.703305    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c49b9c978-lkxq5_ec80af94-7488-44a7-952d-ea5602a69a7e/manager/0.log"
May 27 18:34:09.477355 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:09.477312    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-66psp_999c1733-2fc5-4319-8cde-955d271cf188/kube-storage-version-migrator-operator/1.log"
May 27 18:34:09.478883 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:09.478862    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-66psp_999c1733-2fc5-4319-8cde-955d271cf188/kube-storage-version-migrator-operator/0.log"
May 27 18:34:10.598929 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.598898    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/kube-multus-additional-cni-plugins/0.log"
May 27 18:34:10.621308 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.621271    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/egress-router-binary-copy/0.log"
May 27 18:34:10.643171 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.643137    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/cni-plugins/0.log"
May 27 18:34:10.663464 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.663433    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/bond-cni-plugin/0.log"
May 27 18:34:10.685667 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.685640    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/routeoverride-cni/0.log"
May 27 18:34:10.706923 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.706898    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/whereabouts-cni-bincopy/0.log"
May 27 18:34:10.726809 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.726780    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lczsm_5d24cbac-10d6-4c32-9045-3ce79030de11/whereabouts-cni/0.log"
May 27 18:34:10.975322 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.975295    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vkxfg_1497a690-7d7a-4cc2-aeaf-73907aa1c11d/kube-multus/0.log"
May 27 18:34:10.998642 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:10.998616    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dw7lr_7e68f161-aaa9-4d2e-8321-635538a4a777/network-metrics-daemon/0.log"
May 27 18:34:11.020440 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:11.020419    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dw7lr_7e68f161-aaa9-4d2e-8321-635538a4a777/kube-rbac-proxy/0.log"
May 27 18:34:12.206848 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.206814    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-controller/0.log"
May 27 18:34:12.225384 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.225355    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/0.log"
May 27 18:34:12.244728 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.244700    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/ovn-acl-logging/1.log"
May 27 18:34:12.265233 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.265210    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/kube-rbac-proxy-node/0.log"
May 27 18:34:12.286652 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.286615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/kube-rbac-proxy-ovn-metrics/0.log"
May 27 18:34:12.308154 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.308127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/northd/0.log"
May 27 18:34:12.332712 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.332674    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/nbdb/0.log"
May 27 18:34:12.361376 ip-10-0-139-141 kubenswrapper[2558]: I0527 18:34:12.361349    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mvnx4_ad910420-8c30-4666-83f6-a15d0166506a/sbdb/0.log"