May 29 20:47:07.444049 ip-10-0-137-57 systemd[1]: Starting Kubernetes Kubelet...
May 29 20:47:07.935779 ip-10-0-137-57 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 20:47:07.935779 ip-10-0-137-57 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 20:47:07.935779 ip-10-0-137-57 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 20:47:07.935779 ip-10-0-137-57 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 20:47:07.935779 ip-10-0-137-57 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 20:47:07.937602 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.937502    2582 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943948    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943973    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943976    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943980    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943983    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943985    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943988    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943992    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943994    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943997    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 20:47:07.943982 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.943999    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944002    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944005    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944008    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944010    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944013    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944015    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944018    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944020    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944023    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944025    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944029    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944034    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944036    2582 feature_gate.go:328] unrecognized feature gate: Example
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944039    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944042    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944044    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944047    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944049    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944060    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 20:47:07.944362 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944062    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944065    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944068    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944077    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944080    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944084    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944088    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944090    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944093    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944096    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944098    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944101    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944104    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944106    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944109    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944112    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944114    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944117    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944119    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944121    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 20:47:07.944852 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944124    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944126    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944129    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944132    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944138    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944141    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944143    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944146    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944149    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944151    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944154    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944156    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944159    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944162    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944165    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944167    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944170    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944172    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944175    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944177    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 20:47:07.945381 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944179    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944182    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944184    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944187    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944189    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944192    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944195    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944198    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944201    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944204    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944207    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944209    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944211    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944214    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944216    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944219    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944646    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944651    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944654    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 20:47:07.945885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944657    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944659    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944662    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944665    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944667    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944763    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944771    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944775    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944778    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944781    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944784    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944786    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944789    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944791    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944794    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944797    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944800    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944802    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944805    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 20:47:07.946345 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944808    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944810    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944814    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944817    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944819    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944822    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944825    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944827    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944830    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944832    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944834    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944838    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944842    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944844    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944847    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944850    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944852    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944855    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944858    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 20:47:07.946842 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944861    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944864    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944867    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944869    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944871    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944874    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944877    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944879    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944881    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944884    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944886    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944888    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944891    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944893    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944897    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944900    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944903    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944906    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944908    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944911    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 20:47:07.947321 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944913    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944916    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944919    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944921    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944923    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944926    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944928    2582 feature_gate.go:328] unrecognized feature gate: Example
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944931    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944933    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944935    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944938    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944943    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944945    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944948    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944950    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944953    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944955    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944958    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944960    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944963    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 20:47:07.947865 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944965    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944967    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944970    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944972    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.944975    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945058    2582 flags.go:64] FLAG: --address="0.0.0.0"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945067    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945074    2582 flags.go:64] FLAG: --anonymous-auth="true"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945079    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945086    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945090    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945094    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945098    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945102    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945105    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945109    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945112    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945115    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945118    2582 flags.go:64] FLAG: --cgroup-root=""
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945121    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945124    2582 flags.go:64] FLAG: --client-ca-file=""
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945127    2582 flags.go:64] FLAG: --cloud-config=""
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945130    2582 flags.go:64] FLAG: --cloud-provider="external"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945133    2582 flags.go:64] FLAG: --cluster-dns="[]"
May 29 20:47:07.948354 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945137    2582 flags.go:64] FLAG: --cluster-domain=""
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945140    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945143    2582 flags.go:64] FLAG: --config-dir=""
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945146    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945150    2582 flags.go:64] FLAG: --container-log-max-files="5"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945153    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945156    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945159    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945163    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945166    2582 flags.go:64] FLAG: --contention-profiling="false"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945169    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945172    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945174    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945178    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945182    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945186    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945189    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945191    2582 flags.go:64] FLAG: --enable-load-reader="false"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945196    2582 flags.go:64] FLAG: --enable-server="true"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945199    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945204    2582 flags.go:64] FLAG: --event-burst="100"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945207    2582 flags.go:64] FLAG: --event-qps="50"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945210    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945229    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945232    2582 flags.go:64] FLAG: --eviction-hard=""
May 29 20:47:07.948977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945240    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945243    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945246    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945249    2582 flags.go:64] FLAG: --eviction-soft=""
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945252    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945255    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945258    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945261    2582 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945264    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945267    2582 flags.go:64] FLAG: --fail-swap-on="true"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945270    2582 flags.go:64] FLAG: --feature-gates=""
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945273    2582 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945276    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945279    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945282    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945285    2582 flags.go:64] FLAG: --healthz-port="10248"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945288    2582 flags.go:64] FLAG: --help="false"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945291    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-137-57.ec2.internal"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945294    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945297    2582 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945300    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945303    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945306    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945310    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 20:47:07.949580 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945312    2582 flags.go:64] FLAG: --image-service-endpoint=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945315    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945324    2582 flags.go:64] FLAG: --kube-api-burst="100"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945327    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945330    2582 flags.go:64] FLAG: --kube-api-qps="50"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945333    2582 flags.go:64] FLAG: --kube-reserved=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945335    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945338    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945341    2582 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945344    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945346    2582 flags.go:64] FLAG: --lock-file=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945349    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945352    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945355    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945360    2582 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945363    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945366    2582 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945369    2582 flags.go:64] FLAG: --logging-format="text"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945372    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945375    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945378    2582 flags.go:64] FLAG: --manifest-url=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945380    2582 flags.go:64] FLAG: --manifest-url-header=""
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945385    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945388    2582 flags.go:64] FLAG: --max-open-files="1000000"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945392    2582 flags.go:64] FLAG: --max-pods="110"
May 29 20:47:07.950225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945396    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945399    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945401    2582 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945405    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945408    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945410    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945416    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945424    2582 flags.go:64] FLAG: --node-status-max-images="50"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945428    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945431    2582 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945440    2582 flags.go:64] FLAG: --pod-cidr=""
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945443    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945449    2582 flags.go:64] FLAG: --pod-manifest-path=""
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945452    2582 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945455    2582 flags.go:64] FLAG: --pods-per-core="0"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945458    2582 flags.go:64] FLAG: --port="10250"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945461    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945464    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05912756e662a0ebd"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945467    2582 flags.go:64] FLAG: --qos-reserved=""
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945469    2582 flags.go:64] FLAG: --read-only-port="10255"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945472    2582 flags.go:64] FLAG: --register-node="true"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945475    2582 flags.go:64] FLAG: --register-schedulable="true"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945478    2582 flags.go:64] FLAG: --register-with-taints=""
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945489    2582 flags.go:64] FLAG: --registry-burst="10"
May 29 20:47:07.950923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945492    2582 flags.go:64] FLAG: --registry-qps="5"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945494    2582 flags.go:64] FLAG: --reserved-cpus=""
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945497    2582 flags.go:64] FLAG: --reserved-memory=""
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945501    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945504    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945507    2582 flags.go:64] FLAG: --rotate-certificates="false"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945510    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945513    2582 flags.go:64] FLAG: --runonce="false"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945516    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945519    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945521    2582 flags.go:64] FLAG: --seccomp-default="false"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945524    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945527    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945530    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945534    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945537    2582 flags.go:64] FLAG: --storage-driver-password="root"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945540    2582 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945543    2582 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945545    2582 flags.go:64] FLAG: --storage-driver-user="root"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945548    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945551    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945554    2582 flags.go:64] FLAG: --system-cgroups=""
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945557    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945562    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945565    2582 flags.go:64] FLAG: --tls-cert-file=""
May 29 20:47:07.951516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945568    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945576    2582 flags.go:64] FLAG: --tls-min-version=""
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945579    2582 flags.go:64] FLAG: --tls-private-key-file=""
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945581    2582 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945584    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945587    2582 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945591    2582 flags.go:64] FLAG: --v="2"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945595    2582 flags.go:64] FLAG: --version="false"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945599    2582 flags.go:64] FLAG: --vmodule=""
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945603    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.945606    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945726    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945731    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945734    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945737    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945740    2582 feature_gate.go:328] unrecognized feature gate: Example
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945743    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945746    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945749    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945751    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945755    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945759    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 20:47:07.952139 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945761    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945764    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945766    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945769    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945771    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945781    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945783    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945786    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945789    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945791    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945793    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945796    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945798    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945800    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945803    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945805    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945811    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945813    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945815    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 20:47:07.952705 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945818    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945822    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945825    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945829    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945832    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945835    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945838    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945840    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945843    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945846    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945849    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945851    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945855    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945858    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945860    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945863    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945865    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945868    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945870    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 20:47:07.953236 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945878    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945881    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945883    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945886    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945888    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945891    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945894    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945897    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945899    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945902    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945905    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945908    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945910    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945913    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945915    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945918    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945920    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945923    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945925    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945927    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 20:47:07.953715 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945930    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945932    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945935    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945939    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945943    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945947    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945949    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945952    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945955    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945957    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945960    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945962    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945965    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945973    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945976    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945978    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 20:47:07.954223 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.945981    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 20:47:07.954624 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.946804    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 20:47:07.956203 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.956179    2582 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
May 29 20:47:07.956245 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.956204    2582 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 20:47:07.956275 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956261    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 20:47:07.956275 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956267    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 20:47:07.956275 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956270    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 20:47:07.956275 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956273    2582 feature_gate.go:328] unrecognized feature gate: Example
May 29 20:47:07.956275 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956276    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956279    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956281    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956284    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956287    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956289    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956292    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956294    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956296    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956299    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956302    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956304    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956307    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956309    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956312    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956316    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956321    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956325    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956328    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 20:47:07.956401 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956331    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956334    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956338    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956341    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956343    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956346    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956348    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956351    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956353    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956355    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956358    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956361    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956363    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956365    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956368    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956372    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956374    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956377    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956380    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 20:47:07.956873 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956382    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956385    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956389    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956391    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956394    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956396    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956399    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956401    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956404    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956406    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956409    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956412    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956414    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956417    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956419    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956422    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956425    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956427    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956429    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956432    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 20:47:07.957353 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956434    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956437    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956439    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956441    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956444    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956446    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956448    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956451    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956454    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956457    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956459    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956462    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956465    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956467    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956470    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956472    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956474    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956477    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956480    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956482    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 20:47:07.957855 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956485    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956487    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956489    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956492    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.956497    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956605    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956610    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956614    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956617    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956623    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956626    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956629    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956632    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956635    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956638    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956640    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 20:47:07.958357 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956643    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956645    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956648    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956651    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956654    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956657    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956659    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956662    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956664    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956666    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956686    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956690    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956694    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956697    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956699    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956702    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956704    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956707    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956709    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956712    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 20:47:07.958856 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956714    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956718    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956721    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956725    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956728    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956731    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956734    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956737    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956739    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956742    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956744    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956747    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956749    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956752    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956755    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956758    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956760    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956763    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956765    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 20:47:07.959372 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956768    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956770    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956773    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956775    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956778    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956781    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956783    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956786    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956788    2582 feature_gate.go:328] unrecognized feature gate: Example
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956791    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956793    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956795    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956798    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956800    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956802    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956805    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956807    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956810    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956812    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956815    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 20:47:07.959848 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956818    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956821    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956823    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956828    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956832    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956835    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956838    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956840    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956844    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956847    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956850    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956853    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956855    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956857    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956860    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 20:47:07.960336 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:07.956863    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 20:47:07.960724 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.956868    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 20:47:07.960724 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.957625    2582 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 20:47:07.960724 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.959743    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 20:47:07.960808 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.960758    2582 server.go:1019] "Starting client certificate rotation"
May 29 20:47:07.960873 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.960852    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 20:47:07.960908 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.960899    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 20:47:07.987044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.987023    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 20:47:07.990752 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:07.990731    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 20:47:08.010078 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.010054    2582 log.go:25] "Validated CRI v1 runtime API"
May 29 20:47:08.017163 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.017131    2582 log.go:25] "Validated CRI v1 image API"
May 29 20:47:08.019231 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.019209    2582 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 20:47:08.023240 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.023221    2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 20:47:08.023929 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.023907    2582 fs.go:135] Filesystem UUIDs: map[16ba153c-0bee-4945-abdb-00030a4d0484:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f62bba75-49dc-4a4a-a2db-cd65748dd0ad:/dev/nvme0n1p3]
May 29 20:47:08.023996 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.023930    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 20:47:08.028816 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.028694    2582 manager.go:217] Machine: {Timestamp:2026-05-29 20:47:08.028176492 +0000 UTC m=+0.447029869 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099183 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec38ca612be7a5dfee3bda7040203 SystemUUID:ec2ec38c-a612-be7a-5dfe-e3bda7040203 BootID:a6a38dd0-146c-4d9e-be65-c35a06ebc350 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:b4:94:1e:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:b4:94:1e:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:92:77:d0:fb:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 20:47:08.029514 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.029503    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 20:47:08.029613 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.029601    2582 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 20:47:08.031553 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031526    2582 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 20:47:08.031712 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031556    2582 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 20:47:08.031765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031724    2582 topology_manager.go:138] "Creating topology manager with none policy"
May 29 20:47:08.031765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031733    2582 container_manager_linux.go:306] "Creating device plugin manager"
May 29 20:47:08.031765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031740    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 20:47:08.031765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.031754    2582 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 20:47:08.033099 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.033087    2582 state_mem.go:36] "Initialized new in-memory state store"
May 29 20:47:08.033250 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.033241    2582 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 20:47:08.036207 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.036196    2582 kubelet.go:491] "Attempting to sync node with API server"
May 29 20:47:08.036249 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.036210    2582 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 20:47:08.036249 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.036222    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 20:47:08.036249 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.036231    2582 kubelet.go:397] "Adding apiserver pod source"
May 29 20:47:08.036249 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.036242    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 20:47:08.037653 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.037640    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 20:47:08.037740 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.037660    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 20:47:08.041241 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.041223    2582 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
May 29 20:47:08.043279 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.043265    2582 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 20:47:08.044944 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.044920    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn99z"
May 29 20:47:08.045806 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045792    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 20:47:08.045849 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045812    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 20:47:08.045849 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045821    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 20:47:08.045849 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045831    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 20:47:08.045849 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045842    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 20:47:08.045849 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045848    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045854    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045860    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045868    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045874    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045882    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 20:47:08.045992 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.045888    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 20:47:08.046896 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.046885    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 20:47:08.046896 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.046896    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 20:47:08.048767 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.048731    2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 20:47:08.048842 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.048780    2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 20:47:08.050439 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.050427    2582 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 20:47:08.050481 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.050465    2582 server.go:1295] "Started kubelet"
May 29 20:47:08.050646 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.050543    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 20:47:08.050646 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.050593    2582 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 20:47:08.050767 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.050693    2582 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 20:47:08.052537 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.052497    2582 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 20:47:08.052802 ip-10-0-137-57 systemd[1]: Started Kubernetes Kubelet.
May 29 20:47:08.054204 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.054186    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn99z"
May 29 20:47:08.054696 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.054655    2582 server.go:317] "Adding debug handlers to kubelet server"
May 29 20:47:08.061502 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061486    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 20:47:08.061599 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061530    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 20:47:08.061652 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061607    2582 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 20:47:08.061652 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061622    2582 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 20:47:08.061791 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061779    2582 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 20:47:08.061841 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061831    2582 reconstruct.go:97] "Volume reconstruction finished"
May 29 20:47:08.061841 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.061840    2582 reconciler.go:26] "Reconciler: start to sync state"
May 29 20:47:08.062397 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.062376    2582 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 20:47:08.062486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062472    2582 factory.go:55] Registering systemd factory
May 29 20:47:08.062542 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062492    2582 factory.go:223] Registration of the systemd container factory successfully
May 29 20:47:08.062595 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.062538    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.062708 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062695    2582 factory.go:153] Registering CRI-O factory
May 29 20:47:08.062765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062712    2582 factory.go:223] Registration of the crio container factory successfully
May 29 20:47:08.062822 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062779    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 20:47:08.062822 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062798    2582 factory.go:103] Registering Raw factory
May 29 20:47:08.062822 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.062813    2582 manager.go:1196] Started watching for new ooms in manager
May 29 20:47:08.063423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.063402    2582 manager.go:319] Starting recovery of all containers
May 29 20:47:08.064820 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.064781    2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:08.071315 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.071293    2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-57.ec2.internal" not found
May 29 20:47:08.072913 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.072889    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-57.ec2.internal\" not found" node="ip-10-0-137-57.ec2.internal"
May 29 20:47:08.073482 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.073327    2582 manager.go:324] Recovery completed
May 29 20:47:08.078863 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.078851    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.081450 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.081436    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.081503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.081465    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.081503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.081476    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.082101 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.082085    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 20:47:08.082101 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.082099    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 20:47:08.082211 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.082121    2582 state_mem.go:36] "Initialized new in-memory state store"
May 29 20:47:08.084515 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.084504    2582 policy_none.go:49] "None policy: Start"
May 29 20:47:08.084561 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.084521    2582 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 20:47:08.084561 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.084531    2582 state_mem.go:35] "Initializing new in-memory state store"
May 29 20:47:08.088765 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.088744    2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-57.ec2.internal" not found
May 29 20:47:08.126416 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.126392    2582 manager.go:341] "Starting Device Plugin manager"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.126441    2582 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.126455    2582 server.go:85] "Starting device plugin registration server"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.126784    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.126798    2582 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.126974    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.127062    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.127071    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.127696    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 20:47:08.145266 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.127743    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.146912 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.146897    2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-57.ec2.internal" not found
May 29 20:47:08.196819 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.196734    2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 20:47:08.198130 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.198114    2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 20:47:08.198213 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.198142    2582 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 20:47:08.198213 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.198161    2582 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 20:47:08.198213 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.198169    2582 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 20:47:08.198213 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.198209    2582 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 20:47:08.202781 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.202761    2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:08.227119 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.227094    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.228110 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.228086    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.228167 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.228115    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.228167 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.228139    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.228167 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.228164    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-57.ec2.internal"
May 29 20:47:08.238225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.238199    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-57.ec2.internal"
May 29 20:47:08.238327 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.238229    2582 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-57.ec2.internal\": node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.261093 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.261069    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.298922 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.298880    2582 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"]
May 29 20:47:08.299055 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.298968    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.299973 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.299951    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.300033 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.299981    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.300033 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.299996    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.303588 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.303576    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.303791 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.303778    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.303845 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.303807    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.304288 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304272    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.304397 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304300    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.304397 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304313    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.304397 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304377    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.304543 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304408    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.304543 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.304446    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.306236 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.306220    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.306321 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.306253    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 20:47:08.306928 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.306912    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
May 29 20:47:08.307001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.306932    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
May 29 20:47:08.307001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.306941    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
May 29 20:47:08.336527 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.336496    2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-57.ec2.internal\" not found" node="ip-10-0-137-57.ec2.internal"
May 29 20:47:08.341083 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.341064    2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-57.ec2.internal\" not found" node="ip-10-0-137-57.ec2.internal"
May 29 20:47:08.361649 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.361618    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.363877 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.363861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.363930 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.363889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/556eb30cc85b9809bd1a18b3cb95f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"556eb30cc85b9809bd1a18b3cb95f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.363930 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.363914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.462397 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.462300    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.464525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464503    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.464585 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464535    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/556eb30cc85b9809bd1a18b3cb95f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"556eb30cc85b9809bd1a18b3cb95f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.464585 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464554    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.464668 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464599    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/556eb30cc85b9809bd1a18b3cb95f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"556eb30cc85b9809bd1a18b3cb95f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.464668 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464605    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.464771 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.464694    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f74607fd4bf392c5ebf43ef4f2ce66b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"9f74607fd4bf392c5ebf43ef4f2ce66b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.562987 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.562958    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.639340 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.639298    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.646097 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.646082    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:08.663731 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.663696    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.764289 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.764192    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.864712 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.864654    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:08.935378 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.935346    2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:08.961191 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.961159    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 20:47:08.961726 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.961315    2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 20:47:08.961726 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.961343    2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 20:47:08.961726 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:08.961344    2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 20:47:08.965353 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:08.965332    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
May 29 20:47:09.057975 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.057929    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 20:42:08 +0000 UTC" deadline="2028-03-06 13:26:42.08506862 +0000 UTC"
May 29 20:47:09.057975 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.057971    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15520h39m33.027101926s"
May 29 20:47:09.062168 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.062143    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 20:47:09.064471 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.064452    2582 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:09.076776 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.076751    2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 20:47:09.095845 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.095805    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xdkrl"
May 29 20:47:09.105606 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.105579    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xdkrl"
May 29 20:47:09.129332 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:09.129302    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556eb30cc85b9809bd1a18b3cb95f3d9.slice/crio-ea8efdccc07ecb55b911c3707d70915b2bb1a04e726a26004940e4aadca397c3 WatchSource:0}: Error finding container ea8efdccc07ecb55b911c3707d70915b2bb1a04e726a26004940e4aadca397c3: Status 404 returned error can't find the container with id ea8efdccc07ecb55b911c3707d70915b2bb1a04e726a26004940e4aadca397c3
May 29 20:47:09.129548 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:09.129529    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f74607fd4bf392c5ebf43ef4f2ce66b.slice/crio-0edc1305f5069ed31f90757abb1681b3709326892d0e071142dec46a09286ee1 WatchSource:0}: Error finding container 0edc1305f5069ed31f90757abb1681b3709326892d0e071142dec46a09286ee1: Status 404 returned error can't find the container with id 0edc1305f5069ed31f90757abb1681b3709326892d0e071142dec46a09286ee1
May 29 20:47:09.133421 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.133402    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 20:47:09.163025 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.162982    2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
May 29 20:47:09.174927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.174898    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 20:47:09.175866 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.175851    2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
May 29 20:47:09.185595 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.185576    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 20:47:09.201737 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.201684    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"9f74607fd4bf392c5ebf43ef4f2ce66b","Type":"ContainerStarted","Data":"0edc1305f5069ed31f90757abb1681b3709326892d0e071142dec46a09286ee1"}
May 29 20:47:09.202727 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.202695    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" event={"ID":"556eb30cc85b9809bd1a18b3cb95f3d9","Type":"ContainerStarted","Data":"ea8efdccc07ecb55b911c3707d70915b2bb1a04e726a26004940e4aadca397c3"}
May 29 20:47:09.889166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:09.889132    2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:10.037372 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.037340    2582 apiserver.go:52] "Watching apiserver"
May 29 20:47:10.046719 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.046687    2582 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 20:47:10.048263 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.048225    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t","openshift-cluster-node-tuning-operator/tuned-cr9jq","openshift-dns/node-resolver-fvxsz","openshift-image-registry/node-ca-tkbs9","openshift-multus/multus-additional-cni-plugins-d5g9x","openshift-multus/multus-k9ts5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal","openshift-multus/network-metrics-daemon-dflf6","openshift-network-diagnostics/network-check-target-qd24h","openshift-network-operator/iptables-alerter-lxklg","openshift-ovn-kubernetes/ovnkube-node-5r4nz","kube-system/konnectivity-agent-cw8lw"]
May 29 20:47:10.049917 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.049893    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.051169 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.051142    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.052294 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.052273    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.053044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.053017    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 20:47:10.053303 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.053285    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f8bsw\""
May 29 20:47:10.053507 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.053491    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 20:47:10.053711 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.053695    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 20:47:10.053894 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.053877    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054025    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054200    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054243    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jtr52\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054427    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054624    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054794    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054825    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.054910    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gsjzr\""
May 29 20:47:10.056593 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.056555    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.057516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.057255    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 20:47:10.057516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.057262    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 20:47:10.057516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.057333    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 20:47:10.057516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.057481    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7ntb\""
May 29 20:47:10.058437 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.058418    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.058532 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.058498    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.058596 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.058567    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:10.059044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.059023    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 20:47:10.059130 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.059072    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 20:47:10.059332 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.059314    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kj4r\""
May 29 20:47:10.059897 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.059803    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:10.059897 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.059862    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:10.060451 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.060432    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 20:47:10.060921 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.060664    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8xklf\""
May 29 20:47:10.060921 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.060896    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 20:47:10.065234 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.063442    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.065234 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.063907    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.065234 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.065082    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.065900 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.065871    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vz5k6\""
May 29 20:47:10.066378 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.066190    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 20:47:10.066524 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.066508    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 20:47:10.066759 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.066745    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 20:47:10.066931 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.066917    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 20:47:10.067597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.067577    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 20:47:10.067704 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.067607    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.067851    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zrfhv\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.067871    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.068068    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.068175    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.068241    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.068291    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 20:47:10.068517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.068401    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p8jsm\""
May 29 20:47:10.073702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysconfig\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.073795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-kubernetes\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.073795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvk7r\" (UniqueName: \"kubernetes.io/projected/c7bf9c55-9383-401f-bef6-6e418a3a90f2-kube-api-access-vvk7r\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.073795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-node-log\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.073795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-netns\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-etc-kubernetes\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-conf\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-slash\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-netns\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-systemd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-os-release\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.073986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-multus-daemon-config\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.074001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1825d10-aa4c-4f03-be3b-13e3214b43b9-host\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c8rb\" (UniqueName: \"kubernetes.io/projected/f2223183-bcdc-42f8-b0b2-68c23783cfda-kube-api-access-6c8rb\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-lib-modules\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-script-lib\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-tuned\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2bj\" (UniqueName: \"kubernetes.io/projected/c1825d10-aa4c-4f03-be3b-13e3214b43b9-kube-api-access-8v2bj\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-os-release\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265wp\" (UniqueName: \"kubernetes.io/projected/35fb30ce-a29c-4949-b007-3d531526436f-kube-api-access-265wp\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-ovn\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.074423 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-systemd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46kd\" (UniqueName: \"kubernetes.io/projected/17e47a0d-4a62-4cee-8b1d-bd2266b93366-kube-api-access-f46kd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-hosts-file\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-log-socket\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-system-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-device-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-systemd-units\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-hostroot\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-bin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbd4\" (UniqueName: \"kubernetes.io/projected/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kube-api-access-mwbd4\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-run\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-kubelet\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-cni-binary-copy\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-var-lib-kubelet\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-cnibin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075181 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-conf-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.074976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krv2l\" (UniqueName: \"kubernetes.io/projected/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-kube-api-access-krv2l\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-cnibin\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7bf9c55-9383-401f-bef6-6e418a3a90f2-host-slash\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovn-node-metrics-cert\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-kubelet\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-modprobe-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-config\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5zhl\" (UniqueName: \"kubernetes.io/projected/ec4364aa-9468-4f9e-9b63-fd36e17926f6-kube-api-access-k5zhl\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-system-cni-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-socket-dir-parent\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-host\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-tmp\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1825d10-aa4c-4f03-be3b-13e3214b43b9-serviceca\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.075907 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7bf9c55-9383-401f-bef6-6e418a3a90f2-iptables-alerter-script\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-etc-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-k8s-cni-cncf-io\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-multus-certs\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-binary-copy\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-var-lib-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-bin\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-sys\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-tmp-dir\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-netd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-env-overrides\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-multus\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.076503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.075790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bdww\" (UniqueName: \"kubernetes.io/projected/8b958c5d-9415-445f-8364-4d407885f3ea-kube-api-access-9bdww\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.106692 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.106626    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 20:42:09 +0000 UTC" deadline="2027-10-26 13:44:58.863647859 +0000 UTC"
May 29 20:47:10.106692 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.106665    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12352h57m48.756985287s"
May 29 20:47:10.163072 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.163001    2582 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 20:47:10.177026 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.176987    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-hostroot\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.177368 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.176882    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-hostroot\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177380    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-bin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177407    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbd4\" (UniqueName: \"kubernetes.io/projected/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kube-api-access-mwbd4\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177438    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177459    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-run\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177470    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-bin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.177495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177480    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177526    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-run\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177624    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177624    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-kubelet\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177660    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-kubelet\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce741b03-bb7f-470f-a877-4e4b42da13d3-agent-certs\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce741b03-bb7f-470f-a877-4e4b42da13d3-konnectivity-ca\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177776    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-cni-binary-copy\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.177803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177801    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-var-lib-kubelet\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177824    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-cnibin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177880    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-var-lib-kubelet\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177882    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-cnibin\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177919    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-conf-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177945    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177966    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krv2l\" (UniqueName: \"kubernetes.io/projected/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-kube-api-access-krv2l\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.177985    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-cnibin\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178012    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7bf9c55-9383-401f-bef6-6e418a3a90f2-host-slash\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178038    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178058    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-conf-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-cnibin\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178105    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7bf9c55-9383-401f-bef6-6e418a3a90f2-host-slash\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.178166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178065    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovn-node-metrics-cert\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178171    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-kubelet\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178118    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178214    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-modprobe-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-kubelet\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178240    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-config\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178274    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5zhl\" (UniqueName: \"kubernetes.io/projected/ec4364aa-9468-4f9e-9b63-fd36e17926f6-kube-api-access-k5zhl\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178296    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-system-cni-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178324    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-socket-dir-parent\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178346    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-host\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178357    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-modprobe-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178369    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-tmp\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178375    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178397    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-cni-binary-copy\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178409    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-system-cni-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178442    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1825d10-aa4c-4f03-be3b-13e3214b43b9-serviceca\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178470    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7bf9c55-9383-401f-bef6-6e418a3a90f2-iptables-alerter-script\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178494    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-etc-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.178833 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178520    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-k8s-cni-cncf-io\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178544    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-multus-certs\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178568    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-binary-copy\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178593    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178617    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178640    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-var-lib-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178666    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-bin\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.179525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.178711    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.179838 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.179810    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-socket-dir-parent\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.179905 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.179883    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-sys\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.179954 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.179928    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-multus-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.179954 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.179934    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-tmp-dir\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.180037 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.179989    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-netd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.180037 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180024    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-env-overrides\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.180126 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180053    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-multus\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180126 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180083    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bdww\" (UniqueName: \"kubernetes.io/projected/8b958c5d-9415-445f-8364-4d407885f3ea-kube-api-access-9bdww\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180126 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180102    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysconfig\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180129    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-kubernetes\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180152    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk7r\" (UniqueName: \"kubernetes.io/projected/c7bf9c55-9383-401f-bef6-6e418a3a90f2-kube-api-access-vvk7r\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180168    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-node-log\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180187    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-netns\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180214    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-etc-kubernetes\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180233    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-conf\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-tmp-dir\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.180539 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.180539 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysconfig\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180625 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180556    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-kubernetes\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180625 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180602    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-etc-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.180788 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180761    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-node-log\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.180845 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-netns\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180845 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180840    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-etc-kubernetes\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180937 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180874    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-k8s-cni-cncf-io\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.180986 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180937    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-conf\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180986 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-sys\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.180986 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.180253    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.181107 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181004    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-netd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181268 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-env-overrides\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181331 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181292    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-slash\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181331 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-config\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181331 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181311    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-netns\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181458 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-run-netns\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181458 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181355    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-systemd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181458 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-systemd\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.181458 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-var-lib-cni-multus\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.181622 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.181527    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:10.181713 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.181699    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:10.681613303 +0000 UTC m=+3.100466690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:10.181775 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181761    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-os-release\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.181826 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181772    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-host\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.181826 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181797    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-multus-daemon-config\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.181920 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181833    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1825d10-aa4c-4f03-be3b-13e3214b43b9-host\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.182001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.181983    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-binary-copy\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.182101 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-cni-bin\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.182101 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-host-run-multus-certs\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.182183 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182135    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.182183 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182155    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-os-release\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.182278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182179    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6c8rb\" (UniqueName: \"kubernetes.io/projected/f2223183-bcdc-42f8-b0b2-68c23783cfda-kube-api-access-6c8rb\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.182278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182198    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.182278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182198    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-var-lib-openvswitch\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.182278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182239    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-slash\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.182278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182247    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-lib-modules\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1825d10-aa4c-4f03-be3b-13e3214b43b9-host\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182330    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182349    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182364    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-lib-modules\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182419    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.182525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182452    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.182812 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182600    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-script-lib\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.182812 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182647    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.182812 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182723    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-tuned\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.182812 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182756    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2bj\" (UniqueName: \"kubernetes.io/projected/c1825d10-aa4c-4f03-be3b-13e3214b43b9-kube-api-access-8v2bj\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.182985 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182814    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.182985 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182919    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-os-release\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.182985 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.182958    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.183115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183017    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183037    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-265wp\" (UniqueName: \"kubernetes.io/projected/35fb30ce-a29c-4949-b007-3d531526436f-kube-api-access-265wp\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.183115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183074    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:10.183115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183108    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-ovn\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183139    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-systemd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.183289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183207    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f46kd\" (UniqueName: \"kubernetes.io/projected/17e47a0d-4a62-4cee-8b1d-bd2266b93366-kube-api-access-f46kd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.183289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183238    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-hosts-file\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.183289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183269    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-log-socket\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183284    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-sysctl-d\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.183503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183302    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-system-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.183503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183331    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-device-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.183503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183334    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-systemd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.183503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183387    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-systemd-units\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35fb30ce-a29c-4949-b007-3d531526436f-os-release\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.183702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183538    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-systemd-units\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c1825d10-aa4c-4f03-be3b-13e3214b43b9-serviceca\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.183702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183620    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-device-dir\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.183702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183642    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-log-socket\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.183922 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183711    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b958c5d-9415-445f-8364-4d407885f3ea-system-cni-dir\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.183922 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec4364aa-9468-4f9e-9b63-fd36e17926f6-run-ovn\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.184016 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.183943    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-hosts-file\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.184016 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.184003    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.185221 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185179    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b958c5d-9415-445f-8364-4d407885f3ea-multus-daemon-config\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.185357 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35fb30ce-a29c-4949-b007-3d531526436f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.185800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-tmp\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.185800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovnkube-script-lib\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.185800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185712    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec4364aa-9468-4f9e-9b63-fd36e17926f6-ovn-node-metrics-cert\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.185800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.185777    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7bf9c55-9383-401f-bef6-6e418a3a90f2-iptables-alerter-script\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.186905 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.186884    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbd4\" (UniqueName: \"kubernetes.io/projected/f5e3b71a-2c0d-47af-a6fc-00569f969bbe-kube-api-access-mwbd4\") pod \"aws-ebs-csi-driver-node-n2q9t\" (UID: \"f5e3b71a-2c0d-47af-a6fc-00569f969bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.188620 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.188600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17e47a0d-4a62-4cee-8b1d-bd2266b93366-etc-tuned\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.189332 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.188918    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krv2l\" (UniqueName: \"kubernetes.io/projected/62db3f7d-8556-4b7d-928d-ddd0fbc9551e-kube-api-access-krv2l\") pod \"node-resolver-fvxsz\" (UID: \"62db3f7d-8556-4b7d-928d-ddd0fbc9551e\") " pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.189332 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.189281    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bdww\" (UniqueName: \"kubernetes.io/projected/8b958c5d-9415-445f-8364-4d407885f3ea-kube-api-access-9bdww\") pod \"multus-k9ts5\" (UID: \"8b958c5d-9415-445f-8364-4d407885f3ea\") " pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.189444 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.189346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvk7r\" (UniqueName: \"kubernetes.io/projected/c7bf9c55-9383-401f-bef6-6e418a3a90f2-kube-api-access-vvk7r\") pod \"iptables-alerter-lxklg\" (UID: \"c7bf9c55-9383-401f-bef6-6e418a3a90f2\") " pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.189627 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.189610    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5zhl\" (UniqueName: \"kubernetes.io/projected/ec4364aa-9468-4f9e-9b63-fd36e17926f6-kube-api-access-k5zhl\") pod \"ovnkube-node-5r4nz\" (UID: \"ec4364aa-9468-4f9e-9b63-fd36e17926f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.192619 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.192335    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:10.192619 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.192360    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:10.192619 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.192373    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:10.192619 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.192447    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:10.692424679 +0000 UTC m=+3.111278055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:10.194033 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.194012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c8rb\" (UniqueName: \"kubernetes.io/projected/f2223183-bcdc-42f8-b0b2-68c23783cfda-kube-api-access-6c8rb\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.194328 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.194304    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-265wp\" (UniqueName: \"kubernetes.io/projected/35fb30ce-a29c-4949-b007-3d531526436f-kube-api-access-265wp\") pod \"multus-additional-cni-plugins-d5g9x\" (UID: \"35fb30ce-a29c-4949-b007-3d531526436f\") " pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.194894 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.194871    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2bj\" (UniqueName: \"kubernetes.io/projected/c1825d10-aa4c-4f03-be3b-13e3214b43b9-kube-api-access-8v2bj\") pod \"node-ca-tkbs9\" (UID: \"c1825d10-aa4c-4f03-be3b-13e3214b43b9\") " pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.195415 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.195395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46kd\" (UniqueName: \"kubernetes.io/projected/17e47a0d-4a62-4cee-8b1d-bd2266b93366-kube-api-access-f46kd\") pod \"tuned-cr9jq\" (UID: \"17e47a0d-4a62-4cee-8b1d-bd2266b93366\") " pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.284439 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.284400    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce741b03-bb7f-470f-a877-4e4b42da13d3-agent-certs\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.284439 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.284448    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce741b03-bb7f-470f-a877-4e4b42da13d3-konnectivity-ca\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.285062 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.285041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce741b03-bb7f-470f-a877-4e4b42da13d3-konnectivity-ca\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.287319 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.287294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce741b03-bb7f-470f-a877-4e4b42da13d3-agent-certs\") pod \"konnectivity-agent-cw8lw\" (UID: \"ce741b03-bb7f-470f-a877-4e4b42da13d3\") " pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.336778 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.336742    2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:10.367430 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.367394    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9ts5"
May 29 20:47:10.375305 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.375282    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t"
May 29 20:47:10.382994 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.382969    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cr9jq"
May 29 20:47:10.391741 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.391718    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tkbs9"
May 29 20:47:10.398843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.398819    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d5g9x"
May 29 20:47:10.405399 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.405369    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvxsz"
May 29 20:47:10.411955 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.411933    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxklg"
May 29 20:47:10.419645 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.419586    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:10.424282 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.424262    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:10.570115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.570080    2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 20:47:10.687809 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.687720    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:10.687968 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.687881    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:10.687968 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.687960    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:11.687940454 +0000 UTC m=+4.106793832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:10.788224 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:10.788183    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:10.788404 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.788339    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:10.788404 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.788361    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:10.788404 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.788373    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:10.788566 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:10.788450    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:11.788428735 +0000 UTC m=+4.207282099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:10.839410 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:10.839349    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e3b71a_2c0d_47af_a6fc_00569f969bbe.slice/crio-cb36b0e05b9d464fb7648c59aae9cced70d0a4233fef52318406e0b432223b46 WatchSource:0}: Error finding container cb36b0e05b9d464fb7648c59aae9cced70d0a4233fef52318406e0b432223b46: Status 404 returned error can't find the container with id cb36b0e05b9d464fb7648c59aae9cced70d0a4233fef52318406e0b432223b46
May 29 20:47:10.841363 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:10.841306    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bf9c55_9383_401f_bef6_6e418a3a90f2.slice/crio-b8819b63b9c9c64dca85e6e9e127e9ce1848c705b75eb95c20c63f7d5568ebef WatchSource:0}: Error finding container b8819b63b9c9c64dca85e6e9e127e9ce1848c705b75eb95c20c63f7d5568ebef: Status 404 returned error can't find the container with id b8819b63b9c9c64dca85e6e9e127e9ce1848c705b75eb95c20c63f7d5568ebef
May 29 20:47:11.107039 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.106860    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 20:42:09 +0000 UTC" deadline="2028-01-25 11:11:51.37396823 +0000 UTC"
May 29 20:47:11.107039 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.107035    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14534h24m40.266936006s"
May 29 20:47:11.199110 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.199069    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:11.199240 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.199200    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:11.206781 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.206751    2582 generic.go:358] "Generic (PLEG): container finished" podID="9f74607fd4bf392c5ebf43ef4f2ce66b" containerID="26b0d36fe2cb5fa56ee0101a2d1450280deec03013948c629f8359326e292065" exitCode=0
May 29 20:47:11.206956 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.206826    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"9f74607fd4bf392c5ebf43ef4f2ce66b","Type":"ContainerDied","Data":"26b0d36fe2cb5fa56ee0101a2d1450280deec03013948c629f8359326e292065"}
May 29 20:47:11.208067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.208034    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerStarted","Data":"b3c76ffc3f248ab629a72e0e6d058435e2a09e3289c45e245aef3f4140f5e134"}
May 29 20:47:11.208970 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.208948    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tkbs9" event={"ID":"c1825d10-aa4c-4f03-be3b-13e3214b43b9","Type":"ContainerStarted","Data":"7c55941336f1800bffd58292db6f770724d6c84053e106ce9397b63d0df5a7a5"}
May 29 20:47:11.210019 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.209992    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxklg" event={"ID":"c7bf9c55-9383-401f-bef6-6e418a3a90f2","Type":"ContainerStarted","Data":"b8819b63b9c9c64dca85e6e9e127e9ce1848c705b75eb95c20c63f7d5568ebef"}
May 29 20:47:11.211002 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.210978    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t" event={"ID":"f5e3b71a-2c0d-47af-a6fc-00569f969bbe","Type":"ContainerStarted","Data":"cb36b0e05b9d464fb7648c59aae9cced70d0a4233fef52318406e0b432223b46"}
May 29 20:47:11.212626 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.212599    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" event={"ID":"556eb30cc85b9809bd1a18b3cb95f3d9","Type":"ContainerStarted","Data":"e472f003757d560071cdaaf96095dea6955c404806ea4dd7595372f298d12af3"}
May 29 20:47:11.213711 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.213688    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw8lw" event={"ID":"ce741b03-bb7f-470f-a877-4e4b42da13d3","Type":"ContainerStarted","Data":"1e6b099d3c1cfd88e1b0d1d3d2910fc4413228fec5069679e0111e4c1daf41fb"}
May 29 20:47:11.214575 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.214552    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9ts5" event={"ID":"8b958c5d-9415-445f-8364-4d407885f3ea","Type":"ContainerStarted","Data":"6ea08b0ef170984e570a8fcab32d55612d0d3d02e009338fc2fc6a360f88024b"}
May 29 20:47:11.215654 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.215631    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"7b72b91e077ec790434f566b6df130f825fdda2ab75426c2434130bc033190a0"}
May 29 20:47:11.216791 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.216768    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cr9jq" event={"ID":"17e47a0d-4a62-4cee-8b1d-bd2266b93366","Type":"ContainerStarted","Data":"72e8805778c97461fee64ad75c75ce935f714795bf910e3bd9b068def463d58a"}
May 29 20:47:11.217843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.217820    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvxsz" event={"ID":"62db3f7d-8556-4b7d-928d-ddd0fbc9551e","Type":"ContainerStarted","Data":"c72d14c7592c2d47ea5f0261a963d955df6f573cdf5c59c8621d1f792a08a71a"}
May 29 20:47:11.236644 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.236595    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" podStartSLOduration=2.236580643 podStartE2EDuration="2.236580643s" podCreationTimestamp="2026-05-29 20:47:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:47:11.236461112 +0000 UTC m=+3.655314500" watchObservedRunningTime="2026-05-29 20:47:11.236580643 +0000 UTC m=+3.655434031"
May 29 20:47:11.695023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.694933    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:11.695185 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.695132    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:11.695265 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.695251    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:13.695230144 +0000 UTC m=+6.114083515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:11.795372 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:11.795333    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:11.795540 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.795503    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:11.795540 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.795532    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:11.795648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.795544    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:11.795648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:11.795604    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:13.795584295 +0000 UTC m=+6.214437679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:12.201387 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:12.200901    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:12.201387 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:12.201022    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:12.248645 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:12.248609    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"9f74607fd4bf392c5ebf43ef4f2ce66b","Type":"ContainerStarted","Data":"70f96420a52d33d8e1e0d921f56fff29b2c3f2991e0b634b116497640699a34b"}
May 29 20:47:12.263787 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:12.263731    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" podStartSLOduration=3.263711969 podStartE2EDuration="3.263711969s" podCreationTimestamp="2026-05-29 20:47:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:47:12.263699068 +0000 UTC m=+4.682552454" watchObservedRunningTime="2026-05-29 20:47:12.263711969 +0000 UTC m=+4.682565349"
May 29 20:47:13.198695 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:13.198644    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:13.198943 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.198817    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:13.713179 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:13.712573    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:13.713179 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.712755    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:13.713179 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.712821    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:17.712801144 +0000 UTC m=+10.131654522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:13.813648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:13.812937    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:13.813648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.813132    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:13.813648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.813149    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:13.813648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.813162    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:13.813648 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:13.813223    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:17.813204986 +0000 UTC m=+10.232058358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:14.199234 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:14.198721    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:14.199234 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:14.198850    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:15.198753 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:15.198650    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:15.199156 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:15.198842    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:16.199193 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:16.198701    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:16.199193 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:16.198842    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:17.199187 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.199152    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:17.199377 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.199292    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:17.666216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.666178    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cfp6n"]
May 29 20:47:17.668337 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.668309    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.668530 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.668389    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:17.747200 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.747160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.747412 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.747276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-kubelet-config\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.747412 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.747321    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:17.747412 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.747348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-dbus\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.747580 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.747431    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:17.747580 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.747482    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:25.747462684 +0000 UTC m=+18.166316048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848371    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848414    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848442    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-kubelet-config\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848468    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-dbus\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848656    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-dbus\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848725    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848777    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848784    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:18.348766782 +0000 UTC m=+10.767620146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848791    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848804    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:17.848834    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:25.848824979 +0000 UTC m=+18.267678344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:17.848927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:17.848883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54340870-e1f8-4b05-9136-9ef98053cef0-kubelet-config\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:18.199804 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:18.199766    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:18.200234 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:18.199894    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:18.352574 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:18.352525    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:18.352778 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:18.352745    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:18.352835 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:18.352810    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:19.352792233 +0000 UTC m=+11.771645603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:19.198763 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:19.198659    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:19.198763 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:19.198699    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:19.198963 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:19.198829    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:19.199018 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:19.198964    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:19.360557 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:19.360506    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:19.361089 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:19.360657    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:19.361089 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:19.360745    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:21.360724646 +0000 UTC m=+13.779578013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:20.199356 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:20.198862    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:20.199356 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:20.198993    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:21.199314 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:21.199272    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:21.199794 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:21.199272    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:21.199794 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:21.199414    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:21.199794 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:21.199506    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:21.375248 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:21.375159    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:21.375379 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:21.375279    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:21.375379 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:21.375349    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:25.375329142 +0000 UTC m=+17.794182530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:22.199368 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:22.199330    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:22.199781 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:22.199471    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:23.199339 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:23.199307    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:23.199514 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:23.199341    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:23.199514 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:23.199429    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:23.199969 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:23.199564    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:24.199112 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:24.199071    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:24.199267 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:24.199205    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:25.199437 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:25.199397    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:25.199945 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:25.199408    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:25.199945 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.199547    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:25.199945 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.199658    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:25.403442 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:25.403401    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:25.403591 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.403543    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:25.403634 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.403606    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:33.403587618 +0000 UTC m=+25.822440983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:25.806274 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:25.806229    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:25.806437 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.806392    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:25.806485 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.806465    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:47:41.806442891 +0000 UTC m=+34.225296265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:25.907242 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:25.907139    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:25.907394 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.907288    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:25.907394 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.907314    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:25.907394 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.907324    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:25.907394 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:25.907382    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:41.907367337 +0000 UTC m=+34.326220702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:26.199475 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:26.199385    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:26.199928 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:26.199512    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:27.199056 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:27.199018    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:27.199238 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:27.199033    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:27.199238 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:27.199146    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:27.199363 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:27.199254    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:28.199961 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:28.199917    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:28.200405 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:28.200015    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:29.198342 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:29.198306    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:29.198529 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:29.198380    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:29.198529 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:29.198503    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:29.198639 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:29.198621    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:30.198944 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.198694    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:30.199553 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:30.199047    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:30.282538 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.282499    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvxsz" event={"ID":"62db3f7d-8556-4b7d-928d-ddd0fbc9551e","Type":"ContainerStarted","Data":"2397710f0878e8afdfce43a5e359f934cc4293db17ec73bb9680c1b58e105e35"}
May 29 20:47:30.284225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.284191    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="957f1aa452dce696a7b9a04bd19925a05728af8ee8e52c9163bac6cd6c6317cd" exitCode=0
May 29 20:47:30.284371 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.284223    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"957f1aa452dce696a7b9a04bd19925a05728af8ee8e52c9163bac6cd6c6317cd"}
May 29 20:47:30.285802 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.285774    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tkbs9" event={"ID":"c1825d10-aa4c-4f03-be3b-13e3214b43b9","Type":"ContainerStarted","Data":"50b66089b6cc0881476abf5d939d4ec30dd00c641c32eb736be722afa2f2c320"}
May 29 20:47:30.287426 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.287401    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t" event={"ID":"f5e3b71a-2c0d-47af-a6fc-00569f969bbe","Type":"ContainerStarted","Data":"9d20d3b249d2da06457fd154bc66f73bdfecc305dad60f61ad21a09b301b155c"}
May 29 20:47:30.288800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.288779    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw8lw" event={"ID":"ce741b03-bb7f-470f-a877-4e4b42da13d3","Type":"ContainerStarted","Data":"63a10a31fa279ab4f39d06eb8a216de3446aab4c371a929a87977ca96633c4f9"}
May 29 20:47:30.290189 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.290166    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9ts5" event={"ID":"8b958c5d-9415-445f-8364-4d407885f3ea","Type":"ContainerStarted","Data":"884ae41fa666350d7a187a4f12414eb490477186aa10f6c0b8af865040875074"}
May 29 20:47:30.292821 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.292798    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:47:30.293174 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293150    2582 generic.go:358] "Generic (PLEG): container finished" podID="ec4364aa-9468-4f9e-9b63-fd36e17926f6" containerID="2dbd2fa7660b414c0a4c81418c7b045e28a944cad7f5e53bbfe72509849ea652" exitCode=1
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293174    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"354a83ccd4875bb7b5b365dc9ed81d475b81cb7d8f0466ab862954fb187a7e29"}
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293199    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"52edc19ed3dd1719552396978b3d63ad9dd51c049fd62b0f728db5e240bc3638"}
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293220    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"81b0338b3e4689decde51460b7958e8f50c8e763aee46fb6c01224d561320490"}
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293230    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"70d3abda183a5229fa611bcb8cc23b38c27ca46ff8546c74ef42d9ce2f9a2991"}
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293238    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerDied","Data":"2dbd2fa7660b414c0a4c81418c7b045e28a944cad7f5e53bbfe72509849ea652"}
May 29 20:47:30.293253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.293249    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"e9786cf61be35aab9e5e972cfc43571789a121069c3d3869b23d9d6eca5bfda0"}
May 29 20:47:30.294800 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.294782    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cr9jq" event={"ID":"17e47a0d-4a62-4cee-8b1d-bd2266b93366","Type":"ContainerStarted","Data":"41abdae50a1fc5af852e562028de1f1d7e8eebb84e97f96f3d420f2eb425e028"}
May 29 20:47:30.298052 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.298015    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fvxsz" podStartSLOduration=3.881508208 podStartE2EDuration="22.298000682s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.849887121 +0000 UTC m=+3.268740488" lastFinishedPulling="2026-05-29 20:47:29.266379597 +0000 UTC m=+21.685232962" observedRunningTime="2026-05-29 20:47:30.297791526 +0000 UTC m=+22.716644911" watchObservedRunningTime="2026-05-29 20:47:30.298000682 +0000 UTC m=+22.716854069"
May 29 20:47:30.315342 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.315274    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-k9ts5" podStartSLOduration=3.516372851 podStartE2EDuration="22.315263046s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.851693706 +0000 UTC m=+3.270547117" lastFinishedPulling="2026-05-29 20:47:29.650583943 +0000 UTC m=+22.069437312" observedRunningTime="2026-05-29 20:47:30.314916432 +0000 UTC m=+22.733769819" watchObservedRunningTime="2026-05-29 20:47:30.315263046 +0000 UTC m=+22.734116431"
May 29 20:47:30.332653 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.332608    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cr9jq" podStartSLOduration=3.921907221 podStartE2EDuration="22.332597993s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.851170021 +0000 UTC m=+3.270023386" lastFinishedPulling="2026-05-29 20:47:29.261860786 +0000 UTC m=+21.680714158" observedRunningTime="2026-05-29 20:47:30.332095466 +0000 UTC m=+22.750948852" watchObservedRunningTime="2026-05-29 20:47:30.332597993 +0000 UTC m=+22.751451379"
May 29 20:47:30.345960 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.345901    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tkbs9" podStartSLOduration=4.010698739 podStartE2EDuration="22.345885583s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.849820242 +0000 UTC m=+3.268673611" lastFinishedPulling="2026-05-29 20:47:29.185007091 +0000 UTC m=+21.603860455" observedRunningTime="2026-05-29 20:47:30.345709552 +0000 UTC m=+22.764562939" watchObservedRunningTime="2026-05-29 20:47:30.345885583 +0000 UTC m=+22.764738971"
May 29 20:47:30.383306 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.383260    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cw8lw" podStartSLOduration=3.977015594 podStartE2EDuration="22.383244486s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.853995853 +0000 UTC m=+3.272849224" lastFinishedPulling="2026-05-29 20:47:29.260224751 +0000 UTC m=+21.679078116" observedRunningTime="2026-05-29 20:47:30.382701445 +0000 UTC m=+22.801554833" watchObservedRunningTime="2026-05-29 20:47:30.383244486 +0000 UTC m=+22.802097871"
May 29 20:47:30.731856 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:30.731829    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 20:47:31.142136 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.141980    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T20:47:30.73185286Z","UUID":"88c5cfbe-3c13-4f6f-915f-e08609d68978","Handler":null,"Name":"","Endpoint":""}
May 29 20:47:31.143935 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.143914    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 20:47:31.144067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.143943    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 20:47:31.198933 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.198896    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:31.198933 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.198938    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:31.199431 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:31.199026    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:31.199431 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:31.199134    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:31.299263 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.299217    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxklg" event={"ID":"c7bf9c55-9383-401f-bef6-6e418a3a90f2","Type":"ContainerStarted","Data":"4af47ffaa5cab0399b66af4c173578805cc8772f9239f2a6f792e25c2b82d956"}
May 29 20:47:31.301702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:31.301345    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t" event={"ID":"f5e3b71a-2c0d-47af-a6fc-00569f969bbe","Type":"ContainerStarted","Data":"ef297698d99e7ebbdcb19863ddf06e12f7526f22f466d7f5490397c079ebb727"}
May 29 20:47:32.198743 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:32.198709    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:32.198902 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:32.198843    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:32.304814 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:32.304789    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t" event={"ID":"f5e3b71a-2c0d-47af-a6fc-00569f969bbe","Type":"ContainerStarted","Data":"c7c96eef5372872d66d51511c9d376b511e7bcf002fe26346561b68f005ed43f"}
May 29 20:47:32.341808 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:32.341779    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:32.344165 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:32.344115    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2q9t" podStartSLOduration=3.097678765 podStartE2EDuration="24.344098073s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.841996956 +0000 UTC m=+3.260850321" lastFinishedPulling="2026-05-29 20:47:32.088416262 +0000 UTC m=+24.507269629" observedRunningTime="2026-05-29 20:47:32.342950083 +0000 UTC m=+24.761803469" watchObservedRunningTime="2026-05-29 20:47:32.344098073 +0000 UTC m=+24.762951459"
May 29 20:47:32.344810 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:32.344767    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lxklg" podStartSLOduration=5.928531572 podStartE2EDuration="24.344755759s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.843928412 +0000 UTC m=+3.262781777" lastFinishedPulling="2026-05-29 20:47:29.260152589 +0000 UTC m=+21.679005964" observedRunningTime="2026-05-29 20:47:31.31687692 +0000 UTC m=+23.735730308" watchObservedRunningTime="2026-05-29 20:47:32.344755759 +0000 UTC m=+24.763609147"
May 29 20:47:33.198613 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.198577    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:33.198798 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.198577    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:33.198798 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:33.198740    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:33.198798 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:33.198768    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:33.309962 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.309931    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:47:33.310877 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.310853    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"3e07858be54687a2f7450cc9b73124c233e84add9c2ccabd29485a75dfb35ad3"}
May 29 20:47:33.462739 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.462639    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:33.462904 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:33.462793    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 20:47:33.462904 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:33.462860    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret podName:54340870-e1f8-4b05-9136-9ef98053cef0 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:49.462839052 +0000 UTC m=+41.881692430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret") pod "global-pull-secret-syncer-cfp6n" (UID: "54340870-e1f8-4b05-9136-9ef98053cef0") : object "kube-system"/"original-pull-secret" not registered
May 29 20:47:33.892067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.892028    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:33.892803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:33.892776    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:34.199065 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:34.198982    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:34.199223 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:34.199126    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:34.313251 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:34.313218    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cw8lw"
May 29 20:47:35.198579 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.198548    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:35.198761 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.198551    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:35.198824 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:35.198777    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:35.198824 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:35.198644    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:35.317043 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.317017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:47:35.317838 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.317359    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"3cbabe45c49d5d5f512661a0c922175e190c2c93cb590c0c532bae7fe291a5cc"}
May 29 20:47:35.317838 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.317643    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:35.317838 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.317701    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:35.317838 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.317822    2582 scope.go:117] "RemoveContainer" containerID="2dbd2fa7660b414c0a4c81418c7b045e28a944cad7f5e53bbfe72509849ea652"
May 29 20:47:35.319828 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.319789    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="1f61b8625363365c8c10c71a77d64d6cfe3814834335451f3464103c259ce2e7" exitCode=0
May 29 20:47:35.319942 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.319845    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"1f61b8625363365c8c10c71a77d64d6cfe3814834335451f3464103c259ce2e7"}
May 29 20:47:35.334631 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:35.334448    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:36.198938 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.198899    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:36.199136 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:36.199020    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:36.324215 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.324186    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:47:36.324578 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.324454    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" event={"ID":"ec4364aa-9468-4f9e-9b63-fd36e17926f6","Type":"ContainerStarted","Data":"b23a50bbfc6d35aac55ba06d16131cb14c3f507f39aa12544e9a8360c57ccad8"}
May 29 20:47:36.324826 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.324794    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:36.340806 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.340783    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:47:36.357038 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.356994    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz" podStartSLOduration=9.922286563 podStartE2EDuration="28.356979706s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.849885468 +0000 UTC m=+3.268738837" lastFinishedPulling="2026-05-29 20:47:29.284578616 +0000 UTC m=+21.703431980" observedRunningTime="2026-05-29 20:47:36.355322015 +0000 UTC m=+28.774175425" watchObservedRunningTime="2026-05-29 20:47:36.356979706 +0000 UTC m=+28.775833092"
May 29 20:47:36.956210 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.956175    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfp6n"]
May 29 20:47:36.956421 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.956296    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:36.956421 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:36.956377    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:36.960413 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.960384    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qd24h"]
May 29 20:47:36.960551 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.960501    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:36.960596 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:36.960578    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:36.960927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.960894    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dflf6"]
May 29 20:47:36.961013 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:36.961002    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:36.961118 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:36.961098    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:37.327774 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:37.327735    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="9b7a88b7f5b74af704d71e806706170e1be0d817c2231dbae70bf1ed5b805cb7" exitCode=0
May 29 20:47:37.328147 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:37.327810    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"9b7a88b7f5b74af704d71e806706170e1be0d817c2231dbae70bf1ed5b805cb7"}
May 29 20:47:38.201151 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:38.201121    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:38.201151 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:38.201162    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:38.201354 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:38.201231    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:38.201354 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:38.201296    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:39.199147 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:39.198911    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:39.199496 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:39.199203    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:39.333276 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:39.333244    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="20065acc2c1bb8414b1dddb2f93d7cb24701034509fbb4a15566d3e3c6c90783" exitCode=0
May 29 20:47:39.333466 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:39.333306    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"20065acc2c1bb8414b1dddb2f93d7cb24701034509fbb4a15566d3e3c6c90783"}
May 29 20:47:40.198624 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:40.198593    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:40.198828 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:40.198716    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:40.198828 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:40.198780    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:40.198937 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:40.198901    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:41.198782 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:41.198746    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:41.199377 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.198893    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:47:41.828611 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:41.828570    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:41.828823 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.828755    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:41.828891 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.828833    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:48:13.828816544 +0000 UTC m=+66.247669908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 20:47:41.929775 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:41.929520    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:41.929775 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.929721    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 20:47:41.929775 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.929741    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 20:47:41.929775 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.929755    2582 projected.go:194] Error preparing data for projected volume kube-api-access-8xkvj for pod openshift-network-diagnostics/network-check-target-qd24h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:41.930258 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:41.929824    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj podName:691cfeda-08aa-4ef5-89a3-2f12448ee718 nodeName:}" failed. No retries permitted until 2026-05-29 20:48:13.929804551 +0000 UTC m=+66.348657914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xkvj" (UniqueName: "kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj") pod "network-check-target-qd24h" (UID: "691cfeda-08aa-4ef5-89a3-2f12448ee718") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 20:47:42.198612 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.198515    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:42.198781 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.198515    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:42.198781 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.198642    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qd24h" podUID="691cfeda-08aa-4ef5-89a3-2f12448ee718"
May 29 20:47:42.198781 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.198753    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp6n" podUID="54340870-e1f8-4b05-9136-9ef98053cef0"
May 29 20:47:42.402239 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.402200    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeReady"
May 29 20:47:42.402415 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.402383    2582 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 20:47:42.454802 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.454711    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jvdjd"]
May 29 20:47:42.475842 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.475809    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h85ms"]
May 29 20:47:42.476009 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.475977    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.478301 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.478275    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 20:47:42.478459 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.478378    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7hbwz\""
May 29 20:47:42.478459 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.478413    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 20:47:42.491959 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.491934    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h85ms"]
May 29 20:47:42.491959 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.491964    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvdjd"]
May 29 20:47:42.492268 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.492249    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:42.494708 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.494687    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 20:47:42.494899 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.494871    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 20:47:42.495128 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.495111    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5d94t\""
May 29 20:47:42.495297 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.495276    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 20:47:42.634639 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.634843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shtmh\" (UniqueName: \"kubernetes.io/projected/dd85af44-a91f-4a39-8847-cbb102468100-kube-api-access-shtmh\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:42.634843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d47fe9a-6ea7-4405-8e54-c30def532b5c-tmp-dir\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.634933 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d47fe9a-6ea7-4405-8e54-c30def532b5c-config-volume\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.634933 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mzq\" (UniqueName: \"kubernetes.io/projected/6d47fe9a-6ea7-4405-8e54-c30def532b5c-kube-api-access-z7mzq\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.634933 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.634877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:42.735976 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.735877    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shtmh\" (UniqueName: \"kubernetes.io/projected/dd85af44-a91f-4a39-8847-cbb102468100-kube-api-access-shtmh\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:42.735976 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.735948    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d47fe9a-6ea7-4405-8e54-c30def532b5c-tmp-dir\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.735991    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d47fe9a-6ea7-4405-8e54-c30def532b5c-config-volume\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.736016    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mzq\" (UniqueName: \"kubernetes.io/projected/6d47fe9a-6ea7-4405-8e54-c30def532b5c-kube-api-access-z7mzq\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.736042    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.736070    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.736173    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:42.736197 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.736179    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:42.736417 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.736232    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:47:43.236216922 +0000 UTC m=+35.655070286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:42.736417 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:42.736244    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:43.236238483 +0000 UTC m=+35.655091847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:47:42.736417 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.736375    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d47fe9a-6ea7-4405-8e54-c30def532b5c-tmp-dir\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.736567 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.736549    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d47fe9a-6ea7-4405-8e54-c30def532b5c-config-volume\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.747909 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.747807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mzq\" (UniqueName: \"kubernetes.io/projected/6d47fe9a-6ea7-4405-8e54-c30def532b5c-kube-api-access-z7mzq\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:42.748144 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:42.747992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shtmh\" (UniqueName: \"kubernetes.io/projected/dd85af44-a91f-4a39-8847-cbb102468100-kube-api-access-shtmh\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:43.199405 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:43.199368    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:47:43.202610 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:43.202585    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tklm4\""
May 29 20:47:43.202793 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:43.202592    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 20:47:43.238971 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:43.238934    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:43.238971 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:43.238967    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:43.239194 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:43.239066    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:43.239194 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:43.239112    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:43.239194 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:43.239149    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:44.239122269 +0000 UTC m=+36.657975645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:47:43.239194 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:43.239169    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:47:44.239159196 +0000 UTC m=+36.658012570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:44.199178 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.199136    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:47:44.199353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.199141    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:44.202435 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.202407    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 20:47:44.202821 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.202448    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 20:47:44.203123 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.203103    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdrr8\""
May 29 20:47:44.203236 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.203104    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 20:47:44.246848 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.246812    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:44.247034 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:44.246855    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:44.247034 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:44.246975    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:44.247141 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:44.247049    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:46.247033459 +0000 UTC m=+38.665886824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:47:44.247141 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:44.246975    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:44.247141 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:44.247134    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:47:46.247115159 +0000 UTC m=+38.665968537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:46.263047 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:46.262956    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:46.263047 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:46.263005    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:46.263632 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:46.263122    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:46.263632 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:46.263130    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:46.263632 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:46.263186    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:47:50.263168766 +0000 UTC m=+42.682022129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:46.263632 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:46.263200    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:50.26319361 +0000 UTC m=+42.682046975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:47:47.351433 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:47.351174    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="45de83302f0174bfe3ce1ac6e1052d954b9a486136b302375c03b352f0bf6398" exitCode=0
May 29 20:47:47.351433 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:47.351224    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"45de83302f0174bfe3ce1ac6e1052d954b9a486136b302375c03b352f0bf6398"}
May 29 20:47:48.356184 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:48.356144    2582 generic.go:358] "Generic (PLEG): container finished" podID="35fb30ce-a29c-4949-b007-3d531526436f" containerID="4a3c29120873bee1684b630636f0b2ae1bba0ec4e3f17b3375b29f1d3ba67279" exitCode=0
May 29 20:47:48.356548 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:48.356194    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerDied","Data":"4a3c29120873bee1684b630636f0b2ae1bba0ec4e3f17b3375b29f1d3ba67279"}
May 29 20:47:49.360855 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.360817    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" event={"ID":"35fb30ce-a29c-4949-b007-3d531526436f","Type":"ContainerStarted","Data":"a3852a3bab4a1f4de6bd1827b223a713a6db6e5dc8b0e1b0bde110276279313a"}
May 29 20:47:49.387344 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.387291    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d5g9x" podStartSLOduration=5.55680217 podStartE2EDuration="41.387277143s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:47:10.858940663 +0000 UTC m=+3.277794026" lastFinishedPulling="2026-05-29 20:47:46.689415621 +0000 UTC m=+39.108268999" observedRunningTime="2026-05-29 20:47:49.386318501 +0000 UTC m=+41.805171887" watchObservedRunningTime="2026-05-29 20:47:49.387277143 +0000 UTC m=+41.806130528"
May 29 20:47:49.487234 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.487194    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:49.490185 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.490152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54340870-e1f8-4b05-9136-9ef98053cef0-original-pull-secret\") pod \"global-pull-secret-syncer-cfp6n\" (UID: \"54340870-e1f8-4b05-9136-9ef98053cef0\") " pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:49.617322 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.617239    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp6n"
May 29 20:47:49.749977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:49.749943    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfp6n"]
May 29 20:47:49.754028 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:47:49.753995    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54340870_e1f8_4b05_9136_9ef98053cef0.slice/crio-189efb28df5708b89de8dfd3bc96275c5695582035b4ec68d64499f4ee016a98 WatchSource:0}: Error finding container 189efb28df5708b89de8dfd3bc96275c5695582035b4ec68d64499f4ee016a98: Status 404 returned error can't find the container with id 189efb28df5708b89de8dfd3bc96275c5695582035b4ec68d64499f4ee016a98
May 29 20:47:50.293029 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:50.292986    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:50.293029 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:50.293029    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:50.293265 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:50.293131    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:50.293265 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:50.293137    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:50.293265 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:50.293196    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:47:58.293179008 +0000 UTC m=+50.712032376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:47:50.293265 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:50.293209    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:47:58.2932033 +0000 UTC m=+50.712056663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:50.363528 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:50.363492    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfp6n" event={"ID":"54340870-e1f8-4b05-9136-9ef98053cef0","Type":"ContainerStarted","Data":"189efb28df5708b89de8dfd3bc96275c5695582035b4ec68d64499f4ee016a98"}
May 29 20:47:55.375161 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:55.375123    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfp6n" event={"ID":"54340870-e1f8-4b05-9136-9ef98053cef0","Type":"ContainerStarted","Data":"c21e79b1c1adce329b0b4d08e2d8e508c0028afa77278f8bfcb64cc5ac0b0a98"}
May 29 20:47:55.391402 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:55.391356    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfp6n" podStartSLOduration=33.560155192 podStartE2EDuration="38.39134199s" podCreationTimestamp="2026-05-29 20:47:17 +0000 UTC" firstStartedPulling="2026-05-29 20:47:49.755769885 +0000 UTC m=+42.174623248" lastFinishedPulling="2026-05-29 20:47:54.586956679 +0000 UTC m=+47.005810046" observedRunningTime="2026-05-29 20:47:55.391060046 +0000 UTC m=+47.809913432" watchObservedRunningTime="2026-05-29 20:47:55.39134199 +0000 UTC m=+47.810195378"
May 29 20:47:58.351021 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:58.350979    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:47:58.351021 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:47:58.351025    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:47:58.351506 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:58.351134    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:47:58.351506 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:58.351134    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:47:58.351506 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:58.351205    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:48:14.351184918 +0000 UTC m=+66.770038282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:47:58.351506 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:47:58.351219    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:48:14.351213073 +0000 UTC m=+66.770066437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:48:08.341344 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:08.341313    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r4nz"
May 29 20:48:13.858286 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.858233    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:48:13.860804 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.860782    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 20:48:13.869081 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:13.869061    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 20:48:13.869133 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:13.869122    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:49:17.869105123 +0000 UTC m=+130.287958488 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : secret "metrics-daemon-secret" not found
May 29 20:48:13.958990 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.958956    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:48:13.961801 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.961782    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 20:48:13.971730 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.971710    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 20:48:13.983113 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:13.983090    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkvj\" (UniqueName: \"kubernetes.io/projected/691cfeda-08aa-4ef5-89a3-2f12448ee718-kube-api-access-8xkvj\") pod \"network-check-target-qd24h\" (UID: \"691cfeda-08aa-4ef5-89a3-2f12448ee718\") " pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:48:14.215511 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.215428    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdrr8\""
May 29 20:48:14.223543 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.223520    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:48:14.357898 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.357869    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qd24h"]
May 29 20:48:14.360548 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:48:14.360514    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691cfeda_08aa_4ef5_89a3_2f12448ee718.slice/crio-51f4ced01a3610746e50fffed4d73f0e370f0fa64473084784a7ca773d19eaec WatchSource:0}: Error finding container 51f4ced01a3610746e50fffed4d73f0e370f0fa64473084784a7ca773d19eaec: Status 404 returned error can't find the container with id 51f4ced01a3610746e50fffed4d73f0e370f0fa64473084784a7ca773d19eaec
May 29 20:48:14.362078 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.362033    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:48:14.362078 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.362073    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:48:14.362237 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:14.362208    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:48:14.362321 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:14.362306    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:48:46.362283202 +0000 UTC m=+98.781136570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:48:14.362321 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:14.362215    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:48:14.362421 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:14.362363    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:48:46.362342733 +0000 UTC m=+98.781196112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:48:14.411736 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:14.411692    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qd24h" event={"ID":"691cfeda-08aa-4ef5-89a3-2f12448ee718","Type":"ContainerStarted","Data":"51f4ced01a3610746e50fffed4d73f0e370f0fa64473084784a7ca773d19eaec"}
May 29 20:48:18.420454 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:18.420325    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qd24h" event={"ID":"691cfeda-08aa-4ef5-89a3-2f12448ee718","Type":"ContainerStarted","Data":"56dae45fce0f5ffdf397f594cc45fd1ab5eb25eb11601b91aaa33a4804875bd6"}
May 29 20:48:18.420843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:18.420497    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:48:18.438035 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:18.437983    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qd24h" podStartSLOduration=67.293421928 podStartE2EDuration="1m10.437968158s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:48:14.362519172 +0000 UTC m=+66.781372536" lastFinishedPulling="2026-05-29 20:48:17.507065402 +0000 UTC m=+69.925918766" observedRunningTime="2026-05-29 20:48:18.437447446 +0000 UTC m=+70.856300833" watchObservedRunningTime="2026-05-29 20:48:18.437968158 +0000 UTC m=+70.856821566"
May 29 20:48:46.394980 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:46.394945    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:48:46.394980 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:46.394984    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:48:46.395482 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:46.395088    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 20:48:46.395482 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:46.395102    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 20:48:46.395482 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:46.395146    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls podName:6d47fe9a-6ea7-4405-8e54-c30def532b5c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:50.395132052 +0000 UTC m=+162.813985415 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls") pod "dns-default-jvdjd" (UID: "6d47fe9a-6ea7-4405-8e54-c30def532b5c") : secret "dns-default-metrics-tls" not found
May 29 20:48:46.395482 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:46.395178    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert podName:dd85af44-a91f-4a39-8847-cbb102468100 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:50.395158581 +0000 UTC m=+162.814011945 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert") pod "ingress-canary-h85ms" (UID: "dd85af44-a91f-4a39-8847-cbb102468100") : secret "canary-serving-cert" not found
May 29 20:48:49.424876 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:49.424841    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qd24h"
May 29 20:48:58.350323 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.350286    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"]
May 29 20:48:58.353186 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.353170    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"
May 29 20:48:58.355552 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.355493    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-28f8j\""
May 29 20:48:58.356516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.356325    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 29 20:48:58.356516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.356375    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 29 20:48:58.357417 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.357397    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"]
May 29 20:48:58.359099 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.359081    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"]
May 29 20:48:58.359237 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.359221    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.360958 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.360936    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"
May 29 20:48:58.361360 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361338    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 29 20:48:58.361519 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361435    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 29 20:48:58.361632 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361611    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"]
May 29 20:48:58.361718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361706    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 29 20:48:58.361784 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361725    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l4zmt\""
May 29 20:48:58.361784 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.361747    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 29 20:48:58.363124 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.363106    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-svcxz\""
May 29 20:48:58.375805 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.375781    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"]
May 29 20:48:58.376859 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.376837    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"]
May 29 20:48:58.456627 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.456594    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"]
May 29 20:48:58.458542 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.458526    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.461851 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.461829    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5695c7489-gqpws"]
May 29 20:48:58.462307 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.462280    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 20:48:58.462401 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.462293    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 29 20:48:58.462629 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.462611    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 29 20:48:58.462734 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.462644    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 20:48:58.462734 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.462645    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-j5bpk\""
May 29 20:48:58.464073 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.464057    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.467399 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.467370    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 29 20:48:58.467506 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.467479    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 29 20:48:58.467702 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.467658    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 29 20:48:58.467968 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.467949    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 29 20:48:58.468311 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.468275    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tjgq9\""
May 29 20:48:58.468433 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.468418    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 29 20:48:58.471828 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.471808    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 29 20:48:58.472944 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.472924    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"]
May 29 20:48:58.479001 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.478974    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5695c7489-gqpws"]
May 29 20:48:58.480922 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.480899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvbk\" (UniqueName: \"kubernetes.io/projected/d775baba-1f05-4438-ade7-67bd3f1c771c-kube-api-access-5dvbk\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.481044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.480934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d775baba-1f05-4438-ade7-67bd3f1c771c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.481044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.481003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwh2\" (UniqueName: \"kubernetes.io/projected/6bb254b2-44a0-4921-80da-5c23b13b8517-kube-api-access-fqwh2\") pod \"volume-data-source-validator-7598fd5bd-l92zw\" (UID: \"6bb254b2-44a0-4921-80da-5c23b13b8517\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"
May 29 20:48:58.481044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.481025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d775baba-1f05-4438-ade7-67bd3f1c771c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.481216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.481066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddxv\" (UniqueName: \"kubernetes.io/projected/6d128089-9eba-4ead-a774-66da6e9a275c-kube-api-access-rddxv\") pod \"network-check-source-56d84b9f44-j874t\" (UID: \"6d128089-9eba-4ead-a774-66da6e9a275c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"
May 29 20:48:58.581834 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.581795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-default-certificate\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.582023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.581844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.582023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.581882    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvbk\" (UniqueName: \"kubernetes.io/projected/d775baba-1f05-4438-ade7-67bd3f1c771c-kube-api-access-5dvbk\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.582023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.581906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4xs\" (UniqueName: \"kubernetes.io/projected/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-kube-api-access-gn4xs\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.582023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.581941    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d775baba-1f05-4438-ade7-67bd3f1c771c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.582230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.582230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582140    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwh2\" (UniqueName: \"kubernetes.io/projected/6bb254b2-44a0-4921-80da-5c23b13b8517-kube-api-access-fqwh2\") pod \"volume-data-source-validator-7598fd5bd-l92zw\" (UID: \"6bb254b2-44a0-4921-80da-5c23b13b8517\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"
May 29 20:48:58.582230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582166    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d775baba-1f05-4438-ade7-67bd3f1c771c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.582230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.582431 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-stats-auth\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.582431 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582328    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rddxv\" (UniqueName: \"kubernetes.io/projected/6d128089-9eba-4ead-a774-66da6e9a275c-kube-api-access-rddxv\") pod \"network-check-source-56d84b9f44-j874t\" (UID: \"6d128089-9eba-4ead-a774-66da6e9a275c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"
May 29 20:48:58.582431 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.582431 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wfs9\" (UniqueName: \"kubernetes.io/projected/3b42cf9f-2a01-4378-9684-202de74d281c-kube-api-access-7wfs9\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.582801 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.582543    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d775baba-1f05-4438-ade7-67bd3f1c771c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.584573 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.584551    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d775baba-1f05-4438-ade7-67bd3f1c771c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.590823 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.590798    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddxv\" (UniqueName: \"kubernetes.io/projected/6d128089-9eba-4ead-a774-66da6e9a275c-kube-api-access-rddxv\") pod \"network-check-source-56d84b9f44-j874t\" (UID: \"6d128089-9eba-4ead-a774-66da6e9a275c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"
May 29 20:48:58.591225 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.591206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwh2\" (UniqueName: \"kubernetes.io/projected/6bb254b2-44a0-4921-80da-5c23b13b8517-kube-api-access-fqwh2\") pod \"volume-data-source-validator-7598fd5bd-l92zw\" (UID: \"6bb254b2-44a0-4921-80da-5c23b13b8517\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"
May 29 20:48:58.591277 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.591261    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvbk\" (UniqueName: \"kubernetes.io/projected/d775baba-1f05-4438-ade7-67bd3f1c771c-kube-api-access-5dvbk\") pod \"kube-storage-version-migrator-operator-96ddc787c-tw5rz\" (UID: \"d775baba-1f05-4438-ade7-67bd3f1c771c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.663357 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.663263    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"
May 29 20:48:58.671094 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.671062    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"
May 29 20:48:58.677738 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.677709    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"
May 29 20:48:58.683772 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683739    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-default-certificate\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.683889 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683793    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.683889 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683828    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4xs\" (UniqueName: \"kubernetes.io/projected/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-kube-api-access-gn4xs\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.683889 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683866    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683915    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:58.683920    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683946    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-stats-auth\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.683986    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:58.684005    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:48:59.183983063 +0000 UTC m=+111.602836440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : secret "router-metrics-certs-default" not found
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:58.684017    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:48:58.684067 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.684035    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wfs9\" (UniqueName: \"kubernetes.io/projected/3b42cf9f-2a01-4378-9684-202de74d281c-kube-api-access-7wfs9\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.684423 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:58.684095    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:48:59.184075657 +0000 UTC m=+111.602929022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:48:58.684423 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:58.684387    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:48:59.184370313 +0000 UTC m=+111.603223699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:48:58.685025 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.684769    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.686687 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.686649    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-stats-auth\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.687143 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.687123    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-default-certificate\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.693962 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.693568    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4xs\" (UniqueName: \"kubernetes.io/projected/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-kube-api-access-gn4xs\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:58.693962 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.693860    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wfs9\" (UniqueName: \"kubernetes.io/projected/3b42cf9f-2a01-4378-9684-202de74d281c-kube-api-access-7wfs9\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:58.806725 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.806585    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw"]
May 29 20:48:58.810935 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:48:58.810897    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb254b2_44a0_4921_80da_5c23b13b8517.slice/crio-fa6363d410a0f80ae9647eec96fbcacbe22702721e6c90f345aba662686b725a WatchSource:0}: Error finding container fa6363d410a0f80ae9647eec96fbcacbe22702721e6c90f345aba662686b725a: Status 404 returned error can't find the container with id fa6363d410a0f80ae9647eec96fbcacbe22702721e6c90f345aba662686b725a
May 29 20:48:58.822985 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.822960    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-j874t"]
May 29 20:48:58.825445 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:48:58.825414    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d128089_9eba_4ead_a774_66da6e9a275c.slice/crio-b09b27df0a2d0d52bb8dd46c833c68b48cb0de34f86b3108975a31175c27480d WatchSource:0}: Error finding container b09b27df0a2d0d52bb8dd46c833c68b48cb0de34f86b3108975a31175c27480d: Status 404 returned error can't find the container with id b09b27df0a2d0d52bb8dd46c833c68b48cb0de34f86b3108975a31175c27480d
May 29 20:48:58.835872 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:58.835849    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz"]
May 29 20:48:58.838804 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:48:58.838780    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd775baba_1f05_4438_ade7_67bd3f1c771c.slice/crio-4969cd314ae895e2a78f831a5fcee209930ea3612b04b1aa202f1e990c9d5d5f WatchSource:0}: Error finding container 4969cd314ae895e2a78f831a5fcee209930ea3612b04b1aa202f1e990c9d5d5f: Status 404 returned error can't find the container with id 4969cd314ae895e2a78f831a5fcee209930ea3612b04b1aa202f1e990c9d5d5f
May 29 20:48:59.188111 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.188064    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:48:59.188300 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.188122    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:59.188300 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.188173    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:48:59.188300 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:59.188218    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:48:59.188300 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:59.188248    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 20:48:59.188300 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:59.188295    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:00.188279943 +0000 UTC m=+112.607133307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : secret "router-metrics-certs-default" not found
May 29 20:48:59.188461 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:59.188306    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:00.188300228 +0000 UTC m=+112.607153591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:48:59.188461 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:48:59.188319    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:00.1883121 +0000 UTC m=+112.607165463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:48:59.500516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.500357    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t" event={"ID":"6d128089-9eba-4ead-a774-66da6e9a275c","Type":"ContainerStarted","Data":"b43bedf54242e8c0233debe24989ef4c376cc8cd3f3fba86ddd699d2b99238fd"}
May 29 20:48:59.500516 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.500402    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t" event={"ID":"6d128089-9eba-4ead-a774-66da6e9a275c","Type":"ContainerStarted","Data":"b09b27df0a2d0d52bb8dd46c833c68b48cb0de34f86b3108975a31175c27480d"}
May 29 20:48:59.501945 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.501916    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw" event={"ID":"6bb254b2-44a0-4921-80da-5c23b13b8517","Type":"ContainerStarted","Data":"fa6363d410a0f80ae9647eec96fbcacbe22702721e6c90f345aba662686b725a"}
May 29 20:48:59.502980 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.502944    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz" event={"ID":"d775baba-1f05-4438-ade7-67bd3f1c771c","Type":"ContainerStarted","Data":"4969cd314ae895e2a78f831a5fcee209930ea3612b04b1aa202f1e990c9d5d5f"}
May 29 20:48:59.523879 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:48:59.523820    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-j874t" podStartSLOduration=1.523803965 podStartE2EDuration="1.523803965s" podCreationTimestamp="2026-05-29 20:48:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:48:59.522270549 +0000 UTC m=+111.941123934" watchObservedRunningTime="2026-05-29 20:48:59.523803965 +0000 UTC m=+111.942657350"
May 29 20:49:00.196520 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:00.196479    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:00.196718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:00.196607    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:00.196718 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:00.196636    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:49:00.196841 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:00.196724    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:02.196706076 +0000 UTC m=+114.615559459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:49:00.196841 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:00.196767    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:00.196841 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:00.196792    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:02.196773213 +0000 UTC m=+114.615626605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:49:00.196841 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:00.196814    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 20:49:00.196841 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:00.196842    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:02.196835547 +0000 UTC m=+114.615688911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : secret "router-metrics-certs-default" not found
May 29 20:49:01.509391 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:01.509289    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw" event={"ID":"6bb254b2-44a0-4921-80da-5c23b13b8517","Type":"ContainerStarted","Data":"ec441ebad77ab6f853b6d75f3246ff8b610e681d280cd0d93c80c27160bf0043"}
May 29 20:49:01.510629 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:01.510598    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz" event={"ID":"d775baba-1f05-4438-ade7-67bd3f1c771c","Type":"ContainerStarted","Data":"c343e3302f002c024d5cb5f1356cc53298eca9eae1d65d85ce8d484fd2a740f8"}
May 29 20:49:01.528817 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:01.528769    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-l92zw" podStartSLOduration=1.821970181 podStartE2EDuration="3.52875573s" podCreationTimestamp="2026-05-29 20:48:58 +0000 UTC" firstStartedPulling="2026-05-29 20:48:58.812631158 +0000 UTC m=+111.231484523" lastFinishedPulling="2026-05-29 20:49:00.519416707 +0000 UTC m=+112.938270072" observedRunningTime="2026-05-29 20:49:01.527736316 +0000 UTC m=+113.946589706" watchObservedRunningTime="2026-05-29 20:49:01.52875573 +0000 UTC m=+113.947609144"
May 29 20:49:01.560602 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:01.560543    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz" podStartSLOduration=1.246481374 podStartE2EDuration="3.560525993s" podCreationTimestamp="2026-05-29 20:48:58 +0000 UTC" firstStartedPulling="2026-05-29 20:48:58.840486 +0000 UTC m=+111.259339364" lastFinishedPulling="2026-05-29 20:49:01.154530619 +0000 UTC m=+113.573383983" observedRunningTime="2026-05-29 20:49:01.558805799 +0000 UTC m=+113.977659185" watchObservedRunningTime="2026-05-29 20:49:01.560525993 +0000 UTC m=+113.979379379"
May 29 20:49:02.212574 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.212541    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:02.212793 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.212603    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:02.212793 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.212630    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:02.212793 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:02.212750    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:49:02.212793 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:02.212750    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 20:49:02.212793 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:02.212756    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:06.212734618 +0000 UTC m=+118.631587985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:49:02.213064 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:02.212813    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:06.212799148 +0000 UTC m=+118.631652513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:49:02.213064 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:02.212826    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:06.212818934 +0000 UTC m=+118.631672298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : secret "router-metrics-certs-default" not found
May 29 20:49:02.903786 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.903744    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"]
May 29 20:49:02.906348 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.906325    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"
May 29 20:49:02.908628 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.908605    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 29 20:49:02.909544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.909510    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-65f2c\""
May 29 20:49:02.909544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.909523    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 29 20:49:02.913818 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:02.913796    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"]
May 29 20:49:03.018869 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.018829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpls\" (UniqueName: \"kubernetes.io/projected/6361f76c-0caa-402e-80ac-0d27df85a7c3-kube-api-access-dkpls\") pod \"migrator-96c6f749-tqgzb\" (UID: \"6361f76c-0caa-402e-80ac-0d27df85a7c3\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"
May 29 20:49:03.120339 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.120304    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpls\" (UniqueName: \"kubernetes.io/projected/6361f76c-0caa-402e-80ac-0d27df85a7c3-kube-api-access-dkpls\") pod \"migrator-96c6f749-tqgzb\" (UID: \"6361f76c-0caa-402e-80ac-0d27df85a7c3\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"
May 29 20:49:03.129647 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.129616    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpls\" (UniqueName: \"kubernetes.io/projected/6361f76c-0caa-402e-80ac-0d27df85a7c3-kube-api-access-dkpls\") pod \"migrator-96c6f749-tqgzb\" (UID: \"6361f76c-0caa-402e-80ac-0d27df85a7c3\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"
May 29 20:49:03.216109 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.216022    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"
May 29 20:49:03.340023 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.339990    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb"]
May 29 20:49:03.343745 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:03.343715    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6361f76c_0caa_402e_80ac_0d27df85a7c3.slice/crio-55f036d35b23f0b4b50c22bf66beb6b29b66264fb38f18e0fb396525387cc4cf WatchSource:0}: Error finding container 55f036d35b23f0b4b50c22bf66beb6b29b66264fb38f18e0fb396525387cc4cf: Status 404 returned error can't find the container with id 55f036d35b23f0b4b50c22bf66beb6b29b66264fb38f18e0fb396525387cc4cf
May 29 20:49:03.516264 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:03.516169    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb" event={"ID":"6361f76c-0caa-402e-80ac-0d27df85a7c3","Type":"ContainerStarted","Data":"55f036d35b23f0b4b50c22bf66beb6b29b66264fb38f18e0fb396525387cc4cf"}
May 29 20:49:04.580719 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:04.580688    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvxsz_62db3f7d-8556-4b7d-928d-ddd0fbc9551e/dns-node-resolver/0.log"
May 29 20:49:05.522790 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:05.522751    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb" event={"ID":"6361f76c-0caa-402e-80ac-0d27df85a7c3","Type":"ContainerStarted","Data":"581041a87f8f2bb509a8cf165483a0d60fbc9acaba667b6efb9c1510eba8637f"}
May 29 20:49:05.522790 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:05.522790    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb" event={"ID":"6361f76c-0caa-402e-80ac-0d27df85a7c3","Type":"ContainerStarted","Data":"b578d7392014adb4ec38d76922931bba8a7866a4b765c1fa3ecc6def6c64c997"}
May 29 20:49:05.540099 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:05.540053    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-tqgzb" podStartSLOduration=2.064495873 podStartE2EDuration="3.54003894s" podCreationTimestamp="2026-05-29 20:49:02 +0000 UTC" firstStartedPulling="2026-05-29 20:49:03.345828091 +0000 UTC m=+115.764681455" lastFinishedPulling="2026-05-29 20:49:04.821371155 +0000 UTC m=+117.240224522" observedRunningTime="2026-05-29 20:49:05.538928383 +0000 UTC m=+117.957781768" watchObservedRunningTime="2026-05-29 20:49:05.54003894 +0000 UTC m=+117.958892327"
May 29 20:49:05.780717 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:05.780614    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tkbs9_c1825d10-aa4c-4f03-be3b-13e3214b43b9/node-ca/0.log"
May 29 20:49:06.243416 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:06.243364    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:06.243416 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:06.243430    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:06.243466    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:06.243515    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:06.243581    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:14.243565177 +0000 UTC m=+126.662418541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : secret "router-metrics-certs-default" not found
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:06.243594    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:14.243588637 +0000 UTC m=+126.662442001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:06.243600    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:49:06.243729 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:06.243656    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:14.243638486 +0000 UTC m=+126.662491875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:49:14.308113 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:14.308076    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:14.308511 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:14.308125    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:14.308511 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:14.308157    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:14.308511 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:14.308284    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle podName:3b42cf9f-2a01-4378-9684-202de74d281c nodeName:}" failed. No retries permitted until 2026-05-29 20:49:30.308269653 +0000 UTC m=+142.727123018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle") pod "router-default-5695c7489-gqpws" (UID: "3b42cf9f-2a01-4378-9684-202de74d281c") : configmap references non-existent config key: service-ca.crt
May 29 20:49:14.308511 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:14.308282    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 20:49:14.308511 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:14.308341    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls podName:8d1aa6e8-63e7-477e-b636-5ee13b62a9d9 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:30.308323838 +0000 UTC m=+142.727177204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6pwtv" (UID: "8d1aa6e8-63e7-477e-b636-5ee13b62a9d9") : secret "cluster-monitoring-operator-tls" not found
May 29 20:49:14.310595 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:14.310569    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b42cf9f-2a01-4378-9684-202de74d281c-metrics-certs\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:17.936544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:17.936501    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:49:17.937230 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:17.936704    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 20:49:17.937230 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:17.936784    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs podName:f2223183-bcdc-42f8-b0b2-68c23783cfda nodeName:}" failed. No retries permitted until 2026-05-29 20:51:19.936761735 +0000 UTC m=+252.355615115 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs") pod "network-metrics-daemon-dflf6" (UID: "f2223183-bcdc-42f8-b0b2-68c23783cfda") : secret "metrics-daemon-secret" not found
May 29 20:49:25.335717 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.335661    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"]
May 29 20:49:25.339886 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.339864    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.342188 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.342166    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 29 20:49:25.342313 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.342199    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 29 20:49:25.342513 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.342494    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 29 20:49:25.342643 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.342626    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 29 20:49:25.343074 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.343057    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 29 20:49:25.343133 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.343078    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 29 20:49:25.343133 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.343105    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 29 20:49:25.350451 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.350417    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"]
May 29 20:49:25.422834 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.422804    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2vg2m"]
May 29 20:49:25.426632 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.426611    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.429024 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.428998    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 20:49:25.429133 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.429000    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 20:49:25.429133 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.429097    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q4h98\""
May 29 20:49:25.429133 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.429007    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 20:49:25.429409 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.429395    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 20:49:25.437642 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.437619    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vg2m"]
May 29 20:49:25.494496 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.494661 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.494661 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9h8c\" (UniqueName: \"kubernetes.io/projected/ad1beadf-a03d-45fb-842b-fbfec3401575-kube-api-access-t9h8c\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.494661 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.494661 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ad1beadf-a03d-45fb-842b-fbfec3401575-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.494834 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.494691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.595618 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595523    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.595618 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1037d112-286f-4597-ab8a-72ade5c7cff7-data-volume\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.595618 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1037d112-286f-4597-ab8a-72ade5c7cff7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.595853 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.595853 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595766    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9h8c\" (UniqueName: \"kubernetes.io/projected/ad1beadf-a03d-45fb-842b-fbfec3401575-kube-api-access-t9h8c\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.595853 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595830    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.595960 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595874    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ad1beadf-a03d-45fb-842b-fbfec3401575-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.595960 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595936    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.596045 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.595980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1037d112-286f-4597-ab8a-72ade5c7cff7-crio-socket\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.596045 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.596009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbp4\" (UniqueName: \"kubernetes.io/projected/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-api-access-8xbp4\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.596212 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.596043    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.596752 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.596723    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ad1beadf-a03d-45fb-842b-fbfec3401575-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.598412 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.598376    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.598412 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.598379    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.598559 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.598438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-ca\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.598745 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.598729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1beadf-a03d-45fb-842b-fbfec3401575-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.604641 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.604619    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9h8c\" (UniqueName: \"kubernetes.io/projected/ad1beadf-a03d-45fb-842b-fbfec3401575-kube-api-access-t9h8c\") pod \"cluster-proxy-proxy-agent-67ff69cb79-x75rg\" (UID: \"ad1beadf-a03d-45fb-842b-fbfec3401575\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.661606 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.661569    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"
May 29 20:49:25.697204 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697141    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1037d112-286f-4597-ab8a-72ade5c7cff7-crio-socket\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697218    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbp4\" (UniqueName: \"kubernetes.io/projected/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-api-access-8xbp4\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1037d112-286f-4597-ab8a-72ade5c7cff7-crio-socket\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697275    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1037d112-286f-4597-ab8a-72ade5c7cff7-data-volume\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697314    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1037d112-286f-4597-ab8a-72ade5c7cff7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697353 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697351    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697629    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1037d112-286f-4597-ab8a-72ade5c7cff7-data-volume\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.697839 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.697823    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.699809 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.699792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1037d112-286f-4597-ab8a-72ade5c7cff7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.705979 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.705930    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbp4\" (UniqueName: \"kubernetes.io/projected/1037d112-286f-4597-ab8a-72ade5c7cff7-kube-api-access-8xbp4\") pod \"insights-runtime-extractor-2vg2m\" (UID: \"1037d112-286f-4597-ab8a-72ade5c7cff7\") " pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.736160 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.736131    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vg2m"
May 29 20:49:25.794210 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.794174    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg"]
May 29 20:49:25.797885 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:25.797860    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad1beadf_a03d_45fb_842b_fbfec3401575.slice/crio-9aba3fad454ae255914b7078da70b6230215924b9ee56ec2e9ce003beaff6c21 WatchSource:0}: Error finding container 9aba3fad454ae255914b7078da70b6230215924b9ee56ec2e9ce003beaff6c21: Status 404 returned error can't find the container with id 9aba3fad454ae255914b7078da70b6230215924b9ee56ec2e9ce003beaff6c21
May 29 20:49:25.864553 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:25.864480    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vg2m"]
May 29 20:49:25.867592 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:25.867561    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1037d112_286f_4597_ab8a_72ade5c7cff7.slice/crio-05fa16a830b3e37f78a9b320838fd1dc04fe1a52b438c954c0addaa88ff031e8 WatchSource:0}: Error finding container 05fa16a830b3e37f78a9b320838fd1dc04fe1a52b438c954c0addaa88ff031e8: Status 404 returned error can't find the container with id 05fa16a830b3e37f78a9b320838fd1dc04fe1a52b438c954c0addaa88ff031e8
May 29 20:49:26.573460 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:26.573424    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg" event={"ID":"ad1beadf-a03d-45fb-842b-fbfec3401575","Type":"ContainerStarted","Data":"9aba3fad454ae255914b7078da70b6230215924b9ee56ec2e9ce003beaff6c21"}
May 29 20:49:26.575132 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:26.575098    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vg2m" event={"ID":"1037d112-286f-4597-ab8a-72ade5c7cff7","Type":"ContainerStarted","Data":"77b70e666c6bd3ec6f060f41fec528090afd57e2000082459c64b503c823ff0f"}
May 29 20:49:26.575279 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:26.575141    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vg2m" event={"ID":"1037d112-286f-4597-ab8a-72ade5c7cff7","Type":"ContainerStarted","Data":"05fa16a830b3e37f78a9b320838fd1dc04fe1a52b438c954c0addaa88ff031e8"}
May 29 20:49:27.579896 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:27.579846    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vg2m" event={"ID":"1037d112-286f-4597-ab8a-72ade5c7cff7","Type":"ContainerStarted","Data":"86af9632ece696057e79628e2f5cc01dc8137cbd56404ea04b525da3818a106a"}
May 29 20:49:29.588775 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:29.588730    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg" event={"ID":"ad1beadf-a03d-45fb-842b-fbfec3401575","Type":"ContainerStarted","Data":"183d3960ded9bf06ae05369744114462de212cd9351c98d1a5d441bb86da34de"}
May 29 20:49:30.333918 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.333878    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:30.334126 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.333984    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:30.334714 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.334637    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b42cf9f-2a01-4378-9684-202de74d281c-service-ca-bundle\") pod \"router-default-5695c7489-gqpws\" (UID: \"3b42cf9f-2a01-4378-9684-202de74d281c\") " pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:30.337236 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.337203    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d1aa6e8-63e7-477e-b636-5ee13b62a9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6pwtv\" (UID: \"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:30.572110 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.572074    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-j5bpk\""
May 29 20:49:30.578172 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.578129    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tjgq9\""
May 29 20:49:30.579850 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.579821    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"
May 29 20:49:30.586753 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.586591    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:30.594710 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.594642    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vg2m" event={"ID":"1037d112-286f-4597-ab8a-72ade5c7cff7","Type":"ContainerStarted","Data":"74d03db324514044d70c09cb85c1d1e67501beee9f79a2a02a5f216fab8a0607"}
May 29 20:49:30.619865 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.619789    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2vg2m" podStartSLOduration=1.819761701 podStartE2EDuration="5.61972977s" podCreationTimestamp="2026-05-29 20:49:25 +0000 UTC" firstStartedPulling="2026-05-29 20:49:25.925206299 +0000 UTC m=+138.344059663" lastFinishedPulling="2026-05-29 20:49:29.725174367 +0000 UTC m=+142.144027732" observedRunningTime="2026-05-29 20:49:30.615449086 +0000 UTC m=+143.034302473" watchObservedRunningTime="2026-05-29 20:49:30.61972977 +0000 UTC m=+143.038583157"
May 29 20:49:30.747632 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.747595    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv"]
May 29 20:49:30.764309 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:30.764272    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5695c7489-gqpws"]
May 29 20:49:31.908297 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:31.908256    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1aa6e8_63e7_477e_b636_5ee13b62a9d9.slice/crio-0deda1b0aad0c06c65d92518d6a3ca4057576bbcb52d3e16553aec8f72c4ba3a WatchSource:0}: Error finding container 0deda1b0aad0c06c65d92518d6a3ca4057576bbcb52d3e16553aec8f72c4ba3a: Status 404 returned error can't find the container with id 0deda1b0aad0c06c65d92518d6a3ca4057576bbcb52d3e16553aec8f72c4ba3a
May 29 20:49:31.909013 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:31.908978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b42cf9f_2a01_4378_9684_202de74d281c.slice/crio-2127f93dcbae20359f18493ff24642450e574c9eacd4b6c92968ad3d1ba8152b WatchSource:0}: Error finding container 2127f93dcbae20359f18493ff24642450e574c9eacd4b6c92968ad3d1ba8152b: Status 404 returned error can't find the container with id 2127f93dcbae20359f18493ff24642450e574c9eacd4b6c92968ad3d1ba8152b
May 29 20:49:32.600655 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.600614    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5695c7489-gqpws" event={"ID":"3b42cf9f-2a01-4378-9684-202de74d281c","Type":"ContainerStarted","Data":"2a790352c504086b43df1da6c605d8c1432df63853743f1d586ca086be15a16b"}
May 29 20:49:32.600655 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.600652    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5695c7489-gqpws" event={"ID":"3b42cf9f-2a01-4378-9684-202de74d281c","Type":"ContainerStarted","Data":"2127f93dcbae20359f18493ff24642450e574c9eacd4b6c92968ad3d1ba8152b"}
May 29 20:49:32.602768 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.602732    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg" event={"ID":"ad1beadf-a03d-45fb-842b-fbfec3401575","Type":"ContainerStarted","Data":"0e22d526113ed24309617aa78f7f37aed3841d9cc7395371e898f46ab07a37ff"}
May 29 20:49:32.602768 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.602760    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg" event={"ID":"ad1beadf-a03d-45fb-842b-fbfec3401575","Type":"ContainerStarted","Data":"66bd04b2b605f34dbc26a126962602f02c578729620a4fa059fc36a04db064d1"}
May 29 20:49:32.603714 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.603690    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv" event={"ID":"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9","Type":"ContainerStarted","Data":"0deda1b0aad0c06c65d92518d6a3ca4057576bbcb52d3e16553aec8f72c4ba3a"}
May 29 20:49:32.621626 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.621578    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5695c7489-gqpws" podStartSLOduration=34.62156503 podStartE2EDuration="34.62156503s" podCreationTimestamp="2026-05-29 20:48:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:49:32.620849873 +0000 UTC m=+145.039703270" watchObservedRunningTime="2026-05-29 20:49:32.62156503 +0000 UTC m=+145.040418450"
May 29 20:49:32.639318 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:32.639276    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67ff69cb79-x75rg" podStartSLOduration=1.450385996 podStartE2EDuration="7.639264111s" podCreationTimestamp="2026-05-29 20:49:25 +0000 UTC" firstStartedPulling="2026-05-29 20:49:25.800108179 +0000 UTC m=+138.218961544" lastFinishedPulling="2026-05-29 20:49:31.988986291 +0000 UTC m=+144.407839659" observedRunningTime="2026-05-29 20:49:32.638350627 +0000 UTC m=+145.057204014" watchObservedRunningTime="2026-05-29 20:49:32.639264111 +0000 UTC m=+145.058117497"
May 29 20:49:33.586772 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:33.586730    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:33.589861 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:33.589836    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:33.607255 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:33.607229    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:33.608591 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:33.608569    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5695c7489-gqpws"
May 29 20:49:34.610479 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:34.610443    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv" event={"ID":"8d1aa6e8-63e7-477e-b636-5ee13b62a9d9","Type":"ContainerStarted","Data":"c6c73b8e0ec54b0cbfd59965cdd017f42e55156516054578c5488ff0e09fd9f4"}
May 29 20:49:34.628010 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:34.627961    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6pwtv" podStartSLOduration=34.84112515 podStartE2EDuration="36.62794619s" podCreationTimestamp="2026-05-29 20:48:58 +0000 UTC" firstStartedPulling="2026-05-29 20:49:31.910607891 +0000 UTC m=+144.329461255" lastFinishedPulling="2026-05-29 20:49:33.697428927 +0000 UTC m=+146.116282295" observedRunningTime="2026-05-29 20:49:34.627373594 +0000 UTC m=+147.046226976" watchObservedRunningTime="2026-05-29 20:49:34.62794619 +0000 UTC m=+147.046799591"
May 29 20:49:45.486881 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:45.486828    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jvdjd" podUID="6d47fe9a-6ea7-4405-8e54-c30def532b5c"
May 29 20:49:45.502060 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:45.502023    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-h85ms" podUID="dd85af44-a91f-4a39-8847-cbb102468100"
May 29 20:49:45.638411 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:45.638381    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvdjd"
May 29 20:49:46.210328 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:46.210291    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dflf6" podUID="f2223183-bcdc-42f8-b0b2-68c23783cfda"
May 29 20:49:50.494628 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.494529    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:49:50.494628 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.494605    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:49:50.497059 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.497034    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d47fe9a-6ea7-4405-8e54-c30def532b5c-metrics-tls\") pod \"dns-default-jvdjd\" (UID: \"6d47fe9a-6ea7-4405-8e54-c30def532b5c\") " pod="openshift-dns/dns-default-jvdjd"
May 29 20:49:50.497277 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.497257    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd85af44-a91f-4a39-8847-cbb102468100-cert\") pod \"ingress-canary-h85ms\" (UID: \"dd85af44-a91f-4a39-8847-cbb102468100\") " pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:49:50.742125 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.742094    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7hbwz\""
May 29 20:49:50.750215 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.750144    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvdjd"
May 29 20:49:50.875787 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:50.875752    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvdjd"]
May 29 20:49:50.878745 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:50.878708    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d47fe9a_6ea7_4405_8e54_c30def532b5c.slice/crio-3e8cab058fc6c64f7dd966b502d9da30b033d0d707360692ff940b99bf481bd2 WatchSource:0}: Error finding container 3e8cab058fc6c64f7dd966b502d9da30b033d0d707360692ff940b99bf481bd2: Status 404 returned error can't find the container with id 3e8cab058fc6c64f7dd966b502d9da30b033d0d707360692ff940b99bf481bd2
May 29 20:49:51.655061 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:51.655020    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvdjd" event={"ID":"6d47fe9a-6ea7-4405-8e54-c30def532b5c","Type":"ContainerStarted","Data":"3e8cab058fc6c64f7dd966b502d9da30b033d0d707360692ff940b99bf481bd2"}
May 29 20:49:52.659427 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.659394    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvdjd" event={"ID":"6d47fe9a-6ea7-4405-8e54-c30def532b5c","Type":"ContainerStarted","Data":"ba90baadfdc98597ddcb271e975ee75e854d1c6647990a4bb20b36610ef77ffd"}
May 29 20:49:52.659427 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.659428    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvdjd" event={"ID":"6d47fe9a-6ea7-4405-8e54-c30def532b5c","Type":"ContainerStarted","Data":"569f6289b72d881598042edf7a30aaedd951bba0c5ed3d15b6d166b62830458f"}
May 29 20:49:52.659843 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.659525    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jvdjd"
May 29 20:49:52.672422 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.672390    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krs7d"]
May 29 20:49:52.675606 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.675590    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.677962 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.677923    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 20:49:52.678089 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.677984    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 20:49:52.678089 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.678060    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 20:49:52.678230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.678107    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 20:49:52.678230 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.678199    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-29fkc\""
May 29 20:49:52.690968 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.690894    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jvdjd" podStartSLOduration=129.133607888 podStartE2EDuration="2m10.690881673s" podCreationTimestamp="2026-05-29 20:47:42 +0000 UTC" firstStartedPulling="2026-05-29 20:49:50.880582938 +0000 UTC m=+163.299436302" lastFinishedPulling="2026-05-29 20:49:52.437856714 +0000 UTC m=+164.856710087" observedRunningTime="2026-05-29 20:49:52.689653725 +0000 UTC m=+165.108507114" watchObservedRunningTime="2026-05-29 20:49:52.690881673 +0000 UTC m=+165.109735059"
May 29 20:49:52.808468 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs84f\" (UniqueName: \"kubernetes.io/projected/50370a25-8894-45d9-a327-22315e9bb862-kube-api-access-rs84f\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808468 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-root\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-sys\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-accelerators-collector-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-textfile\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-metrics-client-ca\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808718 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808881 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.808881 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.808738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-wtmp\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909759 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909718    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs84f\" (UniqueName: \"kubernetes.io/projected/50370a25-8894-45d9-a327-22315e9bb862-kube-api-access-rs84f\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909759 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909761    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-root\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909783    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-sys\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-root\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909850    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-accelerators-collector-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909881    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-textfile\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909910    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-metrics-client-ca\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909935    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909959    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.909974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909910    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-sys\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.910327 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.909981    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-wtmp\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.910327 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.910096    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-wtmp\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.910327 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:52.910113    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 29 20:49:52.910327 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:49:52.910167    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls podName:50370a25-8894-45d9-a327-22315e9bb862 nodeName:}" failed. No retries permitted until 2026-05-29 20:49:53.410151305 +0000 UTC m=+165.829004669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls") pod "node-exporter-krs7d" (UID: "50370a25-8894-45d9-a327-22315e9bb862") : secret "node-exporter-tls" not found
May 29 20:49:52.910544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.910336    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-textfile\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.910544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.910445    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-accelerators-collector-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.910544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.910525    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50370a25-8894-45d9-a327-22315e9bb862-metrics-client-ca\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.912648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.912619    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:52.921868 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:52.921834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs84f\" (UniqueName: \"kubernetes.io/projected/50370a25-8894-45d9-a327-22315e9bb862-kube-api-access-rs84f\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:53.413895 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:53.413843    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:53.416795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:53.416763    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50370a25-8894-45d9-a327-22315e9bb862-node-exporter-tls\") pod \"node-exporter-krs7d\" (UID: \"50370a25-8894-45d9-a327-22315e9bb862\") " pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:53.585262 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:53.585177    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krs7d"
May 29 20:49:53.594924 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:49:53.594894    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50370a25_8894_45d9_a327_22315e9bb862.slice/crio-6c9bd236530ce15c3bd9ecd2cda2c588c8114d918296a8facf9a9f98896f888a WatchSource:0}: Error finding container 6c9bd236530ce15c3bd9ecd2cda2c588c8114d918296a8facf9a9f98896f888a: Status 404 returned error can't find the container with id 6c9bd236530ce15c3bd9ecd2cda2c588c8114d918296a8facf9a9f98896f888a
May 29 20:49:53.663228 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:53.663192    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krs7d" event={"ID":"50370a25-8894-45d9-a327-22315e9bb862","Type":"ContainerStarted","Data":"6c9bd236530ce15c3bd9ecd2cda2c588c8114d918296a8facf9a9f98896f888a"}
May 29 20:49:55.669057 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:55.669028    2582 generic.go:358] "Generic (PLEG): container finished" podID="50370a25-8894-45d9-a327-22315e9bb862" containerID="68402ad6f9a58a142857a868a67de8ca0948ef22547efbc355fb8ae828c71da4" exitCode=0
May 29 20:49:55.669441 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:55.669100    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krs7d" event={"ID":"50370a25-8894-45d9-a327-22315e9bb862","Type":"ContainerDied","Data":"68402ad6f9a58a142857a868a67de8ca0948ef22547efbc355fb8ae828c71da4"}
May 29 20:49:56.673264 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:56.673225    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krs7d" event={"ID":"50370a25-8894-45d9-a327-22315e9bb862","Type":"ContainerStarted","Data":"03ecc51726815d3451e7ae857e79ad6b4ae18761f7ede28188026295a06a9618"}
May 29 20:49:56.673264 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:56.673267    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krs7d" event={"ID":"50370a25-8894-45d9-a327-22315e9bb862","Type":"ContainerStarted","Data":"b54ffac5bcf12110855be2f70eb0e4b9443120293f611ad887876c5c41794243"}
May 29 20:49:56.693278 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:56.693229    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krs7d" podStartSLOduration=3.6365138679999998 podStartE2EDuration="4.693215977s" podCreationTimestamp="2026-05-29 20:49:52 +0000 UTC" firstStartedPulling="2026-05-29 20:49:53.596707675 +0000 UTC m=+166.015561044" lastFinishedPulling="2026-05-29 20:49:54.653409787 +0000 UTC m=+167.072263153" observedRunningTime="2026-05-29 20:49:56.692502026 +0000 UTC m=+169.111355424" watchObservedRunningTime="2026-05-29 20:49:56.693215977 +0000 UTC m=+169.112069362"
May 29 20:49:59.199303 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:49:59.199245    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:50:00.199403 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:00.199355    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:50:00.202719 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:00.202694    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5d94t\""
May 29 20:50:00.209714 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:00.209695    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h85ms"
May 29 20:50:00.334302 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:00.334269    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h85ms"]
May 29 20:50:00.338472 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:50:00.338436    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd85af44_a91f_4a39_8847_cbb102468100.slice/crio-a36fe3d0e111a3a8c0c84ce63ab827bb9e8818acc84270b12388c556c1b3a2eb WatchSource:0}: Error finding container a36fe3d0e111a3a8c0c84ce63ab827bb9e8818acc84270b12388c556c1b3a2eb: Status 404 returned error can't find the container with id a36fe3d0e111a3a8c0c84ce63ab827bb9e8818acc84270b12388c556c1b3a2eb
May 29 20:50:00.684438 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:00.684405    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h85ms" event={"ID":"dd85af44-a91f-4a39-8847-cbb102468100","Type":"ContainerStarted","Data":"a36fe3d0e111a3a8c0c84ce63ab827bb9e8818acc84270b12388c556c1b3a2eb"}
May 29 20:50:02.665772 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:02.665739    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jvdjd"
May 29 20:50:02.691878 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:02.691845    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h85ms" event={"ID":"dd85af44-a91f-4a39-8847-cbb102468100","Type":"ContainerStarted","Data":"4916579baa7ba1f5196e9e2aa99225bb28d8e15215e48e9e79d58c0f67b78cdd"}
May 29 20:50:02.707224 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:02.707174    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h85ms" podStartSLOduration=138.928422869 podStartE2EDuration="2m20.70715938s" podCreationTimestamp="2026-05-29 20:47:42 +0000 UTC" firstStartedPulling="2026-05-29 20:50:00.34033558 +0000 UTC m=+172.759188943" lastFinishedPulling="2026-05-29 20:50:02.119072086 +0000 UTC m=+174.537925454" observedRunningTime="2026-05-29 20:50:02.706700143 +0000 UTC m=+175.125553529" watchObservedRunningTime="2026-05-29 20:50:02.70715938 +0000 UTC m=+175.126012766"
May 29 20:50:27.757033 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:27.756996    2582 generic.go:358] "Generic (PLEG): container finished" podID="d775baba-1f05-4438-ade7-67bd3f1c771c" containerID="c343e3302f002c024d5cb5f1356cc53298eca9eae1d65d85ce8d484fd2a740f8" exitCode=0
May 29 20:50:27.757438 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:27.757069    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz" event={"ID":"d775baba-1f05-4438-ade7-67bd3f1c771c","Type":"ContainerDied","Data":"c343e3302f002c024d5cb5f1356cc53298eca9eae1d65d85ce8d484fd2a740f8"}
May 29 20:50:27.757438 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:27.757379    2582 scope.go:117] "RemoveContainer" containerID="c343e3302f002c024d5cb5f1356cc53298eca9eae1d65d85ce8d484fd2a740f8"
May 29 20:50:28.761322 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:50:28.761281    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-tw5rz" event={"ID":"d775baba-1f05-4438-ade7-67bd3f1c771c","Type":"ContainerStarted","Data":"bf8ffabde9367fc954843c65fd87cf228d96a040a6669b650a38fb6c0f206e20"}
May 29 20:51:19.992989 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:19.992900    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:51:19.995458 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:19.995437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2223183-bcdc-42f8-b0b2-68c23783cfda-metrics-certs\") pod \"network-metrics-daemon-dflf6\" (UID: \"f2223183-bcdc-42f8-b0b2-68c23783cfda\") " pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:51:20.203150 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:20.203120    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tklm4\""
May 29 20:51:20.211238 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:20.211218    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflf6"
May 29 20:51:20.343239 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:20.343204    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dflf6"]
May 29 20:51:20.346495 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:51:20.346465    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2223183_bcdc_42f8_b0b2_68c23783cfda.slice/crio-a737957d1c0bd24784031970ddc77b9335d5c3e53a73fc3f3af2661b4605ae35 WatchSource:0}: Error finding container a737957d1c0bd24784031970ddc77b9335d5c3e53a73fc3f3af2661b4605ae35: Status 404 returned error can't find the container with id a737957d1c0bd24784031970ddc77b9335d5c3e53a73fc3f3af2661b4605ae35
May 29 20:51:20.901486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:20.901443    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflf6" event={"ID":"f2223183-bcdc-42f8-b0b2-68c23783cfda","Type":"ContainerStarted","Data":"a737957d1c0bd24784031970ddc77b9335d5c3e53a73fc3f3af2661b4605ae35"}
May 29 20:51:21.905773 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:21.905724    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflf6" event={"ID":"f2223183-bcdc-42f8-b0b2-68c23783cfda","Type":"ContainerStarted","Data":"cc32c5932e51743aa41590443a00d582a6a80562cd6ec65a009b9fc1a9262bd6"}
May 29 20:51:21.905773 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:21.905763    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflf6" event={"ID":"f2223183-bcdc-42f8-b0b2-68c23783cfda","Type":"ContainerStarted","Data":"81f0de0eede2f8417f882f82e3bebdf574361ba9f3f83cf78f076441e5126c35"}
May 29 20:51:21.923463 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:51:21.923409    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dflf6" podStartSLOduration=252.905585558 podStartE2EDuration="4m13.923391893s" podCreationTimestamp="2026-05-29 20:47:08 +0000 UTC" firstStartedPulling="2026-05-29 20:51:20.349098896 +0000 UTC m=+252.767952260" lastFinishedPulling="2026-05-29 20:51:21.366905229 +0000 UTC m=+253.785758595" observedRunningTime="2026-05-29 20:51:21.922981611 +0000 UTC m=+254.341835018" watchObservedRunningTime="2026-05-29 20:51:21.923391893 +0000 UTC m=+254.342245277"
May 29 20:52:08.077685 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:52:08.077637    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:52:08.077685 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:52:08.077645    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:52:08.082291 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:52:08.082268    2582 kubelet.go:1628] "Image garbage collection succeeded"
May 29 20:54:53.300180 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.300143    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"]
May 29 20:54:53.303308 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.303293    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.308275 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.308243    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 29 20:54:53.308275 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.308272    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8ttjm\""
May 29 20:54:53.308474 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.308272    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 29 20:54:53.308474 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.308319    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 29 20:54:53.308474 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.308412    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 29 20:54:53.321462 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.321438    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"]
May 29 20:54:53.442026 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.441975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.442216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.442052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-tmp\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.442216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.442084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.442216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.442106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-manifests\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.442216 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.442163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltq4\" (UniqueName: \"kubernetes.io/projected/7a115b88-0c08-403b-b2f3-cfdd184c4451-kube-api-access-8ltq4\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543299 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543258    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-tmp\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543315    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543352    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-manifests\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543381    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltq4\" (UniqueName: \"kubernetes.io/projected/7a115b88-0c08-403b-b2f3-cfdd184c4451-kube-api-access-8ltq4\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543410    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.543796 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.543775    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-manifests\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.545930 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.545891    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a115b88-0c08-403b-b2f3-cfdd184c4451-tmp\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.546086 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.545933    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.546086 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.546056    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a115b88-0c08-403b-b2f3-cfdd184c4451-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.556347 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.556294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltq4\" (UniqueName: \"kubernetes.io/projected/7a115b88-0c08-403b-b2f3-cfdd184c4451-kube-api-access-8ltq4\") pod \"opendatahub-operator-controller-manager-6c4c488574-8gk9n\" (UID: \"7a115b88-0c08-403b-b2f3-cfdd184c4451\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.617433 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.617406    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:53.751561 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.751536    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"]
May 29 20:54:53.754512 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:54:53.754473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a115b88_0c08_403b_b2f3_cfdd184c4451.slice/crio-ffa0133e1caa8e0c7567b9d43974b15d316ce086a4c5a31b9867ef42e29a04e1 WatchSource:0}: Error finding container ffa0133e1caa8e0c7567b9d43974b15d316ce086a4c5a31b9867ef42e29a04e1: Status 404 returned error can't find the container with id ffa0133e1caa8e0c7567b9d43974b15d316ce086a4c5a31b9867ef42e29a04e1
May 29 20:54:53.756106 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:53.756090    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 20:54:54.466729 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:54.466656    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n" event={"ID":"7a115b88-0c08-403b-b2f3-cfdd184c4451","Type":"ContainerStarted","Data":"ffa0133e1caa8e0c7567b9d43974b15d316ce086a4c5a31b9867ef42e29a04e1"}
May 29 20:54:57.478083 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:57.478044    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n" event={"ID":"7a115b88-0c08-403b-b2f3-cfdd184c4451","Type":"ContainerStarted","Data":"2e1eadb1c6f0152be4496bef5ffc83e52b1a4522882a9c9231e3c7b120284149"}
May 29 20:54:58.486517 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:58.486472    2582 generic.go:358] "Generic (PLEG): container finished" podID="7a115b88-0c08-403b-b2f3-cfdd184c4451" containerID="2e1eadb1c6f0152be4496bef5ffc83e52b1a4522882a9c9231e3c7b120284149" exitCode=0
May 29 20:54:58.486904 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:58.486560    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n" event={"ID":"7a115b88-0c08-403b-b2f3-cfdd184c4451","Type":"ContainerDied","Data":"2e1eadb1c6f0152be4496bef5ffc83e52b1a4522882a9c9231e3c7b120284149"}
May 29 20:54:59.491689 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:59.491639    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n" event={"ID":"7a115b88-0c08-403b-b2f3-cfdd184c4451","Type":"ContainerStarted","Data":"90c992b0d2e0c77db265a07666949bdeef4e584141889ebe5e80ad701fcc4bf8"}
May 29 20:54:59.492062 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:59.491728    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:54:59.511528 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:54:59.511480    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n" podStartSLOduration=1.376407258 podStartE2EDuration="6.511464547s" podCreationTimestamp="2026-05-29 20:54:53 +0000 UTC" firstStartedPulling="2026-05-29 20:54:53.756209354 +0000 UTC m=+466.175062719" lastFinishedPulling="2026-05-29 20:54:58.891266645 +0000 UTC m=+471.310120008" observedRunningTime="2026-05-29 20:54:59.509918857 +0000 UTC m=+471.928772243" watchObservedRunningTime="2026-05-29 20:54:59.511464547 +0000 UTC m=+471.930317963"
May 29 20:55:10.495984 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:10.495954    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4c488574-8gk9n"
May 29 20:55:12.683962 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.683924    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-mj9l2"]
May 29 20:55:12.693302 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.693280    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:12.695552 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.695532    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 29 20:55:12.695721 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.695704    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cv25t\""
May 29 20:55:12.697909 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.697886    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-mj9l2"]
May 29 20:55:12.796949 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.796919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:12.797120 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.796954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsvr\" (UniqueName: \"kubernetes.io/projected/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-kube-api-access-tgsvr\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:12.898264 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.898217    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:12.898264 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.898267    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsvr\" (UniqueName: \"kubernetes.io/projected/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-kube-api-access-tgsvr\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:12.898480 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:12.898359    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 29 20:55:12.898480 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:12.898442    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert podName:7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e nodeName:}" failed. No retries permitted until 2026-05-29 20:55:13.398423663 +0000 UTC m=+485.817277027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert") pod "odh-model-controller-76588b95-mj9l2" (UID: "7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e") : secret "odh-model-controller-webhook-cert" not found
May 29 20:55:12.912473 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:12.912436    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsvr\" (UniqueName: \"kubernetes.io/projected/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-kube-api-access-tgsvr\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:13.402223 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.402189    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:13.404658 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.404633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e-cert\") pod \"odh-model-controller-76588b95-mj9l2\" (UID: \"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e\") " pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:13.464319 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.464285    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-cf7z7"]
May 29 20:55:13.466471 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.466455    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.468485 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.468461    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
May 29 20:55:13.476548 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.476526    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-cf7z7"]
May 29 20:55:13.503277 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.503247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13a5ee3-6886-486c-9a71-8c29a235d8b2-tls-certs\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.503404 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.503319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsf86\" (UniqueName: \"kubernetes.io/projected/e13a5ee3-6886-486c-9a71-8c29a235d8b2-kube-api-access-zsf86\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.604253 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.604210    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:13.604425 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.604318    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13a5ee3-6886-486c-9a71-8c29a235d8b2-tls-certs\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.604425 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.604368    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsf86\" (UniqueName: \"kubernetes.io/projected/e13a5ee3-6886-486c-9a71-8c29a235d8b2-kube-api-access-zsf86\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.607010 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.606986    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13a5ee3-6886-486c-9a71-8c29a235d8b2-tls-certs\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.612539 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.612518    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsf86\" (UniqueName: \"kubernetes.io/projected/e13a5ee3-6886-486c-9a71-8c29a235d8b2-kube-api-access-zsf86\") pod \"model-serving-api-6577596cd5-cf7z7\" (UID: \"e13a5ee3-6886-486c-9a71-8c29a235d8b2\") " pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.727046 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.727017    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-mj9l2"]
May 29 20:55:13.729470 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:13.729435    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3e1f5d_e9c4_45e0_8a10_f82444f1aa2e.slice/crio-cf3bbaf9c2ef624bee107b111b48ff59e3a6e2a733f257a667abd1e68cb93590 WatchSource:0}: Error finding container cf3bbaf9c2ef624bee107b111b48ff59e3a6e2a733f257a667abd1e68cb93590: Status 404 returned error can't find the container with id cf3bbaf9c2ef624bee107b111b48ff59e3a6e2a733f257a667abd1e68cb93590
May 29 20:55:13.777103 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.777067    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:13.899781 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:13.899658    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-cf7z7"]
May 29 20:55:13.902384 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:13.902354    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13a5ee3_6886_486c_9a71_8c29a235d8b2.slice/crio-839d1ceeb1854bfae817f56916c15ac2a67079aae3bd0053e94ba69b408b248c WatchSource:0}: Error finding container 839d1ceeb1854bfae817f56916c15ac2a67079aae3bd0053e94ba69b408b248c: Status 404 returned error can't find the container with id 839d1ceeb1854bfae817f56916c15ac2a67079aae3bd0053e94ba69b408b248c
May 29 20:55:14.530572 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:14.530534    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-cf7z7" event={"ID":"e13a5ee3-6886-486c-9a71-8c29a235d8b2","Type":"ContainerStarted","Data":"839d1ceeb1854bfae817f56916c15ac2a67079aae3bd0053e94ba69b408b248c"}
May 29 20:55:14.531474 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:14.531449    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-mj9l2" event={"ID":"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e","Type":"ContainerStarted","Data":"cf3bbaf9c2ef624bee107b111b48ff59e3a6e2a733f257a667abd1e68cb93590"}
May 29 20:55:15.422183 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.421435    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"]
May 29 20:55:15.424776 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.424755    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.427839 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.427772    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m8xl7\""
May 29 20:55:15.427839 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.427790    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 29 20:55:15.428062 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.428039    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 29 20:55:15.432126 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.432077    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"]
May 29 20:55:15.518364 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.518327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97f1c675-e089-467f-ac71-17fcbdd6b15d-tmp\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.518556 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.518480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwf9p\" (UniqueName: \"kubernetes.io/projected/97f1c675-e089-467f-ac71-17fcbdd6b15d-kube-api-access-pwf9p\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.518556 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.518528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97f1c675-e089-467f-ac71-17fcbdd6b15d-tls-certs\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.619127 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.619090    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwf9p\" (UniqueName: \"kubernetes.io/projected/97f1c675-e089-467f-ac71-17fcbdd6b15d-kube-api-access-pwf9p\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.619127 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.619132    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97f1c675-e089-467f-ac71-17fcbdd6b15d-tls-certs\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.619361 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.619331    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97f1c675-e089-467f-ac71-17fcbdd6b15d-tmp\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.621921 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.621893    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97f1c675-e089-467f-ac71-17fcbdd6b15d-tmp\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.622107 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.622082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97f1c675-e089-467f-ac71-17fcbdd6b15d-tls-certs\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.627318 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.627298    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwf9p\" (UniqueName: \"kubernetes.io/projected/97f1c675-e089-467f-ac71-17fcbdd6b15d-kube-api-access-pwf9p\") pod \"kube-auth-proxy-86969498d5-xf8xp\" (UID: \"97f1c675-e089-467f-ac71-17fcbdd6b15d\") " pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:15.739554 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:15.739475    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"
May 29 20:55:17.654251 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:17.654220    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86969498d5-xf8xp"]
May 29 20:55:17.657118 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:17.657063    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f1c675_e089_467f_ac71_17fcbdd6b15d.slice/crio-a2793e253f7c2a1c288e799f80ca3dec7d73e1294ede8f23510ba5869a317440 WatchSource:0}: Error finding container a2793e253f7c2a1c288e799f80ca3dec7d73e1294ede8f23510ba5869a317440: Status 404 returned error can't find the container with id a2793e253f7c2a1c288e799f80ca3dec7d73e1294ede8f23510ba5869a317440
May 29 20:55:18.545628 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.545583    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-cf7z7" event={"ID":"e13a5ee3-6886-486c-9a71-8c29a235d8b2","Type":"ContainerStarted","Data":"5991eac00a695d97d2ba56fbf905acf60c2a86d1b90e68ac56e1c1079c43699c"}
May 29 20:55:18.545834 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.545659    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:18.546835 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.546791    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp" event={"ID":"97f1c675-e089-467f-ac71-17fcbdd6b15d","Type":"ContainerStarted","Data":"a2793e253f7c2a1c288e799f80ca3dec7d73e1294ede8f23510ba5869a317440"}
May 29 20:55:18.548275 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.548246    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-mj9l2" event={"ID":"7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e","Type":"ContainerStarted","Data":"80ac39068d9e9f1f2ca46120eae8c2ed6cc8087b72f6ab6244a104cabc59e1c9"}
May 29 20:55:18.548491 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.548467    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:18.563095 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.563044    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-cf7z7" podStartSLOduration=1.897630545 podStartE2EDuration="5.563025926s" podCreationTimestamp="2026-05-29 20:55:13 +0000 UTC" firstStartedPulling="2026-05-29 20:55:13.904087712 +0000 UTC m=+486.322941076" lastFinishedPulling="2026-05-29 20:55:17.569483076 +0000 UTC m=+489.988336457" observedRunningTime="2026-05-29 20:55:18.561110069 +0000 UTC m=+490.979963460" watchObservedRunningTime="2026-05-29 20:55:18.563025926 +0000 UTC m=+490.981879313"
May 29 20:55:18.575095 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:18.575039    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-mj9l2" podStartSLOduration=2.781609083 podStartE2EDuration="6.575024054s" podCreationTimestamp="2026-05-29 20:55:12 +0000 UTC" firstStartedPulling="2026-05-29 20:55:13.730736549 +0000 UTC m=+486.149589914" lastFinishedPulling="2026-05-29 20:55:17.524151517 +0000 UTC m=+489.943004885" observedRunningTime="2026-05-29 20:55:18.573926653 +0000 UTC m=+490.992780041" watchObservedRunningTime="2026-05-29 20:55:18.575024054 +0000 UTC m=+490.993877442"
May 29 20:55:20.555329 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:20.555293    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp" event={"ID":"97f1c675-e089-467f-ac71-17fcbdd6b15d","Type":"ContainerStarted","Data":"683d6298454f55e3fe8c4b3f09421df5559f44ffd2001d19495094c5f30613d6"}
May 29 20:55:22.503036 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.502970    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86969498d5-xf8xp" podStartSLOduration=5.61581684 podStartE2EDuration="7.502952706s" podCreationTimestamp="2026-05-29 20:55:15 +0000 UTC" firstStartedPulling="2026-05-29 20:55:17.659414822 +0000 UTC m=+490.078268188" lastFinishedPulling="2026-05-29 20:55:19.54655069 +0000 UTC m=+491.965404054" observedRunningTime="2026-05-29 20:55:20.575753846 +0000 UTC m=+492.994607231" watchObservedRunningTime="2026-05-29 20:55:22.502952706 +0000 UTC m=+494.921806091"
May 29 20:55:22.503584 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.503568    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"]
May 29 20:55:22.506753 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.506736    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:22.508915 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.508896    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 29 20:55:22.509037 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.508939    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m9z8k\""
May 29 20:55:22.516538 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.516514    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"]
May 29 20:55:22.519792 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.519772    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"]
May 29 20:55:22.519897 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.519882    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.522154 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.522132    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
May 29 20:55:22.522246 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.522136    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fq7xn\""
May 29 20:55:22.530661 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.530633    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"]
May 29 20:55:22.574606 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.574570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gh4b\" (UniqueName: \"kubernetes.io/projected/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-kube-api-access-4gh4b\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:22.574606 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.574607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:22.574835 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.574624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.574835 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.574651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd25n\" (UniqueName: \"kubernetes.io/projected/c763b103-6e1d-4253-9c05-c4977a599cf1-kube-api-access-qd25n\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.676086 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.676041    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qd25n\" (UniqueName: \"kubernetes.io/projected/c763b103-6e1d-4253-9c05-c4977a599cf1-kube-api-access-qd25n\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.676254 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.676121    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gh4b\" (UniqueName: \"kubernetes.io/projected/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-kube-api-access-4gh4b\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:22.676254 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.676152    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:22.676254 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.676167    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.676360 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:22.676270    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
May 29 20:55:22.676360 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:22.676271    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 29 20:55:22.676360 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:22.676346    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert podName:c763b103-6e1d-4253-9c05-c4977a599cf1 nodeName:}" failed. No retries permitted until 2026-05-29 20:55:23.176323934 +0000 UTC m=+495.595177299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert") pod "llmisvc-controller-manager-c6b9847d7-wfrcr" (UID: "c763b103-6e1d-4253-9c05-c4977a599cf1") : secret "llmisvc-webhook-server-cert" not found
May 29 20:55:22.676458 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:55:22.676363    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert podName:ef69c5e0-e0ce-4e0f-8c80-1934f4783ede nodeName:}" failed. No retries permitted until 2026-05-29 20:55:23.176356875 +0000 UTC m=+495.595210239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert") pod "kserve-controller-manager-7c99ffcdcd-pssnr" (UID: "ef69c5e0-e0ce-4e0f-8c80-1934f4783ede") : secret "kserve-webhook-server-cert" not found
May 29 20:55:22.688814 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.688778    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd25n\" (UniqueName: \"kubernetes.io/projected/c763b103-6e1d-4253-9c05-c4977a599cf1-kube-api-access-qd25n\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:22.697844 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:22.697807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gh4b\" (UniqueName: \"kubernetes.io/projected/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-kube-api-access-4gh4b\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:23.181538 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.181501    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:23.181538 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.181540    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:23.184536 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.184516    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b103-6e1d-4253-9c05-c4977a599cf1-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wfrcr\" (UID: \"c763b103-6e1d-4253-9c05-c4977a599cf1\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:23.184604 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.184581    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef69c5e0-e0ce-4e0f-8c80-1934f4783ede-cert\") pod \"kserve-controller-manager-7c99ffcdcd-pssnr\" (UID: \"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:23.417053 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.417017    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:23.430835 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.430809    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:23.590525 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.590492    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"]
May 29 20:55:23.592410 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:23.592362    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef69c5e0_e0ce_4e0f_8c80_1934f4783ede.slice/crio-2a71100f94f8d0ad4108672992a62cc30eac6677414adbe0cffc3511c7c2cb70 WatchSource:0}: Error finding container 2a71100f94f8d0ad4108672992a62cc30eac6677414adbe0cffc3511c7c2cb70: Status 404 returned error can't find the container with id 2a71100f94f8d0ad4108672992a62cc30eac6677414adbe0cffc3511c7c2cb70
May 29 20:55:23.594413 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:23.594393    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"]
May 29 20:55:23.596642 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:23.596617    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc763b103_6e1d_4253_9c05_c4977a599cf1.slice/crio-414f01148301628fcf82f7b380d7901af1d1578b1cd789db2666de9a9c90aac5 WatchSource:0}: Error finding container 414f01148301628fcf82f7b380d7901af1d1578b1cd789db2666de9a9c90aac5: Status 404 returned error can't find the container with id 414f01148301628fcf82f7b380d7901af1d1578b1cd789db2666de9a9c90aac5
May 29 20:55:24.567382 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:24.567321    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr" event={"ID":"c763b103-6e1d-4253-9c05-c4977a599cf1","Type":"ContainerStarted","Data":"414f01148301628fcf82f7b380d7901af1d1578b1cd789db2666de9a9c90aac5"}
May 29 20:55:24.568456 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:24.568417    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr" event={"ID":"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede","Type":"ContainerStarted","Data":"2a71100f94f8d0ad4108672992a62cc30eac6677414adbe0cffc3511c7c2cb70"}
May 29 20:55:27.581110 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.581073    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr" event={"ID":"c763b103-6e1d-4253-9c05-c4977a599cf1","Type":"ContainerStarted","Data":"5798c4314453e776556882c2ffb9ec5106b5c8506b085e3de7081c57bf35f14b"}
May 29 20:55:27.581558 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.581216    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:27.582495 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.582468    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr" event={"ID":"ef69c5e0-e0ce-4e0f-8c80-1934f4783ede","Type":"ContainerStarted","Data":"012fb1fb781b01f8d60477e5eb1e52dd34177fb396e95f8e3a82d0f41d830e18"}
May 29 20:55:27.582619 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.582589    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:55:27.612344 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.612286    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr" podStartSLOduration=2.318496235 podStartE2EDuration="5.612271598s" podCreationTimestamp="2026-05-29 20:55:22 +0000 UTC" firstStartedPulling="2026-05-29 20:55:23.597918963 +0000 UTC m=+496.016772327" lastFinishedPulling="2026-05-29 20:55:26.891694314 +0000 UTC m=+499.310547690" observedRunningTime="2026-05-29 20:55:27.597323755 +0000 UTC m=+500.016177133" watchObservedRunningTime="2026-05-29 20:55:27.612271598 +0000 UTC m=+500.031125033"
May 29 20:55:27.612745 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:27.612569    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr" podStartSLOduration=2.319041009 podStartE2EDuration="5.612559831s" podCreationTimestamp="2026-05-29 20:55:22 +0000 UTC" firstStartedPulling="2026-05-29 20:55:23.594492205 +0000 UTC m=+496.013345583" lastFinishedPulling="2026-05-29 20:55:26.888011027 +0000 UTC m=+499.306864405" observedRunningTime="2026-05-29 20:55:27.612168647 +0000 UTC m=+500.031022032" watchObservedRunningTime="2026-05-29 20:55:27.612559831 +0000 UTC m=+500.031413216"
May 29 20:55:29.553948 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:29.553912    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-mj9l2"
May 29 20:55:29.555837 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:29.555815    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-cf7z7"
May 29 20:55:30.928776 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:30.928737    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"]
May 29 20:55:30.932160 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:30.932137    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:30.934384 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:30.934362    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
May 29 20:55:30.934503 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:30.934366    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9jb8w\""
May 29 20:55:30.938494 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:30.938471    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"]
May 29 20:55:31.051191 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.051147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7pt\" (UniqueName: \"kubernetes.io/projected/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-kube-api-access-qf7pt\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.051191 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.051192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-redirect-config\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.152602 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.152565    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-redirect-config\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.152803 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.152656    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7pt\" (UniqueName: \"kubernetes.io/projected/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-kube-api-access-qf7pt\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.153370 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.153341    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-redirect-config\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.160941 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.160914    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7pt\" (UniqueName: \"kubernetes.io/projected/22e97fcf-d9b6-4b06-bb72-467d02c66b4d-kube-api-access-qf7pt\") pod \"dashboard-redirect-6b77dbffcd-7r2gd\" (UID: \"22e97fcf-d9b6-4b06-bb72-467d02c66b4d\") " pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.243586 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.243489    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"
May 29 20:55:31.370132 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.370080    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b77dbffcd-7r2gd"]
May 29 20:55:31.372691 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:31.372652    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e97fcf_d9b6_4b06_bb72_467d02c66b4d.slice/crio-8115bb5148b0312786b0e6c563e08c654bb7a92c54a70d357143b89a7317b9e9 WatchSource:0}: Error finding container 8115bb5148b0312786b0e6c563e08c654bb7a92c54a70d357143b89a7317b9e9: Status 404 returned error can't find the container with id 8115bb5148b0312786b0e6c563e08c654bb7a92c54a70d357143b89a7317b9e9
May 29 20:55:31.598239 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:31.598201    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd" event={"ID":"22e97fcf-d9b6-4b06-bb72-467d02c66b4d","Type":"ContainerStarted","Data":"8115bb5148b0312786b0e6c563e08c654bb7a92c54a70d357143b89a7317b9e9"}
May 29 20:55:33.518085 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.518048    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:55:33.527099 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.526704    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.529513 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.529487    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 29 20:55:33.529812 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.529781    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 29 20:55:33.530004 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.529988    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rhlzr\""
May 29 20:55:33.531863 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.531835    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:55:33.573061 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.572971    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2j96\" (UniqueName: \"kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.573243 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.573100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.674048 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.674007    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.674239 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.674108    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2j96\" (UniqueName: \"kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.676902 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.676867    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.682386 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.682354    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2j96\" (UniqueName: \"kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96\") pod \"servicemesh-operator3-78d89fcb79-g9dbp\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") " pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:33.842486 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:33.842448    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:34.204286 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:34.204257    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba244c2_d184_46e9_b634_ea5520b0c1a3.slice/crio-4e081a315f126004024a57a7e494360b8b6411f633847c12f0e6f49b7c86e57d WatchSource:0}: Error finding container 4e081a315f126004024a57a7e494360b8b6411f633847c12f0e6f49b7c86e57d: Status 404 returned error can't find the container with id 4e081a315f126004024a57a7e494360b8b6411f633847c12f0e6f49b7c86e57d
May 29 20:55:34.204666 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:34.204645    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:55:34.608576 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:34.608537    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" event={"ID":"cba244c2-d184-46e9-b634-ea5520b0c1a3","Type":"ContainerStarted","Data":"4e081a315f126004024a57a7e494360b8b6411f633847c12f0e6f49b7c86e57d"}
May 29 20:55:34.609876 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:34.609852    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd" event={"ID":"22e97fcf-d9b6-4b06-bb72-467d02c66b4d","Type":"ContainerStarted","Data":"31896aecdf61b1db0ae4915382be752cc365fe42ef30a195a937e90642a7313d"}
May 29 20:55:34.625022 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:34.624972    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6b77dbffcd-7r2gd" podStartSLOduration=1.869253165 podStartE2EDuration="4.624956153s" podCreationTimestamp="2026-05-29 20:55:30 +0000 UTC" firstStartedPulling="2026-05-29 20:55:31.374100117 +0000 UTC m=+503.792953481" lastFinishedPulling="2026-05-29 20:55:34.1298031 +0000 UTC m=+506.548656469" observedRunningTime="2026-05-29 20:55:34.62337773 +0000 UTC m=+507.042231115" watchObservedRunningTime="2026-05-29 20:55:34.624956153 +0000 UTC m=+507.043809589"
May 29 20:55:37.621403 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:37.621365    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" event={"ID":"cba244c2-d184-46e9-b634-ea5520b0c1a3","Type":"ContainerStarted","Data":"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"}
May 29 20:55:37.621820 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:37.621500    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:37.642097 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:37.642040    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" podStartSLOduration=1.8699347469999998 podStartE2EDuration="4.642020081s" podCreationTimestamp="2026-05-29 20:55:33 +0000 UTC" firstStartedPulling="2026-05-29 20:55:34.206655849 +0000 UTC m=+506.625509213" lastFinishedPulling="2026-05-29 20:55:36.97874118 +0000 UTC m=+509.397594547" observedRunningTime="2026-05-29 20:55:37.639871581 +0000 UTC m=+510.058724966" watchObservedRunningTime="2026-05-29 20:55:37.642020081 +0000 UTC m=+510.060873475"
May 29 20:55:47.455648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.455616    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"]
May 29 20:55:47.459139 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.459122    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.461660 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.461633    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 29 20:55:47.461660 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.461652    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6k74p\""
May 29 20:55:47.461857 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.461637    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 29 20:55:47.461857 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.461638    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 29 20:55:47.461857 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.461636    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 29 20:55:47.468490 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.468463    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"]
May 29 20:55:47.596343 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596343 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a07f41b-6bc3-4ea4-915f-b7428281a46e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.596597 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.596530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq5cc\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-kube-api-access-cq5cc\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697318 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697278    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697513 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697329    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697513 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697441    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a07f41b-6bc3-4ea4-915f-b7428281a46e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697513 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697496    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cq5cc\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-kube-api-access-cq5cc\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697665 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697538    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697665 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697555    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697665 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697575    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.697980 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.697957    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.700154 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.700129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.700259 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.700134    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.700355 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.700339    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a07f41b-6bc3-4ea4-915f-b7428281a46e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.700507 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.700488    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8a07f41b-6bc3-4ea4-915f-b7428281a46e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.705267 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.705246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.705552 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.705535    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq5cc\" (UniqueName: \"kubernetes.io/projected/8a07f41b-6bc3-4ea4-915f-b7428281a46e-kube-api-access-cq5cc\") pod \"istiod-openshift-gateway-798958bb55-flngp\" (UID: \"8a07f41b-6bc3-4ea4-915f-b7428281a46e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.769387 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.769284    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:47.909368 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:47.909341    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"]
May 29 20:55:47.911988 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:47.911961    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a07f41b_6bc3_4ea4_915f_b7428281a46e.slice/crio-b07dfe2e922a464ec3dd4a72d5dba28c56f4f6dec1b419ba9a267adee93a7789 WatchSource:0}: Error finding container b07dfe2e922a464ec3dd4a72d5dba28c56f4f6dec1b419ba9a267adee93a7789: Status 404 returned error can't find the container with id b07dfe2e922a464ec3dd4a72d5dba28c56f4f6dec1b419ba9a267adee93a7789
May 29 20:55:48.627532 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:48.627496    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:55:48.665881 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:48.665840    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp" event={"ID":"8a07f41b-6bc3-4ea4-915f-b7428281a46e","Type":"ContainerStarted","Data":"b07dfe2e922a464ec3dd4a72d5dba28c56f4f6dec1b419ba9a267adee93a7789"}
May 29 20:55:48.849071 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:48.849031    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"]
May 29 20:55:48.852704 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:48.852656    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:48.863174 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:48.863149    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"]
May 29 20:55:49.014541 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.014447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7d34e839-ca61-4cb4-9f26-249077071aed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.014712 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.014560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz5vp\" (UniqueName: \"kubernetes.io/projected/7d34e839-ca61-4cb4-9f26-249077071aed-kube-api-access-tz5vp\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.116045 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.115992    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tz5vp\" (UniqueName: \"kubernetes.io/projected/7d34e839-ca61-4cb4-9f26-249077071aed-kube-api-access-tz5vp\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.116232 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.116078    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7d34e839-ca61-4cb4-9f26-249077071aed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.119268 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.119234    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7d34e839-ca61-4cb4-9f26-249077071aed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.125824 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.125798    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz5vp\" (UniqueName: \"kubernetes.io/projected/7d34e839-ca61-4cb4-9f26-249077071aed-kube-api-access-tz5vp\") pod \"servicemesh-operator3-55f49c5f94-xgm7x\" (UID: \"7d34e839-ca61-4cb4-9f26-249077071aed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.164802 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.164767    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.322643 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.322610    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"]
May 29 20:55:49.326146 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:55:49.326108    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d34e839_ca61_4cb4_9f26_249077071aed.slice/crio-400ca3832df26dad8253fd4d8cc571a2a8d5bf1387a10ba1ea598ff08b591cf3 WatchSource:0}: Error finding container 400ca3832df26dad8253fd4d8cc571a2a8d5bf1387a10ba1ea598ff08b591cf3: Status 404 returned error can't find the container with id 400ca3832df26dad8253fd4d8cc571a2a8d5bf1387a10ba1ea598ff08b591cf3
May 29 20:55:49.671506 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.671404    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x" event={"ID":"7d34e839-ca61-4cb4-9f26-249077071aed","Type":"ContainerStarted","Data":"72ba47bd3971ced228d094c40f919d29505926a1a6cab3eb7d1c428070c8f30d"}
May 29 20:55:49.671506 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.671455    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x" event={"ID":"7d34e839-ca61-4cb4-9f26-249077071aed","Type":"ContainerStarted","Data":"400ca3832df26dad8253fd4d8cc571a2a8d5bf1387a10ba1ea598ff08b591cf3"}
May 29 20:55:49.671506 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.671507    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:55:49.692187 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:49.692050    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x" podStartSLOduration=1.69202922 podStartE2EDuration="1.69202922s" podCreationTimestamp="2026-05-29 20:55:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 20:55:49.690444354 +0000 UTC m=+522.109297741" watchObservedRunningTime="2026-05-29 20:55:49.69202922 +0000 UTC m=+522.110882607"
May 29 20:55:51.343333 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:51.343296    2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 29 20:55:51.343621 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:51.343367    2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 29 20:55:51.679044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:51.678949    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp" event={"ID":"8a07f41b-6bc3-4ea4-915f-b7428281a46e","Type":"ContainerStarted","Data":"d92ed17340e41f8bb0c8752789af53a375f7e18c8e0838f490be0f091a5e2b5e"}
May 29 20:55:51.679044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:51.679003    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:51.699188 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:51.699118    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp" podStartSLOduration=1.269963433 podStartE2EDuration="4.699098547s" podCreationTimestamp="2026-05-29 20:55:47 +0000 UTC" firstStartedPulling="2026-05-29 20:55:47.913899852 +0000 UTC m=+520.332753216" lastFinishedPulling="2026-05-29 20:55:51.343034967 +0000 UTC m=+523.761888330" observedRunningTime="2026-05-29 20:55:51.695925008 +0000 UTC m=+524.114778411" watchObservedRunningTime="2026-05-29 20:55:51.699098547 +0000 UTC m=+524.117951935"
May 29 20:55:52.683783 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:52.683753    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-flngp"
May 29 20:55:58.592814 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:58.592777    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wfrcr"
May 29 20:55:58.595936 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:55:58.595917    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-pssnr"
May 29 20:56:00.676494 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:00.676463    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xgm7x"
May 29 20:56:00.726507 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:00.726467    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:56:00.726841 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:00.726782    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" podUID="cba244c2-d184-46e9-b634-ea5520b0c1a3" containerName="sail-operator" containerID="cri-o://c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39" gracePeriod=10
May 29 20:56:00.973946 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:00.973922    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:56:01.018824 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.018779    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2j96\" (UniqueName: \"kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96\") pod \"cba244c2-d184-46e9-b634-ea5520b0c1a3\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") "
May 29 20:56:01.019000 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.018856    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config\") pod \"cba244c2-d184-46e9-b634-ea5520b0c1a3\" (UID: \"cba244c2-d184-46e9-b634-ea5520b0c1a3\") "
May 29 20:56:01.021233 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.021188    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config" (OuterVolumeSpecName: "operator-config") pod "cba244c2-d184-46e9-b634-ea5520b0c1a3" (UID: "cba244c2-d184-46e9-b634-ea5520b0c1a3"). InnerVolumeSpecName "operator-config". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
May 29 20:56:01.021233 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.021204    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96" (OuterVolumeSpecName: "kube-api-access-f2j96") pod "cba244c2-d184-46e9-b634-ea5520b0c1a3" (UID: "cba244c2-d184-46e9-b634-ea5520b0c1a3"). InnerVolumeSpecName "kube-api-access-f2j96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 20:56:01.119549 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.119510    2582 reconciler_common.go:299] "Volume detached for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cba244c2-d184-46e9-b634-ea5520b0c1a3-operator-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
May 29 20:56:01.119549 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.119542    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2j96\" (UniqueName: \"kubernetes.io/projected/cba244c2-d184-46e9-b634-ea5520b0c1a3-kube-api-access-f2j96\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
May 29 20:56:01.713418 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.713375    2582 generic.go:358] "Generic (PLEG): container finished" podID="cba244c2-d184-46e9-b634-ea5520b0c1a3" containerID="c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39" exitCode=0
May 29 20:56:01.713867 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.713444    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"
May 29 20:56:01.713867 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.713456    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" event={"ID":"cba244c2-d184-46e9-b634-ea5520b0c1a3","Type":"ContainerDied","Data":"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"}
May 29 20:56:01.713867 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.713500    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp" event={"ID":"cba244c2-d184-46e9-b634-ea5520b0c1a3","Type":"ContainerDied","Data":"4e081a315f126004024a57a7e494360b8b6411f633847c12f0e6f49b7c86e57d"}
May 29 20:56:01.713867 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.713520    2582 scope.go:117] "RemoveContainer" containerID="c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"
May 29 20:56:01.723786 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.723762    2582 scope.go:117] "RemoveContainer" containerID="c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"
May 29 20:56:01.724097 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:56:01.724073    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39\": container with ID starting with c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39 not found: ID does not exist" containerID="c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"
May 29 20:56:01.724152 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.724110    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39"} err="failed to get container status \"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39\": rpc error: code = NotFound desc = could not find container \"c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39\": container with ID starting with c61cf791f78c1716cf995df6c4355f92505a6af53158637f7b4a0c267d204b39 not found: ID does not exist"
May 29 20:56:01.736927 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.736889    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:56:01.746572 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:01.746539    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operators/servicemesh-operator3-78d89fcb79-g9dbp"]
May 29 20:56:02.203545 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:02.203505    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba244c2-d184-46e9-b634-ea5520b0c1a3" path="/var/lib/kubelet/pods/cba244c2-d184-46e9-b634-ea5520b0c1a3/volumes"
May 29 20:56:55.472582 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.472545    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jk5kx"]
May 29 20:56:55.473082 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.472877    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba244c2-d184-46e9-b634-ea5520b0c1a3" containerName="sail-operator"
May 29 20:56:55.473082 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.472889    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba244c2-d184-46e9-b634-ea5520b0c1a3" containerName="sail-operator"
May 29 20:56:55.473082 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.472942    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="cba244c2-d184-46e9-b634-ea5520b0c1a3" containerName="sail-operator"
May 29 20:56:55.475014 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.474998    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:55.477653 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.477632    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 20:56:55.478567 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.478550    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qjnlh\""
May 29 20:56:55.478615 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.478559    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 20:56:55.486991 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.486966    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jk5kx"]
May 29 20:56:55.556403 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.556363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sjhl\" (UniqueName: \"kubernetes.io/projected/9fd3ac95-6934-44de-a10a-f98787fef2ff-kube-api-access-4sjhl\") pod \"authorino-operator-657f44b778-jk5kx\" (UID: \"9fd3ac95-6934-44de-a10a-f98787fef2ff\") " pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:55.656917 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.656872    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sjhl\" (UniqueName: \"kubernetes.io/projected/9fd3ac95-6934-44de-a10a-f98787fef2ff-kube-api-access-4sjhl\") pod \"authorino-operator-657f44b778-jk5kx\" (UID: \"9fd3ac95-6934-44de-a10a-f98787fef2ff\") " pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:55.665540 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.665514    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sjhl\" (UniqueName: \"kubernetes.io/projected/9fd3ac95-6934-44de-a10a-f98787fef2ff-kube-api-access-4sjhl\") pod \"authorino-operator-657f44b778-jk5kx\" (UID: \"9fd3ac95-6934-44de-a10a-f98787fef2ff\") " pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:55.784921 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.784826    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:55.915853 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:55.915825    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jk5kx"]
May 29 20:56:55.918571 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:56:55.918541    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd3ac95_6934_44de_a10a_f98787fef2ff.slice/crio-290fc08ab9a6ecf6eec1bb33a79cbaa647a1c664b622fff35623efdba6808579 WatchSource:0}: Error finding container 290fc08ab9a6ecf6eec1bb33a79cbaa647a1c664b622fff35623efdba6808579: Status 404 returned error can't find the container with id 290fc08ab9a6ecf6eec1bb33a79cbaa647a1c664b622fff35623efdba6808579
May 29 20:56:56.895846 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:56.895782    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx" event={"ID":"9fd3ac95-6934-44de-a10a-f98787fef2ff","Type":"ContainerStarted","Data":"290fc08ab9a6ecf6eec1bb33a79cbaa647a1c664b622fff35623efdba6808579"}
May 29 20:56:58.904372 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:58.904332    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx" event={"ID":"9fd3ac95-6934-44de-a10a-f98787fef2ff","Type":"ContainerStarted","Data":"60e903946c4573b41c98430667247885b44e4a2efdabdaf0d7a115ef370d2b1d"}
May 29 20:56:58.904790 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:58.904394    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:56:58.920667 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:56:58.920608    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx" podStartSLOduration=1.775868086 podStartE2EDuration="3.920587562s" podCreationTimestamp="2026-05-29 20:56:55 +0000 UTC" firstStartedPulling="2026-05-29 20:56:55.92058487 +0000 UTC m=+588.339438234" lastFinishedPulling="2026-05-29 20:56:58.065304346 +0000 UTC m=+590.484157710" observedRunningTime="2026-05-29 20:56:58.919959671 +0000 UTC m=+591.338813057" watchObservedRunningTime="2026-05-29 20:56:58.920587562 +0000 UTC m=+591.339440950"
May 29 20:57:08.101658 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:08.101627    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:57:08.102153 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:08.102134    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 20:57:09.909622 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:09.909585    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-jk5kx"
May 29 20:57:38.911532 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.911493    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 20:57:38.913855 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.913835    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:38.916374 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.916347    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s9vfb\""
May 29 20:57:38.916721 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.916701    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 29 20:57:38.925162 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.925139    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 20:57:38.956947 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:38.956910    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 20:57:39.021220 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.021176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e97c6e85-5e18-485d-97ba-5e3793486cca-config-file\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.021442 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.021292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjz28\" (UniqueName: \"kubernetes.io/projected/e97c6e85-5e18-485d-97ba-5e3793486cca-kube-api-access-cjz28\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.122615 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.122576    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e97c6e85-5e18-485d-97ba-5e3793486cca-config-file\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.122795 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.122621    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjz28\" (UniqueName: \"kubernetes.io/projected/e97c6e85-5e18-485d-97ba-5e3793486cca-kube-api-access-cjz28\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.123218 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.123196    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e97c6e85-5e18-485d-97ba-5e3793486cca-config-file\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.131829 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.131795    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjz28\" (UniqueName: \"kubernetes.io/projected/e97c6e85-5e18-485d-97ba-5e3793486cca-kube-api-access-cjz28\") pod \"limitador-limitador-78c99df468-w9g9l\" (UID: \"e97c6e85-5e18-485d-97ba-5e3793486cca\") " pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.223529 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.223447    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:39.358166 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:39.358131    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 20:57:39.361604 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:57:39.361577    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97c6e85_5e18_485d_97ba_5e3793486cca.slice/crio-e4cfd597a11b5311992ff0340092b16193d128d77a914a1038a0d27b3f266835 WatchSource:0}: Error finding container e4cfd597a11b5311992ff0340092b16193d128d77a914a1038a0d27b3f266835: Status 404 returned error can't find the container with id e4cfd597a11b5311992ff0340092b16193d128d77a914a1038a0d27b3f266835
May 29 20:57:40.039118 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:40.039077    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l" event={"ID":"e97c6e85-5e18-485d-97ba-5e3793486cca","Type":"ContainerStarted","Data":"e4cfd597a11b5311992ff0340092b16193d128d77a914a1038a0d27b3f266835"}
May 29 20:57:42.050289 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:42.050257    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l" event={"ID":"e97c6e85-5e18-485d-97ba-5e3793486cca","Type":"ContainerStarted","Data":"9cb693d1d0feac6e6b75fff88aedc129cae5cabe01f2405c6dd9635ec495f60f"}
May 29 20:57:42.050701 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:42.050397    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:57:42.066997 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:42.066933    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l" podStartSLOduration=1.6950922419999999 podStartE2EDuration="4.066914517s" podCreationTimestamp="2026-05-29 20:57:38 +0000 UTC" firstStartedPulling="2026-05-29 20:57:39.364472401 +0000 UTC m=+631.783325779" lastFinishedPulling="2026-05-29 20:57:41.736294687 +0000 UTC m=+634.155148054" observedRunningTime="2026-05-29 20:57:42.065209531 +0000 UTC m=+634.484062930" watchObservedRunningTime="2026-05-29 20:57:42.066914517 +0000 UTC m=+634.485767907"
May 29 20:57:53.054970 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:57:53.054936    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-w9g9l"
May 29 20:59:02.019557 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.019465    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:02.022899 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.022878    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:02.025378 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.025357    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nnnjn\""
May 29 20:59:02.025488 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.025357    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 29 20:59:02.030510 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.030367    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:02.102866 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.102816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbb49\" (UniqueName: \"kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49\") pod \"maas-controller-6fd5b6d767-4jbmt\" (UID: \"ef6d5e68-9b6b-4095-860c-1888739b26a9\") " pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:02.181947 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.181912    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7767dd86bd-c4gm9"]
May 29 20:59:02.185648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.185626    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:02.194244 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.194215    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767dd86bd-c4gm9"]
May 29 20:59:02.203366 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.203323    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbb49\" (UniqueName: \"kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49\") pod \"maas-controller-6fd5b6d767-4jbmt\" (UID: \"ef6d5e68-9b6b-4095-860c-1888739b26a9\") " pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:02.203544 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.203416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62px4\" (UniqueName: \"kubernetes.io/projected/1963ee89-cfb8-40b2-b1b6-5cc2d4adb987-kube-api-access-62px4\") pod \"maas-controller-7767dd86bd-c4gm9\" (UID: \"1963ee89-cfb8-40b2-b1b6-5cc2d4adb987\") " pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:02.210884 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.210850    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbb49\" (UniqueName: \"kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49\") pod \"maas-controller-6fd5b6d767-4jbmt\" (UID: \"ef6d5e68-9b6b-4095-860c-1888739b26a9\") " pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:02.304041 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.304003    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62px4\" (UniqueName: \"kubernetes.io/projected/1963ee89-cfb8-40b2-b1b6-5cc2d4adb987-kube-api-access-62px4\") pod \"maas-controller-7767dd86bd-c4gm9\" (UID: \"1963ee89-cfb8-40b2-b1b6-5cc2d4adb987\") " pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:02.312115 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.312089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62px4\" (UniqueName: \"kubernetes.io/projected/1963ee89-cfb8-40b2-b1b6-5cc2d4adb987-kube-api-access-62px4\") pod \"maas-controller-7767dd86bd-c4gm9\" (UID: \"1963ee89-cfb8-40b2-b1b6-5cc2d4adb987\") " pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:02.334974 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.334928    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:02.468083 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.468055    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:02.470427 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:59:02.470397    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6d5e68_9b6b_4095_860c_1888739b26a9.slice/crio-1d10e2e7b9d4103e37c8a13e8f9e4d3316e57141a594ed17879dc732e79cfa6f WatchSource:0}: Error finding container 1d10e2e7b9d4103e37c8a13e8f9e4d3316e57141a594ed17879dc732e79cfa6f: Status 404 returned error can't find the container with id 1d10e2e7b9d4103e37c8a13e8f9e4d3316e57141a594ed17879dc732e79cfa6f
May 29 20:59:02.496402 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.496364    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:02.630185 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:02.630156    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767dd86bd-c4gm9"]
May 29 20:59:02.632445 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:59:02.632413    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1963ee89_cfb8_40b2_b1b6_5cc2d4adb987.slice/crio-72697f1e9f6d6ee139f09cf22c3aeb5a0d8c73e210c44c6f6c81074a19293f3d WatchSource:0}: Error finding container 72697f1e9f6d6ee139f09cf22c3aeb5a0d8c73e210c44c6f6c81074a19293f3d: Status 404 returned error can't find the container with id 72697f1e9f6d6ee139f09cf22c3aeb5a0d8c73e210c44c6f6c81074a19293f3d
May 29 20:59:03.329332 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:03.329266    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767dd86bd-c4gm9" event={"ID":"1963ee89-cfb8-40b2-b1b6-5cc2d4adb987","Type":"ContainerStarted","Data":"72697f1e9f6d6ee139f09cf22c3aeb5a0d8c73e210c44c6f6c81074a19293f3d"}
May 29 20:59:03.331329 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:03.331290    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" event={"ID":"ef6d5e68-9b6b-4095-860c-1888739b26a9","Type":"ContainerStarted","Data":"1d10e2e7b9d4103e37c8a13e8f9e4d3316e57141a594ed17879dc732e79cfa6f"}
May 29 20:59:05.340479 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.340441    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767dd86bd-c4gm9" event={"ID":"1963ee89-cfb8-40b2-b1b6-5cc2d4adb987","Type":"ContainerStarted","Data":"2beb7287ff0daafcd9a0a6b1a1b41ae3e84bad9718087f7a4bef557ec18b3049"}
May 29 20:59:05.340923 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.340565    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:05.341977 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.341951    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" event={"ID":"ef6d5e68-9b6b-4095-860c-1888739b26a9","Type":"ContainerStarted","Data":"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"}
May 29 20:59:05.342121 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.342104    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:05.361430 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.361369    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7767dd86bd-c4gm9" podStartSLOduration=0.807799987 podStartE2EDuration="3.361355079s" podCreationTimestamp="2026-05-29 20:59:02 +0000 UTC" firstStartedPulling="2026-05-29 20:59:02.633719753 +0000 UTC m=+715.052573119" lastFinishedPulling="2026-05-29 20:59:05.187274829 +0000 UTC m=+717.606128211" observedRunningTime="2026-05-29 20:59:05.359955542 +0000 UTC m=+717.778809011" watchObservedRunningTime="2026-05-29 20:59:05.361355079 +0000 UTC m=+717.780208488"
May 29 20:59:05.387612 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:05.387555    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" podStartSLOduration=0.661625527 podStartE2EDuration="3.387538617s" podCreationTimestamp="2026-05-29 20:59:02 +0000 UTC" firstStartedPulling="2026-05-29 20:59:02.471661466 +0000 UTC m=+714.890514831" lastFinishedPulling="2026-05-29 20:59:05.197574557 +0000 UTC m=+717.616427921" observedRunningTime="2026-05-29 20:59:05.386010012 +0000 UTC m=+717.804863397" watchObservedRunningTime="2026-05-29 20:59:05.387538617 +0000 UTC m=+717.806392042"
May 29 20:59:16.350648 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.350617    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7767dd86bd-c4gm9"
May 29 20:59:16.351125 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.351065    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:16.392315 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.392281    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:16.392587 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.392562    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" podUID="ef6d5e68-9b6b-4095-860c-1888739b26a9" containerName="manager" containerID="cri-o://8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34" gracePeriod=30
May 29 20:59:16.643405 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.643378    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:16.719045 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.719001    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbb49\" (UniqueName: \"kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49\") pod \"ef6d5e68-9b6b-4095-860c-1888739b26a9\" (UID: \"ef6d5e68-9b6b-4095-860c-1888739b26a9\") "
May 29 20:59:16.721381 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.721350    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49" (OuterVolumeSpecName: "kube-api-access-xbb49") pod "ef6d5e68-9b6b-4095-860c-1888739b26a9" (UID: "ef6d5e68-9b6b-4095-860c-1888739b26a9"). InnerVolumeSpecName "kube-api-access-xbb49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 20:59:16.820044 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:16.820004    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbb49\" (UniqueName: \"kubernetes.io/projected/ef6d5e68-9b6b-4095-860c-1888739b26a9-kube-api-access-xbb49\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
May 29 20:59:17.382585 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.382552    2582 generic.go:358] "Generic (PLEG): container finished" podID="ef6d5e68-9b6b-4095-860c-1888739b26a9" containerID="8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34" exitCode=0
May 29 20:59:17.383094 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.382612    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt"
May 29 20:59:17.383094 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.382644    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" event={"ID":"ef6d5e68-9b6b-4095-860c-1888739b26a9","Type":"ContainerDied","Data":"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"}
May 29 20:59:17.383094 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.382717    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fd5b6d767-4jbmt" event={"ID":"ef6d5e68-9b6b-4095-860c-1888739b26a9","Type":"ContainerDied","Data":"1d10e2e7b9d4103e37c8a13e8f9e4d3316e57141a594ed17879dc732e79cfa6f"}
May 29 20:59:17.383094 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.382739    2582 scope.go:117] "RemoveContainer" containerID="8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"
May 29 20:59:17.390753 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.390735    2582 scope.go:117] "RemoveContainer" containerID="8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"
May 29 20:59:17.390978 ip-10-0-137-57 kubenswrapper[2582]: E0529 20:59:17.390962    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34\": container with ID starting with 8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34 not found: ID does not exist" containerID="8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"
May 29 20:59:17.391021 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.390988    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34"} err="failed to get container status \"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34\": rpc error: code = NotFound desc = could not find container \"8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34\": container with ID starting with 8cc20cfcde84f9b28af705b537ce3c236de9df20e119e920c10fa20cb0413b34 not found: ID does not exist"
May 29 20:59:17.402342 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.402317    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:17.406498 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:17.406472    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fd5b6d767-4jbmt"]
May 29 20:59:18.204622 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:18.204588    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6d5e68-9b6b-4095-860c-1888739b26a9" path="/var/lib/kubelet/pods/ef6d5e68-9b6b-4095-860c-1888739b26a9/volumes"
May 29 20:59:37.003650 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.003607    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"]
May 29 20:59:37.004177 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.004157    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6d5e68-9b6b-4095-860c-1888739b26a9" containerName="manager"
May 29 20:59:37.004263 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.004186    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6d5e68-9b6b-4095-860c-1888739b26a9" containerName="manager"
May 29 20:59:37.004314 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.004273    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef6d5e68-9b6b-4095-860c-1888739b26a9" containerName="manager"
May 29 20:59:37.007430 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.007407    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:37.009915 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.009894    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 29 20:59:37.010036 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.010021    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kwvvg\""
May 29 20:59:37.018848 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.018824    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"]
May 29 20:59:37.087104 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.087063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scg98\" (UniqueName: \"kubernetes.io/projected/a84b6d8d-c47e-4129-896a-38c0e76315bb-kube-api-access-scg98\") pod \"payload-processing-58b6c8fdc7-7d9sv\" (UID: \"a84b6d8d-c47e-4129-896a-38c0e76315bb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:37.187855 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.187801    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scg98\" (UniqueName: \"kubernetes.io/projected/a84b6d8d-c47e-4129-896a-38c0e76315bb-kube-api-access-scg98\") pod \"payload-processing-58b6c8fdc7-7d9sv\" (UID: \"a84b6d8d-c47e-4129-896a-38c0e76315bb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:37.189776 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.189749    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 20:59:37.202130 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.202109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scg98\" (UniqueName: \"kubernetes.io/projected/a84b6d8d-c47e-4129-896a-38c0e76315bb-kube-api-access-scg98\") pod \"payload-processing-58b6c8fdc7-7d9sv\" (UID: \"a84b6d8d-c47e-4129-896a-38c0e76315bb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:37.318652 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.318619    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:37.453989 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:37.453958    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"]
May 29 20:59:37.458592 ip-10-0-137-57 kubenswrapper[2582]: W0529 20:59:37.458566    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84b6d8d_c47e_4129_896a_38c0e76315bb.slice/crio-99d44bea3042afdbae9741470ef89cafc5ae189aa2b2da9bced15ecc1794daaf WatchSource:0}: Error finding container 99d44bea3042afdbae9741470ef89cafc5ae189aa2b2da9bced15ecc1794daaf: Status 404 returned error can't find the container with id 99d44bea3042afdbae9741470ef89cafc5ae189aa2b2da9bced15ecc1794daaf
May 29 20:59:38.453643 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:38.453600    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv" event={"ID":"a84b6d8d-c47e-4129-896a-38c0e76315bb","Type":"ContainerStarted","Data":"99d44bea3042afdbae9741470ef89cafc5ae189aa2b2da9bced15ecc1794daaf"}
May 29 20:59:39.459114 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:39.459069    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv" event={"ID":"a84b6d8d-c47e-4129-896a-38c0e76315bb","Type":"ContainerStarted","Data":"7dab2edf06b6c3b6712b0fa31be2d6ce9fc67a6a785b47a6a4722f992d3f61a3"}
May 29 20:59:39.459523 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:39.459238    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 20:59:39.477414 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:39.477360    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv" podStartSLOduration=2.110382058 podStartE2EDuration="3.477345633s" podCreationTimestamp="2026-05-29 20:59:36 +0000 UTC" firstStartedPulling="2026-05-29 20:59:37.460389822 +0000 UTC m=+749.879243186" lastFinishedPulling="2026-05-29 20:59:38.827353396 +0000 UTC m=+751.246206761" observedRunningTime="2026-05-29 20:59:39.47521579 +0000 UTC m=+751.894069176" watchObservedRunningTime="2026-05-29 20:59:39.477345633 +0000 UTC m=+751.896199019"
May 29 20:59:50.464502 ip-10-0-137-57 kubenswrapper[2582]: I0529 20:59:50.464467    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7d9sv"
May 29 21:00:00.140375 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.140342    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29668140-x9rxf"]
May 29 21:00:00.142567 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.142550    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:00.144994 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.144972    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7g5gp\""
May 29 21:00:00.151240 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.151210    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29668140-x9rxf"]
May 29 21:00:00.185542 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.185502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56bh\" (UniqueName: \"kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh\") pod \"maas-api-key-cleanup-29668140-x9rxf\" (UID: \"73b53871-893a-47ff-9477-56ef85a3b7f9\") " pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:00.286856 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.286809    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f56bh\" (UniqueName: \"kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh\") pod \"maas-api-key-cleanup-29668140-x9rxf\" (UID: \"73b53871-893a-47ff-9477-56ef85a3b7f9\") " pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:00.296344 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.296316    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56bh\" (UniqueName: \"kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh\") pod \"maas-api-key-cleanup-29668140-x9rxf\" (UID: \"73b53871-893a-47ff-9477-56ef85a3b7f9\") " pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:00.453762 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.453644    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:00.585038 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.585009    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29668140-x9rxf"]
May 29 21:00:00.587307 ip-10-0-137-57 kubenswrapper[2582]: W0529 21:00:00.587274    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b53871_893a_47ff_9477_56ef85a3b7f9.slice/crio-19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d WatchSource:0}: Error finding container 19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d: Status 404 returned error can't find the container with id 19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d
May 29 21:00:00.589166 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:00.589141    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 21:00:01.533722 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:01.533686    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf" event={"ID":"73b53871-893a-47ff-9477-56ef85a3b7f9","Type":"ContainerStarted","Data":"19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d"}
May 29 21:00:04.547198 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:04.547156    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf" event={"ID":"73b53871-893a-47ff-9477-56ef85a3b7f9","Type":"ContainerStarted","Data":"a2665c3966a7e1772f546f1d7443bb63cdb816bb923ffcf8e0f004b0dd47443c"}
May 29 21:00:04.563794 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:04.563734    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf" podStartSLOduration=1.098196715 podStartE2EDuration="4.563716183s" podCreationTimestamp="2026-05-29 21:00:00 +0000 UTC" firstStartedPulling="2026-05-29 21:00:00.589341619 +0000 UTC m=+773.008194985" lastFinishedPulling="2026-05-29 21:00:04.054861073 +0000 UTC m=+776.473714453" observedRunningTime="2026-05-29 21:00:04.562055102 +0000 UTC m=+776.980908479" watchObservedRunningTime="2026-05-29 21:00:04.563716183 +0000 UTC m=+776.982569569"
May 29 21:00:05.552568 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:05.552530    2582 generic.go:358] "Generic (PLEG): container finished" podID="73b53871-893a-47ff-9477-56ef85a3b7f9" containerID="a2665c3966a7e1772f546f1d7443bb63cdb816bb923ffcf8e0f004b0dd47443c" exitCode=0
May 29 21:00:05.553008 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:05.552603    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf" event={"ID":"73b53871-893a-47ff-9477-56ef85a3b7f9","Type":"ContainerDied","Data":"a2665c3966a7e1772f546f1d7443bb63cdb816bb923ffcf8e0f004b0dd47443c"}
May 29 21:00:06.685756 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:06.685731    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:06.736396 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:06.736362    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f56bh\" (UniqueName: \"kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh\") pod \"73b53871-893a-47ff-9477-56ef85a3b7f9\" (UID: \"73b53871-893a-47ff-9477-56ef85a3b7f9\") "
May 29 21:00:06.738554 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:06.738517    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh" (OuterVolumeSpecName: "kube-api-access-f56bh") pod "73b53871-893a-47ff-9477-56ef85a3b7f9" (UID: "73b53871-893a-47ff-9477-56ef85a3b7f9"). InnerVolumeSpecName "kube-api-access-f56bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 21:00:06.837441 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:06.837353    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f56bh\" (UniqueName: \"kubernetes.io/projected/73b53871-893a-47ff-9477-56ef85a3b7f9-kube-api-access-f56bh\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
May 29 21:00:07.560391 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:07.560354    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf"
May 29 21:00:07.560567 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:07.560350    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29668140-x9rxf" event={"ID":"73b53871-893a-47ff-9477-56ef85a3b7f9","Type":"ContainerDied","Data":"19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d"}
May 29 21:00:07.560567 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:07.560462    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19f2a37d48c9856e1c35ae0e9fc1a96b6856274e74d565588ba80d5a3e9d7d6d"
May 29 21:00:38.204192 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:38.204119    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:00:50.505038 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.505003    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"]
May 29 21:00:50.505433 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.505346    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b53871-893a-47ff-9477-56ef85a3b7f9" containerName="cleanup"
May 29 21:00:50.505433 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.505357    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b53871-893a-47ff-9477-56ef85a3b7f9" containerName="cleanup"
May 29 21:00:50.505433 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.505412    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="73b53871-893a-47ff-9477-56ef85a3b7f9" containerName="cleanup"
May 29 21:00:50.507540 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.507519    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.511900 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.511873    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-trsqn\""
May 29 21:00:50.512055 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.511903    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 29 21:00:50.512055 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.511873    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 29 21:00:50.512055 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.511950    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 29 21:00:50.529011 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.528985    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"]
May 29 21:00:50.608665 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctc8f\" (UniqueName: \"kubernetes.io/projected/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kube-api-access-ctc8f\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.608862 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.608862 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.608862 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.608862 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.609057 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.608922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.709873 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.709836    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710043 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.709893    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctc8f\" (UniqueName: \"kubernetes.io/projected/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kube-api-access-ctc8f\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710043 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.709922    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710043 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.709945    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710043 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.709961    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710276 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.710251    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710365 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.710303    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710424 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.710378    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.710478 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.710449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.712542 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.712520    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.712615 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.712598    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.720899 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.720874    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctc8f\" (UniqueName: \"kubernetes.io/projected/1ec65a5c-9f6a-4912-982c-ae17fc825ff7-kube-api-access-ctc8f\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5\" (UID: \"1ec65a5c-9f6a-4912-982c-ae17fc825ff7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.819842 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.819796    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:00:50.960509 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:50.960486    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"]
May 29 21:00:50.965386 ip-10-0-137-57 kubenswrapper[2582]: W0529 21:00:50.965350    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec65a5c_9f6a_4912_982c_ae17fc825ff7.slice/crio-4f668bfa3e954008f846ee6e2b46f274a9e857f5ec8f02811c1931c68e5d2c82 WatchSource:0}: Error finding container 4f668bfa3e954008f846ee6e2b46f274a9e857f5ec8f02811c1931c68e5d2c82: Status 404 returned error can't find the container with id 4f668bfa3e954008f846ee6e2b46f274a9e857f5ec8f02811c1931c68e5d2c82
May 29 21:00:51.087890 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:51.087799    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:00:51.710827 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:51.710791    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5" event={"ID":"1ec65a5c-9f6a-4912-982c-ae17fc825ff7","Type":"ContainerStarted","Data":"4f668bfa3e954008f846ee6e2b46f274a9e857f5ec8f02811c1931c68e5d2c82"}
May 29 21:00:55.727549 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:55.727511    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5" event={"ID":"1ec65a5c-9f6a-4912-982c-ae17fc825ff7","Type":"ContainerStarted","Data":"c18df8242c4d42946a945ebd2d7ff8df7062158bdf1f3167a30981b580857420"}
May 29 21:00:56.732638 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:56.732601    2582 generic.go:358] "Generic (PLEG): container finished" podID="1ec65a5c-9f6a-4912-982c-ae17fc825ff7" containerID="c18df8242c4d42946a945ebd2d7ff8df7062158bdf1f3167a30981b580857420" exitCode=0
May 29 21:00:56.733028 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:56.732706    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5" event={"ID":"1ec65a5c-9f6a-4912-982c-ae17fc825ff7","Type":"ContainerDied","Data":"c18df8242c4d42946a945ebd2d7ff8df7062158bdf1f3167a30981b580857420"}
May 29 21:00:58.742082 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:58.742045    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5" event={"ID":"1ec65a5c-9f6a-4912-982c-ae17fc825ff7","Type":"ContainerStarted","Data":"6ebbc64ad254cfeeb0259a89738345b0ea64da1ae610157308470e45b1b835ff"}
May 29 21:00:58.793967 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:00:58.793902    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5" podStartSLOduration=1.907568839 podStartE2EDuration="8.793885751s" podCreationTimestamp="2026-05-29 21:00:50 +0000 UTC" firstStartedPulling="2026-05-29 21:00:50.967739731 +0000 UTC m=+823.386593099" lastFinishedPulling="2026-05-29 21:00:57.854056643 +0000 UTC m=+830.272910011" observedRunningTime="2026-05-29 21:00:58.793056005 +0000 UTC m=+831.211909394" watchObservedRunningTime="2026-05-29 21:00:58.793885751 +0000 UTC m=+831.212739138"
May 29 21:01:00.820972 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:00.820930    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:01:00.820972 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:00.820981    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:01:00.833789 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:00.833760    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:01:01.220216 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:01.220132    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:01:01.764356 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:01.764325    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5"
May 29 21:01:03.787597 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:03.787562    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:01:14.691115 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.691071    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"]
May 29 21:01:14.694157 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.694133    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.698170 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.698148    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 29 21:01:14.730834 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.730801    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"]
May 29 21:01:14.792261 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.792453 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2xm\" (UniqueName: \"kubernetes.io/projected/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kube-api-access-gx2xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.792453 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.792453 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.792453 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.792453 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.792371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893053 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893005    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893246 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893066    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2xm\" (UniqueName: \"kubernetes.io/projected/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kube-api-access-gx2xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893246 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893099    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893246 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893128    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893424 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893289    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893424 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893329    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893591 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893570    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893655 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.893828 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.893802    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.895915 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.895882    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.896174 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.896155    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:14.934250 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:14.934213    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2xm\" (UniqueName: \"kubernetes.io/projected/944faba4-a5ee-4f19-a21b-ce9c9ebb7101-kube-api-access-gx2xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9\" (UID: \"944faba4-a5ee-4f19-a21b-ce9c9ebb7101\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:15.004707 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:15.004584    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:15.172610 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:15.172574    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"]
May 29 21:01:15.177023 ip-10-0-137-57 kubenswrapper[2582]: W0529 21:01:15.176994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944faba4_a5ee_4f19_a21b_ce9c9ebb7101.slice/crio-30f5e585b123985b749b18d5bbb15ff07742d3b6f5d9ec7309c8940e9c46234d WatchSource:0}: Error finding container 30f5e585b123985b749b18d5bbb15ff07742d3b6f5d9ec7309c8940e9c46234d: Status 404 returned error can't find the container with id 30f5e585b123985b749b18d5bbb15ff07742d3b6f5d9ec7309c8940e9c46234d
May 29 21:01:15.804611 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:15.804571    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9" event={"ID":"944faba4-a5ee-4f19-a21b-ce9c9ebb7101","Type":"ContainerStarted","Data":"8b81e4cedc8b8984d27f2d6a6b753c1a99a88eafbb9e3bbc93e5337d9488148d"}
May 29 21:01:15.804611 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:15.804617    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9" event={"ID":"944faba4-a5ee-4f19-a21b-ce9c9ebb7101","Type":"ContainerStarted","Data":"30f5e585b123985b749b18d5bbb15ff07742d3b6f5d9ec7309c8940e9c46234d"}
May 29 21:01:16.566363 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:16.566317    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:01:16.814637 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:16.814599    2582 generic.go:358] "Generic (PLEG): container finished" podID="944faba4-a5ee-4f19-a21b-ce9c9ebb7101" containerID="8b81e4cedc8b8984d27f2d6a6b753c1a99a88eafbb9e3bbc93e5337d9488148d" exitCode=0
May 29 21:01:16.815083 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:16.814666    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9" event={"ID":"944faba4-a5ee-4f19-a21b-ce9c9ebb7101","Type":"ContainerDied","Data":"8b81e4cedc8b8984d27f2d6a6b753c1a99a88eafbb9e3bbc93e5337d9488148d"}
May 29 21:01:17.821203 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:17.821161    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9" event={"ID":"944faba4-a5ee-4f19-a21b-ce9c9ebb7101","Type":"ContainerStarted","Data":"8460da9c250f318498d1b547d718722566d20269b450271ea7c12abf7521e881"}
May 29 21:01:17.848239 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:17.848185    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9" podStartSLOduration=3.586284014 podStartE2EDuration="3.848168764s" podCreationTimestamp="2026-05-29 21:01:14 +0000 UTC" firstStartedPulling="2026-05-29 21:01:16.815158893 +0000 UTC m=+849.234012258" lastFinishedPulling="2026-05-29 21:01:17.07704364 +0000 UTC m=+849.495897008" observedRunningTime="2026-05-29 21:01:17.847874343 +0000 UTC m=+850.266727729" watchObservedRunningTime="2026-05-29 21:01:17.848168764 +0000 UTC m=+850.267022150"
May 29 21:01:25.005477 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:25.005431    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:25.005477 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:25.005474    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:25.018141 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:25.018112    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:25.857949 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:25.857917    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9"
May 29 21:01:26.978368 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:26.978322    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"]
May 29 21:01:26.996180 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:26.996154    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:26.997331 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:26.997307    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"]
May 29 21:01:27.001931 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.001908    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 29 21:01:27.100917 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.100885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.101064 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.100954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.101064 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.100974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.101064 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.100992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfgs\" (UniqueName: \"kubernetes.io/projected/d07b63e6-7278-4c42-8746-bfeff30b57f8-kube-api-access-wpfgs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.101064 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.101020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.101064 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.101038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d07b63e6-7278-4c42-8746-bfeff30b57f8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201460 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201410    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d07b63e6-7278-4c42-8746-bfeff30b57f8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201635 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201473    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201635 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201538    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201635 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201561    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201635 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201585    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfgs\" (UniqueName: \"kubernetes.io/projected/d07b63e6-7278-4c42-8746-bfeff30b57f8-kube-api-access-wpfgs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.201635 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201622    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.202007 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.201982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.202007 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.202001    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.202134 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.202041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.204123 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.204097    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d07b63e6-7278-4c42-8746-bfeff30b57f8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.204540 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.204519    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d07b63e6-7278-4c42-8746-bfeff30b57f8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.213447 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.213417    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfgs\" (UniqueName: \"kubernetes.io/projected/d07b63e6-7278-4c42-8746-bfeff30b57f8-kube-api-access-wpfgs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859\" (UID: \"d07b63e6-7278-4c42-8746-bfeff30b57f8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.306575 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.306538    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"
May 29 21:01:27.491224 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.491187    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859"]
May 29 21:01:27.496297 ip-10-0-137-57 kubenswrapper[2582]: W0529 21:01:27.496264    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07b63e6_7278_4c42_8746_bfeff30b57f8.slice/crio-fbbb1b6975ab7101001f7117d177b5059b5435509523cb5a4741b0f713f36919 WatchSource:0}: Error finding container fbbb1b6975ab7101001f7117d177b5059b5435509523cb5a4741b0f713f36919: Status 404 returned error can't find the container with id fbbb1b6975ab7101001f7117d177b5059b5435509523cb5a4741b0f713f36919
May 29 21:01:27.855003 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.854903    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859" event={"ID":"d07b63e6-7278-4c42-8746-bfeff30b57f8","Type":"ContainerStarted","Data":"ac37feda4ba61ccc485d8a7cfdae402d2c027c70f49739176d55e9f68f992b3a"}
May 29 21:01:27.855003 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:27.854951    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859" event={"ID":"d07b63e6-7278-4c42-8746-bfeff30b57f8","Type":"ContainerStarted","Data":"fbbb1b6975ab7101001f7117d177b5059b5435509523cb5a4741b0f713f36919"}
May 29 21:01:28.993383 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:01:28.993344    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w9g9l"]
May 29 21:02:08.130874 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:02:08.130836    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 21:02:08.130874 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:02:08.130836    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 21:07:08.153448 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:08.153424    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 21:07:08.156099 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:08.156078    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5r4nz_ec4364aa-9468-4f9e-9b63-fd36e17926f6/ovn-acl-logging/0.log"
May 29 21:07:19.625225 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:19.625194    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859_d07b63e6-7278-4c42-8746-bfeff30b57f8/storage-initializer/0.log"
May 29 21:07:25.599758 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:25.599725    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b77dbffcd-7r2gd_22e97fcf-d9b6-4b06-bb72-467d02c66b4d/nginx/0.log"
May 29 21:07:25.719738 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:25.719709    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-pssnr_ef69c5e0-e0ce-4e0f-8c80-1934f4783ede/manager/0.log"
May 29 21:07:25.837895 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:25.837862    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wfrcr_c763b103-6e1d-4253-9c05-c4977a599cf1/manager/0.log"
May 29 21:07:26.068106 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.068070    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29668140-x9rxf_73b53871-893a-47ff-9477-56ef85a3b7f9/cleanup/0.log"
May 29 21:07:26.186900 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.186867    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7767dd86bd-c4gm9_1963ee89-cfb8-40b2-b1b6-5cc2d4adb987/manager/0.log"
May 29 21:07:26.327522 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.327452    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-cf7z7_e13a5ee3-6886-486c-9a71-8c29a235d8b2/server/0.log"
May 29 21:07:26.454895 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.454866    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-mj9l2_7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e/manager/0.log"
May 29 21:07:26.572076 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.572045    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4c488574-8gk9n_7a115b88-0c08-403b-b2f3-cfdd184c4451/copy-manifests/0.log"
May 29 21:07:26.579956 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:26.579886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4c488574-8gk9n_7a115b88-0c08-403b-b2f3-cfdd184c4451/manager/0.log"
May 29 21:07:28.409060 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:28.409029    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-jk5kx_9fd3ac95-6934-44de-a10a-f98787fef2ff/manager/0.log"
May 29 21:07:28.981457 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:28.981426    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w9g9l_e97c6e85-5e18-485d-97ba-5e3793486cca/limitador/0.log"
May 29 21:07:29.579410 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:29.579379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-flngp_8a07f41b-6bc3-4ea4-915f-b7428281a46e/discovery/0.log"
May 29 21:07:29.811283 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:29.811248    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86969498d5-xf8xp_97f1c675-e089-467f-ac71-17fcbdd6b15d/kube-auth-proxy/0.log"
May 29 21:07:30.048358 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:30.048326    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7d9sv_a84b6d8d-c47e-4129-896a-38c0e76315bb/payload-processing/0.log"
May 29 21:07:30.166511 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:30.166461    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5695c7489-gqpws_3b42cf9f-2a01-4378-9684-202de74d281c/router/0.log"
May 29 21:07:30.645793 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:30.645762    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5_1ec65a5c-9f6a-4912-982c-ae17fc825ff7/storage-initializer/0.log"
May 29 21:07:30.654232 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:30.654208    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-7fhb5_1ec65a5c-9f6a-4912-982c-ae17fc825ff7/main/0.log"
May 29 21:07:31.011814 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:31.011739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9_944faba4-a5ee-4f19-a21b-ce9c9ebb7101/storage-initializer/0.log"
May 29 21:07:31.019911 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:31.019886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-b8rf9_944faba4-a5ee-4f19-a21b-ce9c9ebb7101/main/0.log"
May 29 21:07:31.135607 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:31.135576    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-qd859_d07b63e6-7278-4c42-8746-bfeff30b57f8/storage-initializer/0.log"
May 29 21:07:38.357237 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:38.357197    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfp6n_54340870-e1f8-4b05-9136-9ef98053cef0/global-pull-secret-syncer/0.log"
May 29 21:07:38.580553 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:38.580519    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cw8lw_ce741b03-bb7f-470f-a877-4e4b42da13d3/konnectivity-agent/0.log"
May 29 21:07:38.667375 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:38.667288    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-57.ec2.internal_556eb30cc85b9809bd1a18b3cb95f3d9/haproxy/0.log"
May 29 21:07:42.759969 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:42.759874    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-jk5kx_9fd3ac95-6934-44de-a10a-f98787fef2ff/manager/0.log"
May 29 21:07:42.934813 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:42.934770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w9g9l_e97c6e85-5e18-485d-97ba-5e3793486cca/limitador/0.log"
May 29 21:07:44.407746 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:44.407707    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-6pwtv_8d1aa6e8-63e7-477e-b636-5ee13b62a9d9/cluster-monitoring-operator/0.log"
May 29 21:07:44.784745 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:44.784655    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krs7d_50370a25-8894-45d9-a327-22315e9bb862/node-exporter/0.log"
May 29 21:07:44.808347 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:44.808323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krs7d_50370a25-8894-45d9-a327-22315e9bb862/kube-rbac-proxy/0.log"
May 29 21:07:44.835098 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:44.835076    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krs7d_50370a25-8894-45d9-a327-22315e9bb862/init-textfile/0.log"
May 29 21:07:48.104057 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.103977    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"]
May 29 21:07:48.106423 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.106401    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.108825 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.108790    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gg47z\"/\"kube-root-ca.crt\""
May 29 21:07:48.108951 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.108801    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gg47z\"/\"openshift-service-ca.crt\""
May 29 21:07:48.108951 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.108924    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gg47z\"/\"default-dockercfg-4sgqx\""
May 29 21:07:48.113811 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.113788    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"]
May 29 21:07:48.188867 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.188823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-sys\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.188867 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.188867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-proc\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.189089 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.188906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4gdr\" (UniqueName: \"kubernetes.io/projected/80277909-b9ee-464a-87bf-c1d23b818a54-kube-api-access-d4gdr\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.189089 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.188926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-lib-modules\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.189089 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.188955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-podres\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.288042 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.288008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-l92zw_6bb254b2-44a0-4921-80da-5c23b13b8517/volume-data-source-validator/0.log"
May 29 21:07:48.289661 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289639    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-sys\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289768 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289693    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-proc\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289768 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289718    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4gdr\" (UniqueName: \"kubernetes.io/projected/80277909-b9ee-464a-87bf-c1d23b818a54-kube-api-access-d4gdr\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289768 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289738    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-lib-modules\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289768 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289757    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-sys\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289768 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289767    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-podres\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289984 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289757    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-proc\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289984 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289862    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-podres\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.289984 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.289898    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80277909-b9ee-464a-87bf-c1d23b818a54-lib-modules\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.298066 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.298045    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4gdr\" (UniqueName: \"kubernetes.io/projected/80277909-b9ee-464a-87bf-c1d23b818a54-kube-api-access-d4gdr\") pod \"perf-node-gather-daemonset-m7f4v\" (UID: \"80277909-b9ee-464a-87bf-c1d23b818a54\") " pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.416989 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.416892    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:48.556023 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.555993    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"]
May 29 21:07:48.558377 ip-10-0-137-57 kubenswrapper[2582]: W0529 21:07:48.558345    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod80277909_b9ee_464a_87bf_c1d23b818a54.slice/crio-173f039094d93b51895e15907ef1b291d72c85f1c8b8060f665eb29116498b8e WatchSource:0}: Error finding container 173f039094d93b51895e15907ef1b291d72c85f1c8b8060f665eb29116498b8e: Status 404 returned error can't find the container with id 173f039094d93b51895e15907ef1b291d72c85f1c8b8060f665eb29116498b8e
May 29 21:07:48.559953 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:48.559937    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 21:07:49.198335 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.198290    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v" event={"ID":"80277909-b9ee-464a-87bf-c1d23b818a54","Type":"ContainerStarted","Data":"f5094ef7287f298331cec3a93038d0694c7aefbd960ba58d6a1bfab6006ee4e7"}
May 29 21:07:49.198335 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.198340    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v" event={"ID":"80277909-b9ee-464a-87bf-c1d23b818a54","Type":"ContainerStarted","Data":"173f039094d93b51895e15907ef1b291d72c85f1c8b8060f665eb29116498b8e"}
May 29 21:07:49.198805 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.198371    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:49.225457 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.225405    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v" podStartSLOduration=1.225388611 podStartE2EDuration="1.225388611s" podCreationTimestamp="2026-05-29 21:07:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 21:07:49.223784833 +0000 UTC m=+1241.642638221" watchObservedRunningTime="2026-05-29 21:07:49.225388611 +0000 UTC m=+1241.644242049"
May 29 21:07:49.481359 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.481282    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvdjd_6d47fe9a-6ea7-4405-8e54-c30def532b5c/dns/0.log"
May 29 21:07:49.505361 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.505334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvdjd_6d47fe9a-6ea7-4405-8e54-c30def532b5c/kube-rbac-proxy/0.log"
May 29 21:07:49.578479 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:49.578451    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvxsz_62db3f7d-8556-4b7d-928d-ddd0fbc9551e/dns-node-resolver/0.log"
May 29 21:07:50.240152 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:50.240123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tkbs9_c1825d10-aa4c-4f03-be3b-13e3214b43b9/node-ca/0.log"
May 29 21:07:51.298139 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:51.298108    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-flngp_8a07f41b-6bc3-4ea4-915f-b7428281a46e/discovery/0.log"
May 29 21:07:51.387230 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:51.387199    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86969498d5-xf8xp_97f1c675-e089-467f-ac71-17fcbdd6b15d/kube-auth-proxy/0.log"
May 29 21:07:51.481666 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:51.481632    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7d9sv_a84b6d8d-c47e-4129-896a-38c0e76315bb/payload-processing/0.log"
May 29 21:07:51.540804 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:51.540778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5695c7489-gqpws_3b42cf9f-2a01-4378-9684-202de74d281c/router/0.log"
May 29 21:07:52.230765 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:52.230732    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h85ms_dd85af44-a91f-4a39-8847-cbb102468100/serve-healthcheck-canary/0.log"
May 29 21:07:52.815029 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:52.814998    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vg2m_1037d112-286f-4597-ab8a-72ade5c7cff7/kube-rbac-proxy/0.log"
May 29 21:07:52.841395 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:52.841357    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vg2m_1037d112-286f-4597-ab8a-72ade5c7cff7/exporter/0.log"
May 29 21:07:52.868649 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:52.868621    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vg2m_1037d112-286f-4597-ab8a-72ade5c7cff7/extractor/0.log"
May 29 21:07:55.212336 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.212308    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gg47z/perf-node-gather-daemonset-m7f4v"
May 29 21:07:55.367647 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.367618    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b77dbffcd-7r2gd_22e97fcf-d9b6-4b06-bb72-467d02c66b4d/nginx/0.log"
May 29 21:07:55.396470 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.396439    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-pssnr_ef69c5e0-e0ce-4e0f-8c80-1934f4783ede/manager/0.log"
May 29 21:07:55.434330 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.434296    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wfrcr_c763b103-6e1d-4253-9c05-c4977a599cf1/manager/0.log"
May 29 21:07:55.487939 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.487852    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29668140-x9rxf_73b53871-893a-47ff-9477-56ef85a3b7f9/cleanup/0.log"
May 29 21:07:55.523217 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.523183    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7767dd86bd-c4gm9_1963ee89-cfb8-40b2-b1b6-5cc2d4adb987/manager/0.log"
May 29 21:07:55.547168 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.547147    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-cf7z7_e13a5ee3-6886-486c-9a71-8c29a235d8b2/server/0.log"
May 29 21:07:55.600525 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.600500    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-mj9l2_7b3e1f5d-e9c4-45e0-8a10-f82444f1aa2e/manager/0.log"
May 29 21:07:55.628646 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.628615    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4c488574-8gk9n_7a115b88-0c08-403b-b2f3-cfdd184c4451/manager/0.log"
May 29 21:07:55.659668 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:07:55.659639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4c488574-8gk9n_7a115b88-0c08-403b-b2f3-cfdd184c4451/copy-manifests/0.log"
May 29 21:08:02.357872 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:02.357841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-tqgzb_6361f76c-0caa-402e-80ac-0d27df85a7c3/migrator/0.log"
May 29 21:08:02.382958 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:02.382930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-tqgzb_6361f76c-0caa-402e-80ac-0d27df85a7c3/graceful-termination/0.log"
May 29 21:08:02.807291 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:02.807257    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-tw5rz_d775baba-1f05-4438-ade7-67bd3f1c771c/kube-storage-version-migrator-operator/1.log"
May 29 21:08:02.808109 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:02.808089    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-tw5rz_d775baba-1f05-4438-ade7-67bd3f1c771c/kube-storage-version-migrator-operator/0.log"
May 29 21:08:04.154960 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.154930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/kube-multus-additional-cni-plugins/0.log"
May 29 21:08:04.191604 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.191569    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/egress-router-binary-copy/0.log"
May 29 21:08:04.217661 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.217634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/cni-plugins/0.log"
May 29 21:08:04.241777 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.241746    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/bond-cni-plugin/0.log"
May 29 21:08:04.266665 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.266637    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/routeoverride-cni/0.log"
May 29 21:08:04.294086 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.294060    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/whereabouts-cni-bincopy/0.log"
May 29 21:08:04.318976 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.318948    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d5g9x_35fb30ce-a29c-4949-b007-3d531526436f/whereabouts-cni/0.log"
May 29 21:08:04.594744 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.594719    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9ts5_8b958c5d-9415-445f-8364-4d407885f3ea/kube-multus/0.log"
May 29 21:08:04.668245 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.668219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dflf6_f2223183-bcdc-42f8-b0b2-68c23783cfda/network-metrics-daemon/0.log"
May 29 21:08:04.695877 ip-10-0-137-57 kubenswrapper[2582]: I0529 21:08:04.695848    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dflf6_f2223183-bcdc-42f8-b0b2-68c23783cfda/kube-rbac-proxy/0.log"