Sep 18 03:32:36.648481 ip-10-0-142-107 systemd[1]: Starting Kubernetes Kubelet... Sep 18 03:32:40.237216 ip-10-0-142-107 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:40.237216 ip-10-0-142-107 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 03:32:40.237216 ip-10-0-142-107 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:40.237216 ip-10-0-142-107 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 03:32:40.237216 ip-10-0-142-107 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:40.238050 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.237292 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 03:32:40.241277 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241260 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.241277 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241276 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241280 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241284 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241287 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241291 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241295 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241298 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241301 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241304 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241307 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241310 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241313 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241316 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241319 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241322 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241325 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241327 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241330 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241340 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.241344 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241343 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241346 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241349 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241353 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241356 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241359 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241362 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241365 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241368 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241370 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241373 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241376 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241379 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241382 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241384 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241387 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241390 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241393 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241395 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241398 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.241879 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241401 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241404 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241406 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241409 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241412 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241415 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241417 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241420 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241423 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241425 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241428 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241433 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241437 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241440 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241445 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241450 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241454 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241457 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241460 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.242437 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241463 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241465 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241468 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241471 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241474 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241477 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241479 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241482 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241485 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241487 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241490 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241493 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241502 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241505 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241508 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241511 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241514 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241516 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241519 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241522 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.242943 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241524 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241527 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241530 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241533 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241538 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241540 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241544 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241548 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241551 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241555 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241558 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241560 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241563 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241566 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241570 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241574 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241577 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241580 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241583 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.243491 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.241587 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242372 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242379 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242382 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242385 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242389 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242393 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242396 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242398 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242401 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242404 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242407 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242410 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242413 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242416 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242419 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242423 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242427 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242430 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.244000 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242433 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242436 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242439 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242442 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242445 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242447 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242450 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242453 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242456 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242459 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242462 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242464 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242467 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242470 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242473 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242476 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242479 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242481 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242484 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242488 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.244517 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242493 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242496 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242499 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242502 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242506 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242509 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242511 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242514 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242517 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242519 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242522 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242525 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242528 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242531 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242534 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242537 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242539 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242542 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242545 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.245040 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242548 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242550 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242553 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242556 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242559 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242561 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242564 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242567 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242569 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242572 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242575 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242578 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242580 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242583 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242586 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242589 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242592 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242595 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242598 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242601 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.245582 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242603 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242606 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242611 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242615 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242618 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242621 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242624 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242628 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242631 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242634 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242637 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242640 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242642 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242645 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242650 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242653 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242656 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242659 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242662 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242665 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.246110 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242668 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.242671 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243061 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243065 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243068 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243071 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243074 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243077 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243081 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243083 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243086 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243089 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243091 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243094 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243097 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243100 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243103 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243106 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243109 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243112 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.246662 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243115 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243118 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243121 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243124 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243127 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243131 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243135 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243138 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243141 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243144 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243147 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243150 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243152 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243155 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243158 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243160 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243163 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243166 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243168 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243174 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.247251 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243178 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243181 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243185 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243188 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243191 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243211 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243214 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243217 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243219 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243222 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243225 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243228 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243231 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243234 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243236 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243239 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243242 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243245 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243250 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243253 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.247797 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243256 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243258 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243261 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243264 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243267 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243270 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243274 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243278 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243282 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243285 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243288 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243292 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243296 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243299 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243302 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243305 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243308 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243311 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.248351 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243314 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243316 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243319 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243322 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243324 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243327 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243330 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243332 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243335 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243338 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243340 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243343 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243351 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243354 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243357 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243359 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243362 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243365 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243368 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243371 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.248866 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243373 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243376 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.243379 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243459 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243497 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243504 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243508 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243514 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243517 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243522 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243527 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243530 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243534 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243538 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243541 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243545 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243548 2581 flags.go:64] FLAG: --cgroup-root="" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243551 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243555 2581 flags.go:64] FLAG: --client-ca-file="" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243558 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243561 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243566 2581 flags.go:64] FLAG: --cluster-domain="" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243569 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243572 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 03:32:40.249396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243577 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243581 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243585 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243588 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243592 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243595 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243599 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243602 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243606 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243610 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243613 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243617 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243620 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243624 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243627 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243630 2581 flags.go:64] FLAG: --enable-server="true" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243634 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243642 2581 flags.go:64] FLAG: --event-burst="100" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243645 2581 flags.go:64] FLAG: --event-qps="50" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243649 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243652 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243655 2581 flags.go:64] FLAG: --eviction-hard="" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243659 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243662 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243665 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 03:32:40.250015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243669 2581 flags.go:64] FLAG: --eviction-soft="" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243672 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243675 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243678 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243681 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243684 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243687 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243691 2581 flags.go:64] FLAG: --feature-gates="" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243695 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243698 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243702 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243705 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243708 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243712 2581 flags.go:64] FLAG: --help="false" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243715 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243718 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243722 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243725 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243729 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243733 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243736 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243739 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243742 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 03:32:40.250799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243745 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243750 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243754 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243757 2581 flags.go:64] FLAG: --kube-reserved="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243761 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243764 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243767 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243770 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243774 2581 flags.go:64] FLAG: --lock-file="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243777 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243780 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243783 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243789 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243792 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243795 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243798 2581 flags.go:64] FLAG: --logging-format="text" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243801 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243805 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243808 2581 flags.go:64] FLAG: --manifest-url="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243811 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243816 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243819 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243823 2581 flags.go:64] FLAG: --max-pods="110" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243827 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243830 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 03:32:40.251879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243833 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243836 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243840 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243843 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243846 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243856 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243860 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243863 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243867 2581 flags.go:64] FLAG: --pod-cidr="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243871 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243877 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243881 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243884 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243887 2581 flags.go:64] FLAG: --port="10250" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243891 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243894 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6981fe9a31ab12d" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243898 2581 flags.go:64] FLAG: --qos-reserved="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243901 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243904 2581 flags.go:64] FLAG: --register-node="true" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243907 2581 flags.go:64] FLAG: --register-with-taints="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243911 2581 flags.go:64] FLAG: --registry-burst="10" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243914 2581 flags.go:64] FLAG: --registry-qps="5" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243917 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243921 2581 flags.go:64] FLAG: --reserved-memory="" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243925 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 03:32:40.253048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243928 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243931 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243934 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243938 2581 flags.go:64] FLAG: --runonce="false" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243941 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243944 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243947 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243951 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243954 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243957 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243960 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243964 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243967 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243970 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243973 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243976 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243980 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243984 2581 flags.go:64] FLAG: --system-cgroups="" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243987 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243993 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243996 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.243999 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244006 2581 flags.go:64] FLAG: --tls-min-version="" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244009 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244012 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 03:32:40.254294 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244016 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244019 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244022 2581 flags.go:64] FLAG: --v="2" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244026 2581 flags.go:64] FLAG: --version="false" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244031 2581 flags.go:64] FLAG: --vmodule="" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244034 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.244038 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244161 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244165 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244169 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244172 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244176 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244179 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244182 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244185 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244189 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244206 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244211 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244214 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244217 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244220 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.255505 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244223 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244226 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244231 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244234 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244239 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244246 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244252 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244255 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244261 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244264 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244267 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244270 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244273 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244276 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244279 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244282 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244285 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244288 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244291 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.256093 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244293 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244296 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244299 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244302 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244305 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244308 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244310 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244313 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244316 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244319 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244322 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244326 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244330 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244333 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244336 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244341 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244344 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244347 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244350 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244353 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.256975 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244356 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244361 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244363 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244366 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244369 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244372 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244375 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244378 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244381 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244384 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244387 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244389 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244392 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244395 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244398 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244401 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244405 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244408 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244411 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244414 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.257825 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244417 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244419 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244422 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244425 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244428 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244430 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244433 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244437 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244440 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244443 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244446 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244449 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244452 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244456 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244459 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244462 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244465 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244468 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244471 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244473 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.258378 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244476 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244479 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244482 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244485 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244488 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.244491 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.245080 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.253592 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.253619 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.253648 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.253668 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253766 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253773 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253781 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.258940 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253788 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253794 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253799 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253804 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253808 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253813 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253817 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253821 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253826 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253831 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253835 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253840 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253845 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253849 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253853 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253858 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253863 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253867 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253872 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253877 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.259408 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253884 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253889 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253894 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253898 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253902 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253907 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253921 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253926 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253931 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253936 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253941 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253945 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253950 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253955 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253959 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253964 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253968 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253973 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253978 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.259938 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253987 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253991 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.253996 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254000 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254005 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254009 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254014 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254018 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254023 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254028 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254032 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254037 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254041 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254045 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254050 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254055 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254060 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254064 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254069 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.260493 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254082 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254086 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254091 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254095 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254099 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254104 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254108 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254113 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254117 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254122 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254126 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254131 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254135 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254143 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254149 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254155 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254160 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254165 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254169 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.261010 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254174 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254178 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254183 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254187 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254212 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254218 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254222 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254228 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254234 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254238 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254243 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254248 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254252 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254258 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254272 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254276 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254281 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.261538 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254285 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.254294 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254529 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254540 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254545 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254549 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254556 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254561 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254566 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254571 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254575 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254580 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254585 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254589 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254594 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:40.261995 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254599 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254604 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254608 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254613 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254617 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254622 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254627 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254631 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254636 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254641 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254645 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254650 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254655 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254659 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254664 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254677 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254682 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254686 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254691 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254695 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:40.262422 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254700 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254704 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254708 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254713 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254718 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254725 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254731 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254736 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254741 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254747 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254753 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254759 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254764 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254769 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254774 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254779 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254783 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254789 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254794 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:40.262948 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254799 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254803 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254808 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254813 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254817 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254821 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254826 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254833 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254839 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254854 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254859 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254863 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254867 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254872 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254876 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254881 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254885 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254890 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254894 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254899 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:40.263473 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254903 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254907 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254912 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254917 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254921 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254926 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254930 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254934 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254939 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254943 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254947 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254951 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254956 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254961 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254965 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254970 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254974 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254979 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254984 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254988 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:40.264008 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254992 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.254997 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.255009 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.255014 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.255019 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.255024 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:40.255029 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.255046 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.255261 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.259317 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.260346 2581 server.go:1019] "Starting client certificate rotation" Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.260453 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.260494 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:32:40.264572 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.263244 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:32:40.272783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.272765 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:32:40.277044 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.277024 2581 log.go:25] "Validated CRI v1 runtime API" Sep 18 03:32:40.278689 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.278673 2581 log.go:25] "Validated CRI v1 image API" Sep 18 03:32:40.280730 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.280710 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 03:32:40.283108 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.283082 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b0d0910a-b1e1-49c9-80d4-f0aae19d119c:/dev/nvme0n1p4 f5ca71df-ad56-484e-964c-212a58e35b32:/dev/nvme0n1p3] Sep 18 03:32:40.283205 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.283107 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 03:32:40.288501 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.288389 2581 manager.go:216] Machine: {Timestamp:2026-09-18 03:32:40.287832627 +0000 UTC m=+2.045118073 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094564 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d9bbcaf6086d349861f80b617fc24 SystemUUID:ec2d9bbc-af60-86d3-4986-1f80b617fc24 BootID:eb55fe3d-70cf-4b15-8757-c3ff41eb1980 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d4:44:33:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d4:44:33:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:64:56:79:12:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 03:32:40.288501 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.288496 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 03:32:40.288611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.288571 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 03:32:40.290733 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.290710 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 03:32:40.290897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.290745 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 03:32:40.291957 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.291947 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 03:32:40.291997 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.291959 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 03:32:40.291997 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.291967 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:32:40.291997 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.291978 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:32:40.293258 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.293246 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 03:32:40.296957 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.296942 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:32:40.297116 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297104 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 03:32:40.297211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297152 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 18 03:32:40.297211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297176 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 03:32:40.297308 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297218 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 03:32:40.297308 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297235 2581 kubelet.go:398] "Adding apiserver pod source" Sep 18 03:32:40.297391 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297338 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 03:32:40.297434 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297385 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:32:40.297866 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297841 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:32:40.297992 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.297874 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:32:40.301806 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.301476 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 03:32:40.303784 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.303766 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 03:32:40.303842 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.303810 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 03:32:40.305216 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305197 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 03:32:40.305216 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305219 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305227 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305235 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305246 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305253 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305275 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305282 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305291 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305300 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305312 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 03:32:40.305334 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305319 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 03:32:40.305617 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305344 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 03:32:40.305617 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.305356 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 03:32:40.311994 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.311966 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 03:32:40.312114 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.312069 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 03:32:40.312177 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.312109 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 03:32:40.313641 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.313623 2581 server.go:1268] "Started kubelet" Sep 18 03:32:40.313718 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.313675 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 03:32:40.313872 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.313818 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 03:32:40.313928 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.313891 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 03:32:40.314553 ip-10-0-142-107 systemd[1]: Started Kubernetes Kubelet. Sep 18 03:32:40.315199 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.315069 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 03:32:40.315199 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.315134 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 18 03:32:40.317422 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.317403 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lllz" Sep 18 03:32:40.320265 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.320241 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 03:32:40.321468 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.321447 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 03:32:40.321468 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.321465 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 03:32:40.321613 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.321562 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.322097 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322077 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 03:32:40.322193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322127 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 03:32:40.322193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322155 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 03:32:40.322317 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322298 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 18 03:32:40.322317 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322308 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 18 03:32:40.322738 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322722 2581 factory.go:153] Registering CRI-O factory Sep 18 03:32:40.322738 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322739 2581 factory.go:223] Registration of the crio container factory successfully Sep 18 03:32:40.322867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322792 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 03:32:40.322867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322799 2581 factory.go:55] Registering systemd factory Sep 18 03:32:40.322867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322805 2581 factory.go:223] Registration of the systemd container factory successfully Sep 18 03:32:40.322867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322822 2581 factory.go:103] Registering Raw factory Sep 18 03:32:40.322867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.322836 2581 manager.go:1196] Started watching for new ooms in manager Sep 18 03:32:40.323419 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.323392 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 03:32:40.323512 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.323425 2581 manager.go:349] Starting recovery of all containers Sep 18 03:32:40.323806 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.323706 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 03:32:40.325480 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.325460 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lllz" Sep 18 03:32:40.332255 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.332091 2581 manager.go:354] Recovery completed Sep 18 03:32:40.363382 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.362719 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 03:32:40.367754 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.367733 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.369952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.369935 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.370015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.369963 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.370015 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.369974 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.370549 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.370527 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 03:32:40.370549 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.370539 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 03:32:40.370633 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.370555 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:32:40.370633 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.370587 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.371743 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.371727 2581 policy_none.go:49] "None policy: Start" Sep 18 03:32:40.371743 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.371745 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 03:32:40.371868 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.371756 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 03:32:40.372845 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.372834 2581 policy_none.go:47] "Start" Sep 18 03:32:40.376822 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.376805 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.391256 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.376841 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.391256 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.376864 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.418821 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.418803 2581 manager.go:337] "Starting Device Plugin manager" Sep 18 03:32:40.418902 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.418851 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 03:32:40.418902 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.418866 2581 server.go:87] "Starting device plugin registration server" Sep 18 03:32:40.419167 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.419153 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 03:32:40.419229 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.419197 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 03:32:40.419301 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.419286 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 03:32:40.419378 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.419366 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 03:32:40.419378 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.419378 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 03:32:40.419945 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.419924 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 03:32:40.420026 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.419979 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.424778 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.424755 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 03:32:40.426116 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.426095 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 03:32:40.426211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.426166 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 03:32:40.426211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.426193 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 03:32:40.426289 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.426243 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 03:32:40.428004 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.427984 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:40.520109 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.520037 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.520943 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.520928 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.521028 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.520962 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.521028 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.520978 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.521028 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.521009 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.526990 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.526970 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal"] Sep 18 03:32:40.527067 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.527037 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.527796 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.527780 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.527870 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.527806 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.527870 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.527820 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.529064 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529051 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.529223 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.529270 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529248 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.529598 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529571 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.529654 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.529598 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-107.ec2.internal\": node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.529795 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529772 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.529795 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529791 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.529907 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529810 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.529907 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529811 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.529907 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529833 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.529907 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.529836 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.530989 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.530973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.531074 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.530999 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:40.531793 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.531773 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:40.531891 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.531801 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:40.531891 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.531812 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:40.547729 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.547703 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.547810 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.547760 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-107.ec2.internal\" not found" node="ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.551832 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.551817 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-107.ec2.internal\" not found" node="ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.624224 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.624207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270f868183fab9ab5ab8a92fee0e783a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-107.ec2.internal\" (UID: \"270f868183fab9ab5ab8a92fee0e783a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.624303 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.624231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.624303 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.624252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.648022 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.647988 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.725276 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.725380 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.725380 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270f868183fab9ab5ab8a92fee0e783a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-107.ec2.internal\" (UID: \"270f868183fab9ab5ab8a92fee0e783a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.725380 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.725380 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cdda7b3d1a50fcdfb4ba456af923e32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal\" (UID: \"6cdda7b3d1a50fcdfb4ba456af923e32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.725541 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.725372 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270f868183fab9ab5ab8a92fee0e783a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-107.ec2.internal\" (UID: \"270f868183fab9ab5ab8a92fee0e783a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.748879 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.748860 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.850185 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.850161 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:40.851327 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.851311 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.855774 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:40.855682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:40.951561 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:40.951527 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:41.052474 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:41.052449 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:41.153579 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:41.153531 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:41.254614 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:41.254594 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:41.260182 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.260164 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 03:32:41.260311 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.260294 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 03:32:41.331022 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.330987 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 03:27:40 +0000 UTC" deadline="2028-04-04 12:19:01.295033952 +0000 UTC" Sep 18 03:32:41.331022 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.331016 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13544h46m19.96402128s" Sep 18 03:32:41.355554 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:41.355531 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-107.ec2.internal\" not found" Sep 18 03:32:41.442833 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.442809 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:41.480110 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.480089 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:41.522540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.522510 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" Sep 18 03:32:41.528357 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.528336 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:41.535327 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.535304 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:32:41.536161 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.536148 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" Sep 18 03:32:41.545871 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.545851 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:32:41.579091 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:41.579066 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdda7b3d1a50fcdfb4ba456af923e32.slice/crio-f9eb9fff0b8c43d85ddea1a7615d0bd2c8b65bf2160bc2cea073530650fcf9a9 WatchSource:0}: Error finding container f9eb9fff0b8c43d85ddea1a7615d0bd2c8b65bf2160bc2cea073530650fcf9a9: Status 404 returned error can't find the container with id f9eb9fff0b8c43d85ddea1a7615d0bd2c8b65bf2160bc2cea073530650fcf9a9 Sep 18 03:32:41.579320 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:41.579292 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f868183fab9ab5ab8a92fee0e783a.slice/crio-c645941eceb49301ed85a9274be24f43e389e44d7eaccbfcfcb098819c7eb0fe WatchSource:0}: Error finding container c645941eceb49301ed85a9274be24f43e389e44d7eaccbfcfcb098819c7eb0fe: Status 404 returned error can't find the container with id c645941eceb49301ed85a9274be24f43e389e44d7eaccbfcfcb098819c7eb0fe Sep 18 03:32:41.584392 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:41.584378 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:32:42.299716 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.299636 2581 apiserver.go:52] "Watching apiserver" Sep 18 03:32:42.312077 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.312046 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 03:32:42.312502 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.312469 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-sbvzt","kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4","openshift-image-registry/node-ca-5pqcz","openshift-multus/multus-24hdf","openshift-multus/multus-additional-cni-plugins-shffj","openshift-ovn-kubernetes/ovnkube-node-94h9r","openshift-cluster-node-tuning-operator/tuned-thqj6","openshift-dns/node-resolver-rfv5s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal","openshift-multus/network-metrics-daemon-dxgp9","openshift-network-diagnostics/network-check-target-hzrpl","openshift-network-operator/iptables-alerter-lsqgm","kube-system/global-pull-secret-syncer-fkndc"] Sep 18 03:32:42.315612 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.315584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.317867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.317839 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.317990 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.317926 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:42.319236 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.318823 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t2s2j\"" Sep 18 03:32:42.319236 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.319090 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.319408 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.319278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 03:32:42.319571 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.319536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 03:32:42.320078 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.320052 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 03:32:42.320254 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.320059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 03:32:42.321434 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.320549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.321434 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.320860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.323134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.322895 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 03:32:42.323134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.322907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.324159 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.323991 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.324159 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.324046 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ct42r\"" Sep 18 03:32:42.324159 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.324127 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 03:32:42.324381 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.324221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.325863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.325292 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.325863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.325331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.325863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.325677 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zwbdd\"" Sep 18 03:32:42.326545 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.326524 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 03:32:42.326643 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.326543 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.327456 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.327440 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.328259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.327812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.328365 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.328269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mzzbs\"" Sep 18 03:32:42.328520 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.328504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.329925 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.329904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 03:32:42.330046 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.330226 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330208 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 03:32:42.330430 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.330657 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330637 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 03:32:42.330952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330762 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dbck9\"" Sep 18 03:32:42.331052 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.330986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.333680 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.333194 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.333680 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.333472 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5k8vl\"" Sep 18 03:32:42.333837 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.333765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.333837 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.333788 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:32:42.334313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.334270 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.334991 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.334971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-tmp\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.335156 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lmf5\" (UniqueName: \"kubernetes.io/projected/b1f9d092-f706-4a6c-9e1e-77abdf44393a-kube-api-access-2lmf5\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.335257 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335257 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.335257 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbvx\" (UniqueName: \"kubernetes.io/projected/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kube-api-access-gfbvx\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.335420 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-sys\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.335420 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-registration-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.335420 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-slash\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335420 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-node-log\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335420 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-config\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-env-overrides\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15adfd16-0a62-45e5-a764-615dd8b45f27-serviceca\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-conf\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-script-lib\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.335697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-etc-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-bin\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-netd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-socket-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-kubernetes\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-kubelet\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-var-lib-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.335992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-ovn\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-log-socket\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-device-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-sys-fs\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-modprobe-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvh6j\" (UniqueName: \"kubernetes.io/projected/c785c2d6-dea7-430c-b917-a07c884f1fd3-kube-api-access-nvh6j\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-systemd-units\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.336228 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:42.336245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-netns\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5fhp\" (UniqueName: \"kubernetes.io/projected/9f90a687-e356-4069-a07d-ebf00e33424e-kube-api-access-j5fhp\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-tuned\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f90a687-e356-4069-a07d-ebf00e33424e-ovn-node-metrics-cert\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336361 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22m6\" (UniqueName: \"kubernetes.io/projected/15adfd16-0a62-45e5-a764-615dd8b45f27-kube-api-access-q22m6\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysconfig\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-systemd\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336466 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-run\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-lib-modules\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-var-lib-kubelet\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-systemd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15adfd16-0a62-45e5-a764-615dd8b45f27-host\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-host\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336620 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 03:32:42.337248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.336696 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7tsm\"" Sep 18 03:32:42.339286 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.338479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.341018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.340996 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 03:32:42.341326 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.341302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 03:32:42.341406 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.341353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.342687 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.342543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bmjs\"" Sep 18 03:32:42.345812 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.345245 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 03:32:42.346126 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.346058 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pgk9b\"" Sep 18 03:32:42.346126 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.346096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.346346 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.346294 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:42.359404 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.359381 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc6b9" Sep 18 03:32:42.367648 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.367557 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc6b9" Sep 18 03:32:42.423285 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.423260 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 03:32:42.432738 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.432688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" event={"ID":"6cdda7b3d1a50fcdfb4ba456af923e32","Type":"ContainerStarted","Data":"f9eb9fff0b8c43d85ddea1a7615d0bd2c8b65bf2160bc2cea073530650fcf9a9"} Sep 18 03:32:42.434897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.434872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" event={"ID":"270f868183fab9ab5ab8a92fee0e783a","Type":"ContainerStarted","Data":"c645941eceb49301ed85a9274be24f43e389e44d7eaccbfcfcb098819c7eb0fe"} Sep 18 03:32:42.437230 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-systemd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.437329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-tmp\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.437329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.437329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbvx\" (UniqueName: \"kubernetes.io/projected/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kube-api-access-gfbvx\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.437329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-systemd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-sys\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827580c5-03af-41a9-a342-5287291ef1b3-hosts-file\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n8x8\" (UniqueName: \"kubernetes.io/projected/665d464c-7fbd-48e5-970b-3f5f9ec99d85-kube-api-access-8n8x8\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-sys\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-system-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-registration-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-slash\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.437552 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-node-log\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-config\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15adfd16-0a62-45e5-a764-615dd8b45f27-serviceca\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-conf\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-script-lib\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437663 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-slash\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-multus\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-netd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-socket-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827580c5-03af-41a9-a342-5287291ef1b3-tmp-dir\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-registration-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-bin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.438007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-netd\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.437974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-var-lib-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-sys-fs\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-socket-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-daemon-config\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvh6j\" (UniqueName: \"kubernetes.io/projected/c785c2d6-dea7-430c-b917-a07c884f1fd3-kube-api-access-nvh6j\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-netns\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5fhp\" (UniqueName: \"kubernetes.io/projected/9f90a687-e356-4069-a07d-ebf00e33424e-kube-api-access-j5fhp\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysctl-conf\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-sys-fs\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-netns\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438424 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15adfd16-0a62-45e5-a764-615dd8b45f27-serviceca\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438475 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-node-log\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-var-lib-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439026 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22m6\" (UniqueName: \"kubernetes.io/projected/15adfd16-0a62-45e5-a764-615dd8b45f27-kube-api-access-q22m6\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-systemd\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-var-lib-kubelet\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-host\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438685 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-systemd\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lmf5\" (UniqueName: \"kubernetes.io/projected/b1f9d092-f706-4a6c-9e1e-77abdf44393a-kube-api-access-2lmf5\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-var-lib-kubelet\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-k8s-cni-cncf-io\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-etc-kubernetes\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15adfd16-0a62-45e5-a764-615dd8b45f27-host\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72nkc\" (UniqueName: \"kubernetes.io/projected/827580c5-03af-41a9-a342-5287291ef1b3-kube-api-access-72nkc\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-script-lib\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/665d464c-7fbd-48e5-970b-3f5f9ec99d85-iptables-alerter-script\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438942 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-host\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.438998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.439981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15adfd16-0a62-45e5-a764-615dd8b45f27-host\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61553150-97d9-4af2-902f-4ce7d64d315d-agent-certs\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-ovnkube-config\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-kubelet-config\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-cnibin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-multus-certs\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-env-overrides\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6h92\" (UniqueName: \"kubernetes.io/projected/2ac0f76f-8c98-4f73-bfb4-183600d2755b-kube-api-access-c6h92\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.439501 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-netns\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-hostroot\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.439632 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:42.93961158 +0000 UTC m=+4.696897015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/665d464c-7fbd-48e5-970b-3f5f9ec99d85-host-slash\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.440852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-conf-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f90a687-e356-4069-a07d-ebf00e33424e-env-overrides\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-etc-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-bin\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-kubernetes\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-cni-bin\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-etc-openvswitch\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-cni-binary-copy\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-kubernetes\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-kubelet\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-ovn\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439945 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-kubelet\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-log-socket\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-run-ovn\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.439986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-device-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-modprobe-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-device-dir\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61553150-97d9-4af2-902f-4ce7d64d315d-konnectivity-ca\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.441755 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-log-socket\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-dbus\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-systemd-units\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-tuned\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-system-cni-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-systemd-units\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cnibin\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-socket-dir-parent\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-modprobe-d\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f90a687-e356-4069-a07d-ebf00e33424e-ovn-node-metrics-cert\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysconfig\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f90a687-e356-4069-a07d-ebf00e33424e-host-run-ovn-kubernetes\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-run\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-lib-modules\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-kubelet\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.442682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8c98\" (UniqueName: \"kubernetes.io/projected/af94729f-d2df-447d-bf96-be4ddb151bb1-kube-api-access-n8c98\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.443414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-run\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.443414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440615 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-sysconfig\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.443414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.440639 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1f9d092-f706-4a6c-9e1e-77abdf44393a-lib-modules\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.443414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.441834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-tmp\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.443414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.442771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f90a687-e356-4069-a07d-ebf00e33424e-ovn-node-metrics-cert\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.443673 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.443588 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1f9d092-f706-4a6c-9e1e-77abdf44393a-etc-tuned\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.447340 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.447285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbvx\" (UniqueName: \"kubernetes.io/projected/f8f1ea75-6ce7-4c7e-a00b-1a42c5559494-kube-api-access-gfbvx\") pod \"aws-ebs-csi-driver-node-dmfn4\" (UID: \"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.448141 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.448116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5fhp\" (UniqueName: \"kubernetes.io/projected/9f90a687-e356-4069-a07d-ebf00e33424e-kube-api-access-j5fhp\") pod \"ovnkube-node-94h9r\" (UID: \"9f90a687-e356-4069-a07d-ebf00e33424e\") " pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.449118 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.449093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvh6j\" (UniqueName: \"kubernetes.io/projected/c785c2d6-dea7-430c-b917-a07c884f1fd3-kube-api-access-nvh6j\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.449733 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.449687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22m6\" (UniqueName: \"kubernetes.io/projected/15adfd16-0a62-45e5-a764-615dd8b45f27-kube-api-access-q22m6\") pod \"node-ca-5pqcz\" (UID: \"15adfd16-0a62-45e5-a764-615dd8b45f27\") " pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.449869 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.449852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lmf5\" (UniqueName: \"kubernetes.io/projected/b1f9d092-f706-4a6c-9e1e-77abdf44393a-kube-api-access-2lmf5\") pod \"tuned-thqj6\" (UID: \"b1f9d092-f706-4a6c-9e1e-77abdf44393a\") " pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.541831 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827580c5-03af-41a9-a342-5287291ef1b3-tmp-dir\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-bin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-daemon-config\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-bin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.541995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.541990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-k8s-cni-cncf-io\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-etc-kubernetes\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72nkc\" (UniqueName: \"kubernetes.io/projected/827580c5-03af-41a9-a342-5287291ef1b3-kube-api-access-72nkc\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/665d464c-7fbd-48e5-970b-3f5f9ec99d85-iptables-alerter-script\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61553150-97d9-4af2-902f-4ce7d64d315d-agent-certs\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-kubelet-config\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-cnibin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-multus-certs\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6h92\" (UniqueName: \"kubernetes.io/projected/2ac0f76f-8c98-4f73-bfb4-183600d2755b-kube-api-access-c6h92\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-netns\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-hostroot\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/665d464c-7fbd-48e5-970b-3f5f9ec99d85-host-slash\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.542382 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-conf-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-cni-binary-copy\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61553150-97d9-4af2-902f-4ce7d64d315d-konnectivity-ca\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-dbus\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-system-cni-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cnibin\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.542984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827580c5-03af-41a9-a342-5287291ef1b3-tmp-dir\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.543471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-k8s-cni-cncf-io\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543392 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-etc-kubernetes\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543725 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-daemon-config\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543786 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-socket-dir-parent\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543841 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-kubelet\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543841 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8c98\" (UniqueName: \"kubernetes.io/projected/af94729f-d2df-447d-bf96-be4ddb151bb1-kube-api-access-n8c98\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.543952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.543952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827580c5-03af-41a9-a342-5287291ef1b3-hosts-file\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.543952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.543952 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8x8\" (UniqueName: \"kubernetes.io/projected/665d464c-7fbd-48e5-970b-3f5f9ec99d85-kube-api-access-8n8x8\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.544145 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-system-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544145 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.543995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-multus\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544145 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-cni-multus\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544145 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/665d464c-7fbd-48e5-970b-3f5f9ec99d85-iptables-alerter-script\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.544145 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-socket-dir-parent\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544419 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-var-lib-kubelet\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544524 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.544500 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:42.544597 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.544597 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.544583 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.044567965 +0000 UTC m=+4.801853395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:42.544774 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544752 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827580c5-03af-41a9-a342-5287291ef1b3-hosts-file\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.544836 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-system-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544902 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-hostroot\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.544902 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.544871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-conf-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-system-cni-dir\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af94729f-d2df-447d-bf96-be4ddb151bb1-cni-binary-copy\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61553150-97d9-4af2-902f-4ce7d64d315d-konnectivity-ca\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-cnibin\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-dbus\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545430 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/665d464c-7fbd-48e5-970b-3f5f9ec99d85-host-slash\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-multus-cni-dir\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-kubelet-config\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545483 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-multus-certs\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af94729f-d2df-447d-bf96-be4ddb151bb1-host-run-netns\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.545540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.545534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ac0f76f-8c98-4f73-bfb4-183600d2755b-cnibin\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.546780 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.546753 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61553150-97d9-4af2-902f-4ce7d64d315d-agent-certs\") pod \"konnectivity-agent-sbvzt\" (UID: \"61553150-97d9-4af2-902f-4ce7d64d315d\") " pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.548532 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.548509 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:42.548532 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.548534 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:42.548704 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.548550 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:42.548704 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.548619 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.04860211 +0000 UTC m=+4.805887569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:42.550900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.550843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72nkc\" (UniqueName: \"kubernetes.io/projected/827580c5-03af-41a9-a342-5287291ef1b3-kube-api-access-72nkc\") pod \"node-resolver-rfv5s\" (UID: \"827580c5-03af-41a9-a342-5287291ef1b3\") " pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.551653 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.551630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8c98\" (UniqueName: \"kubernetes.io/projected/af94729f-d2df-447d-bf96-be4ddb151bb1-kube-api-access-n8c98\") pod \"multus-24hdf\" (UID: \"af94729f-d2df-447d-bf96-be4ddb151bb1\") " pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.553196 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.553171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n8x8\" (UniqueName: \"kubernetes.io/projected/665d464c-7fbd-48e5-970b-3f5f9ec99d85-kube-api-access-8n8x8\") pod \"iptables-alerter-lsqgm\" (UID: \"665d464c-7fbd-48e5-970b-3f5f9ec99d85\") " pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.553927 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.553892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6h92\" (UniqueName: \"kubernetes.io/projected/2ac0f76f-8c98-4f73-bfb4-183600d2755b-kube-api-access-c6h92\") pod \"multus-additional-cni-plugins-shffj\" (UID: \"2ac0f76f-8c98-4f73-bfb4-183600d2755b\") " pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.631640 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.631608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:32:42.641380 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.641343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" Sep 18 03:32:42.652241 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.652213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pqcz" Sep 18 03:32:42.659381 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.659311 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thqj6" Sep 18 03:32:42.668335 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.668312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shffj" Sep 18 03:32:42.675232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.675190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfv5s" Sep 18 03:32:42.682300 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.682280 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:42.684563 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.684543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lsqgm" Sep 18 03:32:42.692709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.692691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:32:42.699487 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.699468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24hdf" Sep 18 03:32:42.946522 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:42.946492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:42.946699 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.946669 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:42.946754 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:42.946741 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.946725276 +0000 UTC m=+5.704010714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:43.047136 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.047093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:43.047311 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.047273 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:43.047369 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.047345 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:32:44.04732499 +0000 UTC m=+5.804610424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:43.147891 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.147852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:43.148069 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.148001 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:43.148069 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.148020 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:43.148069 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.148030 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:43.148270 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.148084 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:32:44.148067364 +0000 UTC m=+5.905352796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:43.371312 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.371274 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:27:42 +0000 UTC" deadline="2028-03-28 12:15:10.589746416 +0000 UTC" Sep 18 03:32:43.371312 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.371309 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13376h42m27.218442482s" Sep 18 03:32:43.426660 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.426631 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:43.426799 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.426760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:43.613699 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.613657 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac0f76f_8c98_4f73_bfb4_183600d2755b.slice/crio-a0cb79769149d290fadcc88cbce177f68901a29fe03fb4701dff1829b18912d8 WatchSource:0}: Error finding container a0cb79769149d290fadcc88cbce177f68901a29fe03fb4701dff1829b18912d8: Status 404 returned error can't find the container with id a0cb79769149d290fadcc88cbce177f68901a29fe03fb4701dff1829b18912d8 Sep 18 03:32:43.614792 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.614530 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665d464c_7fbd_48e5_970b_3f5f9ec99d85.slice/crio-8e7cbdb2441917d400949744bef2f2d2bea2c8cf7d47e7c6eff2560ecb8a5445 WatchSource:0}: Error finding container 8e7cbdb2441917d400949744bef2f2d2bea2c8cf7d47e7c6eff2560ecb8a5445: Status 404 returned error can't find the container with id 8e7cbdb2441917d400949744bef2f2d2bea2c8cf7d47e7c6eff2560ecb8a5445 Sep 18 03:32:43.617947 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.617335 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f90a687_e356_4069_a07d_ebf00e33424e.slice/crio-0b719ebf698182ff0a3254538638d6b7e2fb6b42e5ac3ead6a12468203e28f0e WatchSource:0}: Error finding container 0b719ebf698182ff0a3254538638d6b7e2fb6b42e5ac3ead6a12468203e28f0e: Status 404 returned error can't find the container with id 0b719ebf698182ff0a3254538638d6b7e2fb6b42e5ac3ead6a12468203e28f0e Sep 18 03:32:43.620109 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.620082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15adfd16_0a62_45e5_a764_615dd8b45f27.slice/crio-3080e7a389ca65ea654916d5393b825c0121e3c132d59d1edfb5d58536bc1cd3 WatchSource:0}: Error finding container 3080e7a389ca65ea654916d5393b825c0121e3c132d59d1edfb5d58536bc1cd3: Status 404 returned error can't find the container with id 3080e7a389ca65ea654916d5393b825c0121e3c132d59d1edfb5d58536bc1cd3 Sep 18 03:32:43.621596 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.621572 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f9d092_f706_4a6c_9e1e_77abdf44393a.slice/crio-94f316a2d63d3792aac9269a182165a4556c6248bd76f8ad55cdfded1da2c899 WatchSource:0}: Error finding container 94f316a2d63d3792aac9269a182165a4556c6248bd76f8ad55cdfded1da2c899: Status 404 returned error can't find the container with id 94f316a2d63d3792aac9269a182165a4556c6248bd76f8ad55cdfded1da2c899 Sep 18 03:32:43.622798 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.622771 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827580c5_03af_41a9_a342_5287291ef1b3.slice/crio-105c72d6a85fecb9a9cb826e70ec2dd72184e5a67eaa086325fb61f1135f2d8b WatchSource:0}: Error finding container 105c72d6a85fecb9a9cb826e70ec2dd72184e5a67eaa086325fb61f1135f2d8b: Status 404 returned error can't find the container with id 105c72d6a85fecb9a9cb826e70ec2dd72184e5a67eaa086325fb61f1135f2d8b Sep 18 03:32:43.624288 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.624263 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f1ea75_6ce7_4c7e_a00b_1a42c5559494.slice/crio-229cdf0369b5ab7585ca5fc5fb3f1e7015d50fdb83b73cd8d8137cafaf6cb544 WatchSource:0}: Error finding container 229cdf0369b5ab7585ca5fc5fb3f1e7015d50fdb83b73cd8d8137cafaf6cb544: Status 404 returned error can't find the container with id 229cdf0369b5ab7585ca5fc5fb3f1e7015d50fdb83b73cd8d8137cafaf6cb544 Sep 18 03:32:43.625526 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.625500 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf94729f_d2df_447d_bf96_be4ddb151bb1.slice/crio-cde6e103256f7f483584980f3e80587c95334e19d9c23500e7edbbaff98f85b1 WatchSource:0}: Error finding container cde6e103256f7f483584980f3e80587c95334e19d9c23500e7edbbaff98f85b1: Status 404 returned error can't find the container with id cde6e103256f7f483584980f3e80587c95334e19d9c23500e7edbbaff98f85b1 Sep 18 03:32:43.626513 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:32:43.626488 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61553150_97d9_4af2_902f_4ce7d64d315d.slice/crio-1de32a10dacf0110f0b19776d5c8c499ceb285a3f4f749e61fad5dacfaeed036 WatchSource:0}: Error finding container 1de32a10dacf0110f0b19776d5c8c499ceb285a3f4f749e61fad5dacfaeed036: Status 404 returned error can't find the container with id 1de32a10dacf0110f0b19776d5c8c499ceb285a3f4f749e61fad5dacfaeed036 Sep 18 03:32:43.954348 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:43.954178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:43.954447 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.954313 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:43.954485 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:43.954457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:45.95444196 +0000 UTC m=+7.711727391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:44.055505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.055465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:44.055697 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.055630 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:44.055697 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.055695 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:32:46.055678955 +0000 UTC m=+7.812964405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:44.159634 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.159494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:44.159805 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.159683 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:44.159805 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.159704 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:44.159805 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.159717 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:44.159805 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.159776 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:32:46.159757312 +0000 UTC m=+7.917042760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:44.371542 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.371433 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:27:42 +0000 UTC" deadline="2028-03-15 22:13:48.992457963 +0000 UTC" Sep 18 03:32:44.371542 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.371495 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13074h41m4.620967342s" Sep 18 03:32:44.428973 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.428896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:44.429115 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.429031 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:44.429471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.429429 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:44.429575 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:44.429530 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:44.447168 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.447094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sbvzt" event={"ID":"61553150-97d9-4af2-902f-4ce7d64d315d","Type":"ContainerStarted","Data":"1de32a10dacf0110f0b19776d5c8c499ceb285a3f4f749e61fad5dacfaeed036"} Sep 18 03:32:44.450435 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.450407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thqj6" event={"ID":"b1f9d092-f706-4a6c-9e1e-77abdf44393a","Type":"ContainerStarted","Data":"94f316a2d63d3792aac9269a182165a4556c6248bd76f8ad55cdfded1da2c899"} Sep 18 03:32:44.459914 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.459889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lsqgm" event={"ID":"665d464c-7fbd-48e5-970b-3f5f9ec99d85","Type":"ContainerStarted","Data":"8e7cbdb2441917d400949744bef2f2d2bea2c8cf7d47e7c6eff2560ecb8a5445"} Sep 18 03:32:44.467270 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.467244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerStarted","Data":"a0cb79769149d290fadcc88cbce177f68901a29fe03fb4701dff1829b18912d8"} Sep 18 03:32:44.473783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.473248 2581 generic.go:356] "Generic (PLEG): container finished" podID="6cdda7b3d1a50fcdfb4ba456af923e32" containerID="b714a8c3209bdb6a95eb650d345cbad8e868ba4ebf846dd8a3ebb573bc4474ac" exitCode=0 Sep 18 03:32:44.473783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.473337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" event={"ID":"6cdda7b3d1a50fcdfb4ba456af923e32","Type":"ContainerDied","Data":"b714a8c3209bdb6a95eb650d345cbad8e868ba4ebf846dd8a3ebb573bc4474ac"} Sep 18 03:32:44.496017 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.495945 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" event={"ID":"270f868183fab9ab5ab8a92fee0e783a","Type":"ContainerStarted","Data":"dc52553b0eb4c8dd29172a2438cb788f4451e0e692dfd07dea8c256107687a03"} Sep 18 03:32:44.509663 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.509600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24hdf" event={"ID":"af94729f-d2df-447d-bf96-be4ddb151bb1","Type":"ContainerStarted","Data":"cde6e103256f7f483584980f3e80587c95334e19d9c23500e7edbbaff98f85b1"} Sep 18 03:32:44.528589 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.528535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" event={"ID":"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494","Type":"ContainerStarted","Data":"229cdf0369b5ab7585ca5fc5fb3f1e7015d50fdb83b73cd8d8137cafaf6cb544"} Sep 18 03:32:44.539865 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.539839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfv5s" event={"ID":"827580c5-03af-41a9-a342-5287291ef1b3","Type":"ContainerStarted","Data":"105c72d6a85fecb9a9cb826e70ec2dd72184e5a67eaa086325fb61f1135f2d8b"} Sep 18 03:32:44.547573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.547510 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pqcz" event={"ID":"15adfd16-0a62-45e5-a764-615dd8b45f27","Type":"ContainerStarted","Data":"3080e7a389ca65ea654916d5393b825c0121e3c132d59d1edfb5d58536bc1cd3"} Sep 18 03:32:44.570653 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:44.570538 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"0b719ebf698182ff0a3254538638d6b7e2fb6b42e5ac3ead6a12468203e28f0e"} Sep 18 03:32:45.427177 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:45.426636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:45.427177 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:45.426756 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:45.611268 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:45.611168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" event={"ID":"6cdda7b3d1a50fcdfb4ba456af923e32","Type":"ContainerStarted","Data":"3a3f0b9d3677043aea9d66102f21dfb808d12ea3d59f28da41e0afac138a59d5"} Sep 18 03:32:45.626448 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:45.625716 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-107.ec2.internal" podStartSLOduration=4.625696918 podStartE2EDuration="4.625696918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:44.512256972 +0000 UTC m=+6.269542429" watchObservedRunningTime="2026-09-18 03:32:45.625696918 +0000 UTC m=+7.382982371" Sep 18 03:32:45.975091 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:45.975056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:45.975289 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:45.975223 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:45.975289 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:45.975283 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:49.975264704 +0000 UTC m=+11.732550134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:46.076327 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:46.076296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:46.076486 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.076448 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:46.076544 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.076506 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:32:50.076488516 +0000 UTC m=+11.833773951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:46.177750 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:46.177134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:46.177750 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.177313 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:46.177750 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.177330 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:46.177750 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.177342 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:46.177750 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.177395 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:32:50.177378974 +0000 UTC m=+11.934664408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:46.429234 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:46.429201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:46.429674 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.429382 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:46.429772 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:46.429753 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:46.429880 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:46.429860 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:47.426535 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:47.426497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:47.426719 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:47.426610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:48.426604 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:48.426565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:48.427040 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:48.426694 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:48.427173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:48.427154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:48.427281 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:48.427263 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:49.427031 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:49.427000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:49.427603 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:49.427137 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:50.010783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:50.010749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:50.010967 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.010875 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:50.010967 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.010932 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:58.010915634 +0000 UTC m=+19.768201079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:50.111574 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:50.111237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:50.111574 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.111363 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:50.111574 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.111428 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:32:58.111411547 +0000 UTC m=+19.868696985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:50.217307 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:50.215462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:50.217307 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.215742 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:50.217307 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.215765 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:50.217307 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.215777 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:50.217307 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.215841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:32:58.215824267 +0000 UTC m=+19.973109715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:50.430752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:50.430712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:50.431180 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:50.430718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:50.431180 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.430841 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:50.431180 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:50.430930 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:51.426855 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:51.426822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:51.427016 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:51.426951 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:52.427198 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:52.427165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:52.427643 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:52.427165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:52.427643 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:52.427291 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:52.427643 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:52.427368 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:53.426809 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:53.426772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:53.427079 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:53.426892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:54.427273 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:54.427231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:54.427696 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:54.427283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:54.427696 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:54.427372 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:54.427696 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:54.427517 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:55.426727 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:55.426694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:55.426895 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:55.426804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:56.426472 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:56.426427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:56.426472 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:56.426450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:56.426917 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:56.426569 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:56.426917 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:56.426704 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:57.426950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:57.426917 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:57.427353 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:57.427014 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:32:58.073905 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:58.073876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:58.074076 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.074029 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:58.077053 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.074530 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:14.074072239 +0000 UTC m=+35.831357669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:58.175062 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:58.175024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:58.175243 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.175197 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:58.175302 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.175260 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:14.175245173 +0000 UTC m=+35.932530614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:58.276275 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:58.276237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:58.276431 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.276374 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:58.276431 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.276392 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:58.276431 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.276400 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:58.276557 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.276462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:14.276444945 +0000 UTC m=+36.033730375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:58.427401 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:58.427322 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:32:58.427789 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.427457 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:32:58.427789 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:58.427524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:32:58.427789 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:58.427640 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:32:59.426796 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:32:59.426767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:32:59.426955 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:32:59.426877 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:00.427585 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:00.427546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:00.428057 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:00.427655 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:00.428057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:00.427712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:00.428057 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:00.427825 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:01.426802 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.426448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:01.426947 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:01.426798 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:01.649288 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.649255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pqcz" event={"ID":"15adfd16-0a62-45e5-a764-615dd8b45f27","Type":"ContainerStarted","Data":"ae91e56063cc6d5bfb71f9b99cb2c4d15195cb390a5698f7c2f1cc1d4dc53c0e"} Sep 18 03:33:01.654931 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.654905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"ebde11759e7dcde97f39374c099c4b2e6340f97d571289a29be7db3a91b31404"} Sep 18 03:33:01.655057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.654971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"f4a5f161da97b93d4000886e3576ba2787dd1577a4622af099defae053416a9c"} Sep 18 03:33:01.655057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.655015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"5c7cb12eedc60a08cdfa81dd919a2e8ebe83922441e9379d96b65b02f7bfbad7"} Sep 18 03:33:01.655057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.655052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"80da04c6ae88d5a0feef454223dac06fd737b25d6e9737315076c376e14f8be7"} Sep 18 03:33:01.655202 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.655078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"91e3d75060e974e6cee54202eef15ea5270352693f39b989161b25b653867fe0"} Sep 18 03:33:01.655202 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.655106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"af47cc8ed9d53312ede1e80c4c954661860f0eaf01253de2d6bae27d405c133d"} Sep 18 03:33:01.656343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.656317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sbvzt" event={"ID":"61553150-97d9-4af2-902f-4ce7d64d315d","Type":"ContainerStarted","Data":"b5a34f270f5c40fa8faa16af515f11c38be2f0928e2cb9d5494a5dc226ce45fe"} Sep 18 03:33:01.657747 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.657719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thqj6" event={"ID":"b1f9d092-f706-4a6c-9e1e-77abdf44393a","Type":"ContainerStarted","Data":"f07d44af2c45422c0824466bdfd9cdfda11ca7ff676e2b60b41f3eae754d3867"} Sep 18 03:33:01.659331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.659307 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="950bb9c4c077bbf43028abddff47002f3ceff2c2835f1aac91689d1ef18a1940" exitCode=0 Sep 18 03:33:01.659419 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.659395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"950bb9c4c077bbf43028abddff47002f3ceff2c2835f1aac91689d1ef18a1940"} Sep 18 03:33:01.660939 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.660910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24hdf" event={"ID":"af94729f-d2df-447d-bf96-be4ddb151bb1","Type":"ContainerStarted","Data":"ce516a6147f206faf7310d0eed5f7ba14e65c04ca5b23b27aedba14b5568d99f"} Sep 18 03:33:01.662503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.662481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" event={"ID":"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494","Type":"ContainerStarted","Data":"e82da38209233c86b21c60c8ad69f1938808587a5001242d9df089a0c2b3b0b9"} Sep 18 03:33:01.663951 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.663929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfv5s" event={"ID":"827580c5-03af-41a9-a342-5287291ef1b3","Type":"ContainerStarted","Data":"b8bbb0259e09a838f756338481a9a7f1b6f6dfde3baadaec13e260b1876016e1"} Sep 18 03:33:01.664300 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.664264 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-107.ec2.internal" podStartSLOduration=20.66425297 podStartE2EDuration="20.66425297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:45.625625935 +0000 UTC m=+7.382911399" watchObservedRunningTime="2026-09-18 03:33:01.66425297 +0000 UTC m=+23.421538422" Sep 18 03:33:01.664614 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.664590 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5pqcz" podStartSLOduration=4.190136556 podStartE2EDuration="21.664583849s" totalImagesPullingTime="17.474447293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:01.663804122 +0000 UTC m=+23.421089575" watchObservedRunningTime="2026-09-18 03:33:01.664583849 +0000 UTC m=+23.421869301" Sep 18 03:33:01.678983 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.678915 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-thqj6" podStartSLOduration=4.204966337 podStartE2EDuration="21.678898838s" totalImagesPullingTime="17.473932501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:01.67805424 +0000 UTC m=+23.435339692" watchObservedRunningTime="2026-09-18 03:33:01.678898838 +0000 UTC m=+23.436184295" Sep 18 03:33:01.711778 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.711742 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sbvzt" podStartSLOduration=11.708488184 podStartE2EDuration="21.711728731s" totalImagesPullingTime="10.003240547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:01.71159767 +0000 UTC m=+23.468883124" watchObservedRunningTime="2026-09-18 03:33:01.711728731 +0000 UTC m=+23.469014198" Sep 18 03:33:01.726676 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.726643 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-24hdf" podStartSLOduration=3.19966069 podStartE2EDuration="20.726634009s" totalImagesPullingTime="17.526973319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:01.726479234 +0000 UTC m=+23.483764687" watchObservedRunningTime="2026-09-18 03:33:01.726634009 +0000 UTC m=+23.483919461" Sep 18 03:33:01.740515 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:01.740366 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rfv5s" podStartSLOduration=4.268143117 podStartE2EDuration="21.740345216s" totalImagesPullingTime="17.472202099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:01.740054007 +0000 UTC m=+23.497339459" watchObservedRunningTime="2026-09-18 03:33:01.740345216 +0000 UTC m=+23.497630660" Sep 18 03:33:02.102710 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.102688 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 03:33:02.426694 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.426660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:02.426867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.426703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:02.426867 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:02.426799 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:02.426964 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:02.426892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:02.429342 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.429253 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T03:33:02.102707914Z","UUID":"77e4785f-8ee5-4043-82ae-71bc18df2d55","Handler":null,"Name":"","Endpoint":""} Sep 18 03:33:02.430930 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.430912 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 03:33:02.431021 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.430942 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 03:33:02.668088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.668053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lsqgm" event={"ID":"665d464c-7fbd-48e5-970b-3f5f9ec99d85","Type":"ContainerStarted","Data":"1acffd6c6edfe051e68cb0979beb6a6a255745c143790bd840040dfc299faa27"} Sep 18 03:33:02.671032 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.670999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" event={"ID":"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494","Type":"ContainerStarted","Data":"7dfeeb1cf957debf30108269125246f801f454abd66b143605a9e428a0faf9b9"} Sep 18 03:33:02.681749 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:02.681658 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lsqgm" podStartSLOduration=5.200971342 podStartE2EDuration="22.681639948s" totalImagesPullingTime="17.480668606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:02.681598525 +0000 UTC m=+24.438883991" watchObservedRunningTime="2026-09-18 03:33:02.681639948 +0000 UTC m=+24.438925401" Sep 18 03:33:03.427315 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:03.427287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:03.427501 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:03.427388 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:03.676197 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:03.676162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" event={"ID":"f8f1ea75-6ce7-4c7e-a00b-1a42c5559494","Type":"ContainerStarted","Data":"d5a6a236b47d4f0a42fb68005a323e13c5637f6d4b3b8d1b4c8276fa9229aad4"} Sep 18 03:33:03.693181 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:03.693141 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmfn4" podStartSLOduration=4.605580246 podStartE2EDuration="23.693109556s" totalImagesPullingTime="19.08752931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:03.69268033 +0000 UTC m=+25.449965782" watchObservedRunningTime="2026-09-18 03:33:03.693109556 +0000 UTC m=+25.450395009" Sep 18 03:33:03.866946 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:03.866911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:33:03.867570 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:03.867548 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:33:04.426644 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:04.426616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:04.426807 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:04.426786 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:04.426878 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:04.426846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:04.426953 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:04.426935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:04.682897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:04.682780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"4fbf9ef7c9225467446f2d16ecb7c558a68ee5be5645a09a57dc21caef1611ee"} Sep 18 03:33:04.683368 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:04.683140 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:33:04.683745 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:04.683725 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sbvzt" Sep 18 03:33:05.426593 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:05.426563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:05.426772 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:05.426678 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:06.429246 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.429051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:06.429931 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.429096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:06.429931 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:06.429339 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:06.429931 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:06.429391 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:06.690629 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.690540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" event={"ID":"9f90a687-e356-4069-a07d-ebf00e33424e","Type":"ContainerStarted","Data":"1041c0b7687abb46c8b34f296f0daaa8cbb85340b2ca7f1067cc11a8ae3205c8"} Sep 18 03:33:06.690792 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.690772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:06.690856 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.690845 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:06.690905 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.690899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:06.692732 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.692705 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="bd01a05e70d1b8880658fb50fc5bbdbb63e1c04ec0fa2a96c66cc97f655a16f0" exitCode=0 Sep 18 03:33:06.692865 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.692783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"bd01a05e70d1b8880658fb50fc5bbdbb63e1c04ec0fa2a96c66cc97f655a16f0"} Sep 18 03:33:06.706201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.706182 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:06.706335 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.706320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:06.717379 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:06.717108 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" podStartSLOduration=9.190537438 podStartE2EDuration="26.71709147s" totalImagesPullingTime="17.526554032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:06.716290761 +0000 UTC m=+28.473576214" watchObservedRunningTime="2026-09-18 03:33:06.71709147 +0000 UTC m=+28.474376925" Sep 18 03:33:07.427198 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.426945 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:07.427359 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:07.427324 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:07.742146 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.742087 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkndc"] Sep 18 03:33:07.742427 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.742228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:07.742427 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:07.742335 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:07.746192 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.746167 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrpl"] Sep 18 03:33:07.746351 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.746245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:07.746351 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:07.746333 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:07.746782 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.746765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxgp9"] Sep 18 03:33:07.746868 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:07.746856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:07.746976 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:07.746955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:08.698617 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:08.698584 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="3e9d130749d896471986096364b3a4bccfdafb144def58628f3bd5bbe12d035f" exitCode=0 Sep 18 03:33:08.698806 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:08.698670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"3e9d130749d896471986096364b3a4bccfdafb144def58628f3bd5bbe12d035f"} Sep 18 03:33:09.427029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:09.427000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:09.427029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:09.427014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:09.427029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:09.427014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:09.427563 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:09.427108 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:09.427563 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:09.427168 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:09.427563 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:09.427225 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:10.705313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:10.705283 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="ce66cd55d4633fe932119ff2a157c7d71dcc49c9489de64f2b671ec81e80e86b" exitCode=0 Sep 18 03:33:10.705703 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:10.705332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"ce66cd55d4633fe932119ff2a157c7d71dcc49c9489de64f2b671ec81e80e86b"} Sep 18 03:33:11.427172 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:11.427139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:11.427319 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:11.427241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:11.427319 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:11.427250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:11.427319 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:11.427243 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:11.427462 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:11.427339 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:11.427462 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:11.427430 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:13.426401 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:13.426369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:13.426401 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:13.426399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:13.426975 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:13.426405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:13.426975 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:13.426491 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkndc" podUID="99ecca74-c07c-4d46-aebc-7b2e25ce9d5e" Sep 18 03:33:13.426975 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:13.426622 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:33:13.426975 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:13.426707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrpl" podUID="bd656ef9-0209-4440-a544-fb7926651afd" Sep 18 03:33:14.037259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.037058 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-107.ec2.internal" event="NodeReady" Sep 18 03:33:14.037445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.037345 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 03:33:14.067333 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.067306 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-868844c5c9-2j9wq"] Sep 18 03:33:14.091730 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.091654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:14.091862 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.091772 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:33:14.091862 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.091833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:46.091815958 +0000 UTC m=+67.849101397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:33:14.094893 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.094871 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-858r4"] Sep 18 03:33:14.095020 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.095000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.097210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.097183 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 03:33:14.097394 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.097378 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jgsps\"" Sep 18 03:33:14.097394 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.097387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 03:33:14.097537 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.097437 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 03:33:14.102212 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.102193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 03:33:14.112828 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.112805 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4r56"] Sep 18 03:33:14.112939 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.112924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.115855 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.115749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 03:33:14.116195 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.116177 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 03:33:14.116526 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.116507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fvk6\"" Sep 18 03:33:14.134881 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.134856 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868844c5c9-2j9wq"] Sep 18 03:33:14.134986 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.134889 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-858r4"] Sep 18 03:33:14.134986 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.134917 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4r56"] Sep 18 03:33:14.135094 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.134986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.137269 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.137248 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 03:33:14.137723 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.137344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gb67w\"" Sep 18 03:33:14.137723 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.137352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 03:33:14.137723 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.137392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 03:33:14.192010 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.191971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8fm\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxmr8\" (UniqueName: \"kubernetes.io/projected/1b9ca056-2996-4592-9eaf-41acadb4c18b-kube-api-access-dxmr8\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.192193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b9ca056-2996-4592-9eaf-41acadb4c18b-tmp-dir\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9ca056-2996-4592-9eaf-41acadb4c18b-config-volume\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:14.192410 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192635 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192635 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.192462 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:33:14.192635 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.192465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.192635 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.192525 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret podName:99ecca74-c07c-4d46-aebc-7b2e25ce9d5e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:46.192511596 +0000 UTC m=+67.949797026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret") pod "global-pull-secret-syncer-fkndc" (UID: "99ecca74-c07c-4d46-aebc-7b2e25ce9d5e") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:33:14.292925 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.292888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.292940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.292975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8fm\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293088 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxmr8\" (UniqueName: \"kubernetes.io/projected/1b9ca056-2996-4592-9eaf-41acadb4c18b-kube-api-access-dxmr8\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293159 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw62q\" (UniqueName: \"kubernetes.io/projected/cecd1955-20ac-45cf-9330-f072207d8360-kube-api-access-bw62q\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b9ca056-2996-4592-9eaf-41acadb4c18b-tmp-dir\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9ca056-2996-4592-9eaf-41acadb4c18b-config-volume\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.293403 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cecd1955-20ac-45cf-9330-f072207d8360-cert\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.293793 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293793 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.293893 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293182 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:33:14.293893 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.293847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b9ca056-2996-4592-9eaf-41acadb4c18b-tmp-dir\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.293893 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293871 2581 projected.go:196] Error preparing data for projected volume kube-api-access-dkr8v for pod openshift-network-diagnostics/network-check-target-hzrpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293916 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293926 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293931 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293943 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v podName:bd656ef9-0209-4440-a544-fb7926651afd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:46.293924394 +0000 UTC m=+68.051209830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkr8v" (UniqueName: "kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v") pod "network-check-target-hzrpl" (UID: "bd656ef9-0209-4440-a544-fb7926651afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:14.79395424 +0000 UTC m=+36.551239685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:14.294030 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.293996 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:14.793986587 +0000 UTC m=+36.551272019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:14.294375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.294353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9ca056-2996-4592-9eaf-41acadb4c18b-config-volume\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.297506 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.297486 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.297614 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.297487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.302027 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.301991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxmr8\" (UniqueName: \"kubernetes.io/projected/1b9ca056-2996-4592-9eaf-41acadb4c18b-kube-api-access-dxmr8\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.302661 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.302620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.302850 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.302828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8fm\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.306135 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.306099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.394028 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.393956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cecd1955-20ac-45cf-9330-f072207d8360-cert\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.394199 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.394055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw62q\" (UniqueName: \"kubernetes.io/projected/cecd1955-20ac-45cf-9330-f072207d8360-kube-api-access-bw62q\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.396437 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.396412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cecd1955-20ac-45cf-9330-f072207d8360-cert\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.402544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.402522 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw62q\" (UniqueName: \"kubernetes.io/projected/cecd1955-20ac-45cf-9330-f072207d8360-kube-api-access-bw62q\") pod \"ingress-canary-z4r56\" (UID: \"cecd1955-20ac-45cf-9330-f072207d8360\") " pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.444370 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.444343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4r56" Sep 18 03:33:14.796486 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.796460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:14.796605 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.796551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:14.796646 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.796630 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:14.796699 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.796689 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:15.79667623 +0000 UTC m=+37.553961665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:14.796740 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.796634 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:14.796740 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.796728 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:14.796802 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:14.796768 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:15.796756732 +0000 UTC m=+37.554042175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:14.963659 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:14.963602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4r56"] Sep 18 03:33:14.985135 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:33:14.985083 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecd1955_20ac_45cf_9330_f072207d8360.slice/crio-44489d454f34e051a58117eb865ad194d3de7cc3c1684bda2cf69194d52aa155 WatchSource:0}: Error finding container 44489d454f34e051a58117eb865ad194d3de7cc3c1684bda2cf69194d52aa155: Status 404 returned error can't find the container with id 44489d454f34e051a58117eb865ad194d3de7cc3c1684bda2cf69194d52aa155 Sep 18 03:33:15.426978 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.426952 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:15.427093 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.426990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:15.427093 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.427003 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:15.430600 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430570 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:33:15.430600 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:33:15.430600 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtr95\"" Sep 18 03:33:15.430791 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430605 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:33:15.430791 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p5fh\"" Sep 18 03:33:15.430791 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.430582 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:33:15.720103 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.720072 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="820c9e31f34ba70afb440730e6aeea63d2b2f12b720c560debcafd0f2342ffee" exitCode=0 Sep 18 03:33:15.720945 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.720161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"820c9e31f34ba70afb440730e6aeea63d2b2f12b720c560debcafd0f2342ffee"} Sep 18 03:33:15.721373 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.721351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4r56" event={"ID":"cecd1955-20ac-45cf-9330-f072207d8360","Type":"ContainerStarted","Data":"44489d454f34e051a58117eb865ad194d3de7cc3c1684bda2cf69194d52aa155"} Sep 18 03:33:15.804666 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.804641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:15.804785 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:15.804683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:15.804785 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:15.804774 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:15.804877 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:15.804791 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:15.804877 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:15.804845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:17.804827328 +0000 UTC m=+39.562112764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:15.804877 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:15.804853 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:15.804982 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:15.804911 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:17.804894858 +0000 UTC m=+39.562180307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:16.728070 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:16.728027 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ac0f76f-8c98-4f73-bfb4-183600d2755b" containerID="ffede081d55add1b1ae34360767e63f976a4a7235fdf317ce24b6fbf81d8eb59" exitCode=0 Sep 18 03:33:16.728461 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:16.728084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerDied","Data":"ffede081d55add1b1ae34360767e63f976a4a7235fdf317ce24b6fbf81d8eb59"} Sep 18 03:33:17.734168 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.734136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shffj" event={"ID":"2ac0f76f-8c98-4f73-bfb4-183600d2755b","Type":"ContainerStarted","Data":"17ad9faefdb79440ad17f40283e4c57d180fe3d9761457683a651f44cdf95b0a"} Sep 18 03:33:17.735673 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.735643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4r56" event={"ID":"cecd1955-20ac-45cf-9330-f072207d8360","Type":"ContainerStarted","Data":"fc8461c6d7a16abe003da77188c8bd4ed9f40bd88d3b67a28cbddb9a9a8dac48"} Sep 18 03:33:17.754898 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.754844 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-shffj" podStartSLOduration=9.752129639 podStartE2EDuration="37.754823893s" totalImagesPullingTime="28.002694254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:17.753026029 +0000 UTC m=+39.510311482" watchObservedRunningTime="2026-09-18 03:33:17.754823893 +0000 UTC m=+39.512109347" Sep 18 03:33:17.768474 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.768434 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4r56" podStartSLOduration=1.241029338 podStartE2EDuration="3.768421107s" totalImagesPullingTime="2.527391769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:17.767911091 +0000 UTC m=+39.525196542" watchObservedRunningTime="2026-09-18 03:33:17.768421107 +0000 UTC m=+39.525706600" Sep 18 03:33:17.819447 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.819366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:17.819447 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:17.819406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:17.819667 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:17.819520 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:17.819667 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:17.819543 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:17.819667 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:17.819602 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:21.819583081 +0000 UTC m=+43.576868531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:17.819962 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:17.819930 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:17.820049 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:17.819998 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:21.819979886 +0000 UTC m=+43.577265336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:21.848201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:21.848169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:21.848201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:21.848203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:21.848683 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:21.848307 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:21.848683 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:21.848329 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:21.848683 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:21.848350 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:21.848683 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:21.848352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:29.848340337 +0000 UTC m=+51.605625767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:21.848683 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:21.848420 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:29.84840242 +0000 UTC m=+51.605687855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:29.905358 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:29.905321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:29.905358 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:29.905363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:29.905800 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:29.905493 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:29.905800 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:29.905510 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:29.905800 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:29.905520 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:29.905800 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:29.905578 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:33:45.905560437 +0000 UTC m=+67.662845880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:29.905800 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:29.905595 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:45.905586347 +0000 UTC m=+67.662871779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:30.451173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.451144 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt"] Sep 18 03:33:30.455007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.454993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.457508 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.457487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 03:33:30.458501 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.458478 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 03:33:30.458628 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.458488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 03:33:30.458628 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.458488 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 03:33:30.464246 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.464224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt"] Sep 18 03:33:30.468777 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.468751 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt"] Sep 18 03:33:30.473514 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.473496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.475966 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.475944 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 03:33:30.476072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.476005 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 03:33:30.476072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.476011 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 03:33:30.476199 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.476094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 03:33:30.482052 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.482030 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt"] Sep 18 03:33:30.610151 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b425a24-5b97-493e-979d-b0e878980817-klusterlet-config\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.610307 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b2e1d6-85ee-48e0-a53c-aad87a41682d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.610307 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.610307 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.610307 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdh69\" (UniqueName: \"kubernetes.io/projected/8b425a24-5b97-493e-979d-b0e878980817-kube-api-access-zdh69\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.610513 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqrn\" (UniqueName: \"kubernetes.io/projected/79b2e1d6-85ee-48e0-a53c-aad87a41682d-kube-api-access-xdqrn\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.610513 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b425a24-5b97-493e-979d-b0e878980817-tmp\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.610513 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.610513 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.610477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711671 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdh69\" (UniqueName: \"kubernetes.io/projected/8b425a24-5b97-493e-979d-b0e878980817-kube-api-access-zdh69\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.711671 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqrn\" (UniqueName: \"kubernetes.io/projected/79b2e1d6-85ee-48e0-a53c-aad87a41682d-kube-api-access-xdqrn\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711671 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b425a24-5b97-493e-979d-b0e878980817-tmp\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b425a24-5b97-493e-979d-b0e878980817-klusterlet-config\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b2e1d6-85ee-48e0-a53c-aad87a41682d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.711879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.711850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.712161 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.712145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b425a24-5b97-493e-979d-b0e878980817-tmp\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.712625 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.712601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b2e1d6-85ee-48e0-a53c-aad87a41682d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.715476 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.715451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-ca\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.715597 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.715509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.715597 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.715590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.715685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.715595 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79b2e1d6-85ee-48e0-a53c-aad87a41682d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.715685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.715605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b425a24-5b97-493e-979d-b0e878980817-klusterlet-config\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.719223 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.719199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdh69\" (UniqueName: \"kubernetes.io/projected/8b425a24-5b97-493e-979d-b0e878980817-kube-api-access-zdh69\") pod \"klusterlet-addon-workmgr-567667fbcc-skxnt\" (UID: \"8b425a24-5b97-493e-979d-b0e878980817\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.719314 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.719284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqrn\" (UniqueName: \"kubernetes.io/projected/79b2e1d6-85ee-48e0-a53c-aad87a41682d-kube-api-access-xdqrn\") pod \"cluster-proxy-proxy-agent-df56dc7dc-sdtlt\" (UID: \"79b2e1d6-85ee-48e0-a53c-aad87a41682d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:30.763354 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.763335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:30.794494 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:30.794472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:33:31.031636 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:31.031571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt"] Sep 18 03:33:31.035509 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:33:31.035486 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b425a24_5b97_493e_979d_b0e878980817.slice/crio-b2cce379b3bc78824db02d4f15d2f442fb5b06aada194816ad676cb46c14985b WatchSource:0}: Error finding container b2cce379b3bc78824db02d4f15d2f442fb5b06aada194816ad676cb46c14985b: Status 404 returned error can't find the container with id b2cce379b3bc78824db02d4f15d2f442fb5b06aada194816ad676cb46c14985b Sep 18 03:33:31.067158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:31.067138 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt"] Sep 18 03:33:31.069203 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:33:31.069180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79b2e1d6_85ee_48e0_a53c_aad87a41682d.slice/crio-d64a7c9cb9c1e769dcea13524a5a06abad6d0f0e2c3a29d6f2935e07844839bc WatchSource:0}: Error finding container d64a7c9cb9c1e769dcea13524a5a06abad6d0f0e2c3a29d6f2935e07844839bc: Status 404 returned error can't find the container with id d64a7c9cb9c1e769dcea13524a5a06abad6d0f0e2c3a29d6f2935e07844839bc Sep 18 03:33:31.768134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:31.768090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerStarted","Data":"d64a7c9cb9c1e769dcea13524a5a06abad6d0f0e2c3a29d6f2935e07844839bc"} Sep 18 03:33:31.769285 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:31.769261 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerStarted","Data":"b2cce379b3bc78824db02d4f15d2f442fb5b06aada194816ad676cb46c14985b"} Sep 18 03:33:37.788988 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.788944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerStarted","Data":"9f132576458f32e880aa7e34ca00fc5629e5f02d09564188041fc02609d685ed"} Sep 18 03:33:37.789389 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.788998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerStarted","Data":"88fd285a493a63efa58f61a1a4dfc7b7b5d46f2f1fdb40e60764bffb10a44df3"} Sep 18 03:33:37.789389 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.789018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerStarted","Data":"c673848f15564d5ce3988ff1f49d3a50eced49cc1c330d4248c26e15e78c6c81"} Sep 18 03:33:37.790415 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.790395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerStarted","Data":"4c0a9dd02dc4af68958e628564849892cd8dbc436c8a1c473b940b0cbb3eefcc"} Sep 18 03:33:37.790623 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.790606 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:37.792068 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.792049 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:33:37.807204 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.807164 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" podStartSLOduration=1.504454604 podStartE2EDuration="7.807152004s" totalImagesPullingTime="6.3026974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:37.806144945 +0000 UTC m=+59.563430390" watchObservedRunningTime="2026-09-18 03:33:37.807152004 +0000 UTC m=+59.564437456" Sep 18 03:33:37.823821 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:37.823788 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" podStartSLOduration=1.472151764 podStartE2EDuration="7.823775708s" totalImagesPullingTime="6.351623944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:37.822734723 +0000 UTC m=+59.580020176" watchObservedRunningTime="2026-09-18 03:33:37.823775708 +0000 UTC m=+59.581061160" Sep 18 03:33:38.714045 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:38.714017 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94h9r" Sep 18 03:33:45.918960 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:45.918916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:33:45.918960 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:45.918962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:33:45.919392 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:45.919058 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:45.919392 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:45.919068 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:45.919392 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:45.919073 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:33:45.919392 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:45.919138 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:34:17.919109015 +0000 UTC m=+99.676394444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:33:45.919392 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:45.919156 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:34:17.91914766 +0000 UTC m=+99.676433089 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:33:46.120514 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.120477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:33:46.122860 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.122838 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:33:46.130678 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:46.130659 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:33:46.130735 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:33:46.130708 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:34:50.130695137 +0000 UTC m=+131.887980568 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : secret "metrics-daemon-secret" not found Sep 18 03:33:46.221097 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.221021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:46.223462 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.223445 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:33:46.234304 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.234285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99ecca74-c07c-4d46-aebc-7b2e25ce9d5e-original-pull-secret\") pod \"global-pull-secret-syncer-fkndc\" (UID: \"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e\") " pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:46.321928 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.321907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:46.324252 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.324232 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:33:46.335158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.335139 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:33:46.342058 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.342045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkndc" Sep 18 03:33:46.346263 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.346247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkr8v\" (UniqueName: \"kubernetes.io/projected/bd656ef9-0209-4440-a544-fb7926651afd-kube-api-access-dkr8v\") pod \"network-check-target-hzrpl\" (UID: \"bd656ef9-0209-4440-a544-fb7926651afd\") " pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:46.605930 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.605904 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkndc"] Sep 18 03:33:46.609744 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:33:46.609721 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ecca74_c07c_4d46_aebc_7b2e25ce9d5e.slice/crio-4b9472a625f5f8a49d400494abd45498f85ca083e7f29ecd51afe2c1ab6e2001 WatchSource:0}: Error finding container 4b9472a625f5f8a49d400494abd45498f85ca083e7f29ecd51afe2c1ab6e2001: Status 404 returned error can't find the container with id 4b9472a625f5f8a49d400494abd45498f85ca083e7f29ecd51afe2c1ab6e2001 Sep 18 03:33:46.638861 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.638839 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtr95\"" Sep 18 03:33:46.647882 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.647862 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:46.813034 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.813001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkndc" event={"ID":"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e","Type":"ContainerStarted","Data":"4b9472a625f5f8a49d400494abd45498f85ca083e7f29ecd51afe2c1ab6e2001"} Sep 18 03:33:46.912926 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:46.912853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrpl"] Sep 18 03:33:46.915760 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:33:46.915736 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd656ef9_0209_4440_a544_fb7926651afd.slice/crio-67c657a8b90bd4761abd9927d19004dba1d343447054bbb12b3f3d8414b458a5 WatchSource:0}: Error finding container 67c657a8b90bd4761abd9927d19004dba1d343447054bbb12b3f3d8414b458a5: Status 404 returned error can't find the container with id 67c657a8b90bd4761abd9927d19004dba1d343447054bbb12b3f3d8414b458a5 Sep 18 03:33:47.818211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:47.818170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrpl" event={"ID":"bd656ef9-0209-4440-a544-fb7926651afd","Type":"ContainerStarted","Data":"67c657a8b90bd4761abd9927d19004dba1d343447054bbb12b3f3d8414b458a5"} Sep 18 03:33:51.831596 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:51.831553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkndc" event={"ID":"99ecca74-c07c-4d46-aebc-7b2e25ce9d5e","Type":"ContainerStarted","Data":"a53843ccf220a7f9029c93ae406d9a148f8febff6279351319aa352c91dd1722"} Sep 18 03:33:51.832930 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:51.832907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrpl" event={"ID":"bd656ef9-0209-4440-a544-fb7926651afd","Type":"ContainerStarted","Data":"2e0dee14136dd8ab8187286233e86dab8a8b2252dfb68cba878f4cd20eb154f8"} Sep 18 03:33:51.833027 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:51.833013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:33:51.849273 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:51.846322 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fkndc" podStartSLOduration=66.327351696 podStartE2EDuration="1m10.84630648s" totalImagesPullingTime="4.518954784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:51.845884891 +0000 UTC m=+73.603170343" watchObservedRunningTime="2026-09-18 03:33:51.84630648 +0000 UTC m=+73.603591933" Sep 18 03:33:51.860047 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:33:51.859999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzrpl" podStartSLOduration=67.649670272 podStartE2EDuration="1m11.859985072s" totalImagesPullingTime="4.2103148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:51.859713048 +0000 UTC m=+73.616998501" watchObservedRunningTime="2026-09-18 03:33:51.859985072 +0000 UTC m=+73.617270523" Sep 18 03:34:17.934741 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:34:17.934711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:34:17.934741 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:34:17.934743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:34:17.935183 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:17.934840 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:34:17.935183 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:17.934845 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:34:17.935183 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:17.934860 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:34:17.935183 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:17.934913 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:35:21.934900021 +0000 UTC m=+163.692185452 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:34:17.935183 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:17.934926 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:35:21.93492094 +0000 UTC m=+163.692206369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:34:22.839071 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:34:22.839035 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzrpl" Sep 18 03:34:50.155149 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:34:50.155095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:34:50.155602 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:50.155242 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:34:50.155602 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:34:50.155306 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:52.155290311 +0000 UTC m=+253.912575741 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : secret "metrics-daemon-secret" not found Sep 18 03:35:17.105596 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:17.105551 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" podUID="d0a26a08-7a11-4f48-9897-835eb8d3e909" Sep 18 03:35:17.122701 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:17.122673 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-858r4" podUID="1b9ca056-2996-4592-9eaf-41acadb4c18b" Sep 18 03:35:18.087804 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:18.087773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:35:18.088000 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:18.087773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858r4" Sep 18 03:35:18.447215 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:18.447139 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:35:21.966178 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:21.966115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") pod \"image-registry-868844c5c9-2j9wq\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:35:21.966178 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:21.966187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:35:21.966673 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:21.966272 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:35:21.966673 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:21.966293 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868844c5c9-2j9wq: secret "image-registry-tls" not found Sep 18 03:35:21.966673 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:21.966275 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:35:21.966673 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:21.966360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls podName:d0a26a08-7a11-4f48-9897-835eb8d3e909 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:23.966342149 +0000 UTC m=+285.723627592 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls") pod "image-registry-868844c5c9-2j9wq" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909") : secret "image-registry-tls" not found Sep 18 03:35:21.966673 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:35:21.966376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls podName:1b9ca056-2996-4592-9eaf-41acadb4c18b nodeName:}" failed. No retries permitted until 2026-09-18 03:37:23.966368166 +0000 UTC m=+285.723653596 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls") pod "dns-default-858r4" (UID: "1b9ca056-2996-4592-9eaf-41acadb4c18b") : secret "dns-default-metrics-tls" not found Sep 18 03:35:29.426885 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:29.426854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:35:37.791652 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:37.791560 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" podUID="8b425a24-5b97-493e-979d-b0e878980817" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Sep 18 03:35:38.146021 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:38.145990 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b425a24-5b97-493e-979d-b0e878980817" containerID="4c0a9dd02dc4af68958e628564849892cd8dbc436c8a1c473b940b0cbb3eefcc" exitCode=1 Sep 18 03:35:38.146234 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:38.146033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerDied","Data":"4c0a9dd02dc4af68958e628564849892cd8dbc436c8a1c473b940b0cbb3eefcc"} Sep 18 03:35:38.146408 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:38.146393 2581 scope.go:117] "RemoveContainer" containerID="4c0a9dd02dc4af68958e628564849892cd8dbc436c8a1c473b940b0cbb3eefcc" Sep 18 03:35:39.151080 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:39.151046 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerStarted","Data":"d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b"} Sep 18 03:35:39.151474 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:39.151351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:35:39.151957 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:35:39.151936 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:36:47.312583 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.312548 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mfpdc"] Sep 18 03:36:47.314624 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.314608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.316995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.316966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 03:36:47.317942 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.317923 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tg5sj\"" Sep 18 03:36:47.318029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.317941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 03:36:47.318029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.317941 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 03:36:47.318158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.317943 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 03:36:47.328182 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.328163 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mfpdc"] Sep 18 03:36:47.427638 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.427614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.427757 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.427641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1dc928f-289f-4da5-998b-62644550177b-data-volume\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.427757 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.427663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.427757 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.427698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76m4k\" (UniqueName: \"kubernetes.io/projected/b1dc928f-289f-4da5-998b-62644550177b-kube-api-access-76m4k\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.427757 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.427731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1dc928f-289f-4da5-998b-62644550177b-crio-socket\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528114 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1dc928f-289f-4da5-998b-62644550177b-crio-socket\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528225 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528225 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1dc928f-289f-4da5-998b-62644550177b-data-volume\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528225 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1dc928f-289f-4da5-998b-62644550177b-crio-socket\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528225 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528366 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:47.528249 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:47.528366 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:47.528261 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.528366 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:47.528306 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:48.028290692 +0000 UTC m=+249.785576123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : configmap "kube-rbac-proxy" not found Sep 18 03:36:47.528366 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:47.528322 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:48.028313341 +0000 UTC m=+249.785598771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.528366 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76m4k\" (UniqueName: \"kubernetes.io/projected/b1dc928f-289f-4da5-998b-62644550177b-kube-api-access-76m4k\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.528542 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.528445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1dc928f-289f-4da5-998b-62644550177b-data-volume\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:47.536141 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:47.536108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76m4k\" (UniqueName: \"kubernetes.io/projected/b1dc928f-289f-4da5-998b-62644550177b-kube-api-access-76m4k\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:48.031010 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:48.030963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:48.031228 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:48.031019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:48.031228 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:48.031108 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:48.031228 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:48.031150 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:48.031228 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:48.031199 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:49.031183046 +0000 UTC m=+250.788468478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:48.031397 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:48.031234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:49.031227045 +0000 UTC m=+250.788512475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : configmap "kube-rbac-proxy" not found Sep 18 03:36:49.038087 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:49.038053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:49.038087 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:49.038090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:49.038505 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:49.038217 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:49.038505 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:49.038254 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:49.038505 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:49.038291 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:51.038275924 +0000 UTC m=+252.795561354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:49.038505 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:49.038304 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:51.038298128 +0000 UTC m=+252.795583558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : configmap "kube-rbac-proxy" not found Sep 18 03:36:49.264022 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:49.263994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfv5s_827580c5-03af-41a9-a342-5287291ef1b3/dns-node-resolver/0.log" Sep 18 03:36:50.263575 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:50.263545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pqcz_15adfd16-0a62-45e5-a764-615dd8b45f27/node-ca/0.log" Sep 18 03:36:51.051804 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:51.051776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:51.051969 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:51.051810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:51.051969 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:51.051919 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:51.052054 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:51.051976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:55.051960536 +0000 UTC m=+256.809245966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:51.052054 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:51.051923 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:51.052165 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:51.052054 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:36:55.052039779 +0000 UTC m=+256.809325212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : configmap "kube-rbac-proxy" not found Sep 18 03:36:51.264244 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:51.264215 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4r56_cecd1955-20ac-45cf-9330-f072207d8360/serve-healthcheck-canary/0.log" Sep 18 03:36:52.159416 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:52.159382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:36:52.159591 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:52.159486 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:36:52.159591 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:52.159540 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs podName:c785c2d6-dea7-430c-b917-a07c884f1fd3 nodeName:}" failed. No retries permitted until 2026-09-18 03:38:54.159525983 +0000 UTC m=+375.916811413 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs") pod "network-metrics-daemon-dxgp9" (UID: "c785c2d6-dea7-430c-b917-a07c884f1fd3") : secret "metrics-daemon-secret" not found Sep 18 03:36:55.077685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:55.077650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:55.077685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:36:55.077688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:36:55.078220 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:55.077765 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:55.078220 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:55.077794 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:55.078220 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:55.077823 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:37:03.077807262 +0000 UTC m=+264.835092694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : configmap "kube-rbac-proxy" not found Sep 18 03:36:55.078220 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:36:55.077849 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls podName:b1dc928f-289f-4da5-998b-62644550177b nodeName:}" failed. No retries permitted until 2026-09-18 03:37:03.07783568 +0000 UTC m=+264.835121116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mfpdc" (UID: "b1dc928f-289f-4da5-998b-62644550177b") : secret "insights-runtime-extractor-tls" not found Sep 18 03:37:03.132452 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.132409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:37:03.132452 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.132454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:37:03.133065 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.133043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1dc928f-289f-4da5-998b-62644550177b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:37:03.135179 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.135152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1dc928f-289f-4da5-998b-62644550177b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mfpdc\" (UID: \"b1dc928f-289f-4da5-998b-62644550177b\") " pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:37:03.223866 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.223835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mfpdc" Sep 18 03:37:03.495739 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:03.495674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mfpdc"] Sep 18 03:37:03.498630 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:37:03.498608 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dc928f_289f_4da5_998b_62644550177b.slice/crio-b78152d14064edd68d65c1e89f05769860c5857dd4f6035762d96aad0a45052d WatchSource:0}: Error finding container b78152d14064edd68d65c1e89f05769860c5857dd4f6035762d96aad0a45052d: Status 404 returned error can't find the container with id b78152d14064edd68d65c1e89f05769860c5857dd4f6035762d96aad0a45052d Sep 18 03:37:04.393336 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:04.393303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mfpdc" event={"ID":"b1dc928f-289f-4da5-998b-62644550177b","Type":"ContainerStarted","Data":"a54c4a3dc052585625cf9e64fb012cb0a2a2f6a6ac3c94d4b12c7edc78f32394"} Sep 18 03:37:04.393687 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:04.393360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mfpdc" event={"ID":"b1dc928f-289f-4da5-998b-62644550177b","Type":"ContainerStarted","Data":"39efbe066d177eed33d47f0a632a0fae68e940257e179100b59ca020992d9fe5"} Sep 18 03:37:04.393687 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:04.393378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mfpdc" event={"ID":"b1dc928f-289f-4da5-998b-62644550177b","Type":"ContainerStarted","Data":"b78152d14064edd68d65c1e89f05769860c5857dd4f6035762d96aad0a45052d"} Sep 18 03:37:06.401536 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:06.401500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mfpdc" event={"ID":"b1dc928f-289f-4da5-998b-62644550177b","Type":"ContainerStarted","Data":"0f726919ec19298d32bf35fc6fa64162e0a520677d2cd658e6638131c38219f1"} Sep 18 03:37:06.421346 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:06.421301 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mfpdc" podStartSLOduration=17.447811017 podStartE2EDuration="19.421286785s" totalImagesPullingTime="1.973475768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:36:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:06.420568687 +0000 UTC m=+268.177854138" watchObservedRunningTime="2026-09-18 03:37:06.421286785 +0000 UTC m=+268.178572237" Sep 18 03:37:09.775333 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:09.775298 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-868844c5c9-2j9wq"] Sep 18 03:37:09.775676 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:09.775488 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" podUID="d0a26a08-7a11-4f48-9897-835eb8d3e909" Sep 18 03:37:10.412591 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.412561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:37:10.418764 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.418740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:37:10.584775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584749 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584777 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584812 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn8fm\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.584980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.584940 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration\") pod \"d0a26a08-7a11-4f48-9897-835eb8d3e909\" (UID: \"d0a26a08-7a11-4f48-9897-835eb8d3e909\") " Sep 18 03:37:10.585265 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.585207 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:37:10.585265 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.585217 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:37:10.585367 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.585287 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:37:10.587180 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.587150 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:37:10.587292 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.587189 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:37:10.587292 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.587235 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:37:10.587292 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.587284 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm" (OuterVolumeSpecName: "kube-api-access-rn8fm") pod "d0a26a08-7a11-4f48-9897-835eb8d3e909" (UID: "d0a26a08-7a11-4f48-9897-835eb8d3e909"). InnerVolumeSpecName "kube-api-access-rn8fm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.685945 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn8fm\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-kube-api-access-rn8fm\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.685966 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-image-registry-private-configuration\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.685976 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-trusted-ca\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.685985 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0a26a08-7a11-4f48-9897-835eb8d3e909-installation-pull-secrets\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.685993 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-certificates\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686005 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.686001 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-bound-sa-token\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:10.686329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:10.686009 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0a26a08-7a11-4f48-9897-835eb8d3e909-ca-trust-extracted\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:11.415246 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:11.415213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868844c5c9-2j9wq" Sep 18 03:37:11.445238 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:11.445214 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-868844c5c9-2j9wq"] Sep 18 03:37:11.449057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:11.449035 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-868844c5c9-2j9wq"] Sep 18 03:37:11.590704 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:11.590682 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0a26a08-7a11-4f48-9897-835eb8d3e909-registry-tls\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:12.430561 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:12.430524 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a26a08-7a11-4f48-9897-835eb8d3e909" path="/var/lib/kubelet/pods/d0a26a08-7a11-4f48-9897-835eb8d3e909/volumes" Sep 18 03:37:16.082534 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.082504 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:16.086542 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.086526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.088648 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.088624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 03:37:16.088879 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.088863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 03:37:16.088932 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.088887 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 03:37:16.088979 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.088952 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 03:37:16.090025 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.090006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dbvjk\"" Sep 18 03:37:16.090176 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.090041 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 03:37:16.090176 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.090063 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 03:37:16.090176 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.090067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 03:37:16.095259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.095234 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:16.223654 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.223783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.223783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.223783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.223899 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffh9\" (UniqueName: \"kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.223899 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.223811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.324892 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.324862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffh9\" (UniqueName: \"kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.324892 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.324895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325046 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.324920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325046 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.324947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325163 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.325069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325220 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.325179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325645 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.325625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325751 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.325677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.325751 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.325729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.327414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.327393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.327493 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.327403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.332781 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.332734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffh9\" (UniqueName: \"kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9\") pod \"console-6c9799d74b-pxhs6\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.395630 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.395607 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:16.664874 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:16.664792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:16.667382 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:37:16.667355 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5b866f_4b58_4869_9c2f_d813e5e7df7b.slice/crio-91c6ea979c193d7df839222a0d0ee6c99f3804893213092996333fb3fa1de2d4 WatchSource:0}: Error finding container 91c6ea979c193d7df839222a0d0ee6c99f3804893213092996333fb3fa1de2d4: Status 404 returned error can't find the container with id 91c6ea979c193d7df839222a0d0ee6c99f3804893213092996333fb3fa1de2d4 Sep 18 03:37:17.438296 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.438234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9799d74b-pxhs6" event={"ID":"0f5b866f-4b58-4869-9c2f-d813e5e7df7b","Type":"ContainerStarted","Data":"91c6ea979c193d7df839222a0d0ee6c99f3804893213092996333fb3fa1de2d4"} Sep 18 03:37:17.796199 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.796083 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vflbz"] Sep 18 03:37:17.799311 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.799270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.802647 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.802622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 03:37:17.802847 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.802624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 03:37:17.802921 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.802856 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kzscl\"" Sep 18 03:37:17.804040 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.803795 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 03:37:17.804040 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.803797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 03:37:17.804040 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.803797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 03:37:17.804040 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.803876 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 03:37:17.938992 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.938963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-sys\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.938992 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.938992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-root\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-wtmp\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-metrics-client-ca\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxg8\" (UniqueName: \"kubernetes.io/projected/1be949b3-5124-4ef9-9906-51cf77f54d2b-kube-api-access-4dxg8\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939372 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-textfile\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:17.939372 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:17.939269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040391 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-wtmp\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-metrics-client-ca\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxg8\" (UniqueName: \"kubernetes.io/projected/1be949b3-5124-4ef9-9906-51cf77f54d2b-kube-api-access-4dxg8\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-textfile\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040560 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-sys\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-root\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-root\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040663 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-wtmp\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:18.040767 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.040816 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1be949b3-5124-4ef9-9906-51cf77f54d2b-sys\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.040863 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:18.040827 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls podName:1be949b3-5124-4ef9-9906-51cf77f54d2b nodeName:}" failed. No retries permitted until 2026-09-18 03:37:18.540807681 +0000 UTC m=+280.298093114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls") pod "node-exporter-vflbz" (UID: "1be949b3-5124-4ef9-9906-51cf77f54d2b") : secret "node-exporter-tls" not found Sep 18 03:37:18.041232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.041007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.041232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.041023 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be949b3-5124-4ef9-9906-51cf77f54d2b-metrics-client-ca\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.041232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.041084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-textfile\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.042956 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.042931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.049399 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.049349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxg8\" (UniqueName: \"kubernetes.io/projected/1be949b3-5124-4ef9-9906-51cf77f54d2b-kube-api-access-4dxg8\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.545723 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.545689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.548677 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.548651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1be949b3-5124-4ef9-9906-51cf77f54d2b-node-exporter-tls\") pod \"node-exporter-vflbz\" (UID: \"1be949b3-5124-4ef9-9906-51cf77f54d2b\") " pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:18.711623 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:18.711587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vflbz" Sep 18 03:37:19.890853 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:19.890818 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:37:19.894193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:19.894172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:19.903411 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:19.903388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 03:37:19.904794 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:19.904625 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:37:20.059261 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w749n\" (UniqueName: \"kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.059697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.059496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160548 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160548 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w749n\" (UniqueName: \"kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.160752 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.160665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.161402 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.161290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.161402 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.161330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.161402 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.161328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.161886 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.161839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.163511 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.163471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.164248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.164227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.169523 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.169496 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w749n\" (UniqueName: \"kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n\") pod \"console-7bb6c86758-vwhsh\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.206447 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.206416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:20.579183 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:37:20.579158 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be949b3_5124_4ef9_9906_51cf77f54d2b.slice/crio-7df8686384635f2e589c131bf0d5cdbfadcddee9c617c39d405c29d22e73c436 WatchSource:0}: Error finding container 7df8686384635f2e589c131bf0d5cdbfadcddee9c617c39d405c29d22e73c436: Status 404 returned error can't find the container with id 7df8686384635f2e589c131bf0d5cdbfadcddee9c617c39d405c29d22e73c436 Sep 18 03:37:20.795768 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.795734 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" podUID="79b2e1d6-85ee-48e0-a53c-aad87a41682d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 03:37:20.844265 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:20.844242 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:37:20.846447 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:37:20.846423 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9308d568_22eb_4f7b_be7f_97b2bf3bf739.slice/crio-a18ac9b9d18a03db060302625b4891370a47393350405910067c0768d7f00e55 WatchSource:0}: Error finding container a18ac9b9d18a03db060302625b4891370a47393350405910067c0768d7f00e55: Status 404 returned error can't find the container with id a18ac9b9d18a03db060302625b4891370a47393350405910067c0768d7f00e55 Sep 18 03:37:21.088742 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:21.088708 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-858r4" podUID="1b9ca056-2996-4592-9eaf-41acadb4c18b" Sep 18 03:37:21.454286 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.454247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vflbz" event={"ID":"1be949b3-5124-4ef9-9906-51cf77f54d2b","Type":"ContainerStarted","Data":"7df8686384635f2e589c131bf0d5cdbfadcddee9c617c39d405c29d22e73c436"} Sep 18 03:37:21.456179 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.456150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c86758-vwhsh" event={"ID":"9308d568-22eb-4f7b-be7f-97b2bf3bf739","Type":"ContainerStarted","Data":"a2ca9e834fda103a0780b156e8631a69390741cfc4e43a85d36ddf508d8846ea"} Sep 18 03:37:21.456320 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.456201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c86758-vwhsh" event={"ID":"9308d568-22eb-4f7b-be7f-97b2bf3bf739","Type":"ContainerStarted","Data":"a18ac9b9d18a03db060302625b4891370a47393350405910067c0768d7f00e55"} Sep 18 03:37:21.457976 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.457939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858r4" Sep 18 03:37:21.458107 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.457970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9799d74b-pxhs6" event={"ID":"0f5b866f-4b58-4869-9c2f-d813e5e7df7b","Type":"ContainerStarted","Data":"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2"} Sep 18 03:37:21.475027 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.473229 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb6c86758-vwhsh" podStartSLOduration=2.473206877 podStartE2EDuration="2.473206877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:21.471642034 +0000 UTC m=+283.228927487" watchObservedRunningTime="2026-09-18 03:37:21.473206877 +0000 UTC m=+283.230492330" Sep 18 03:37:21.489789 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:21.489754 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c9799d74b-pxhs6" podStartSLOduration=1.5160981690000002 podStartE2EDuration="5.489739227s" totalImagesPullingTime="3.973641058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:21.488479561 +0000 UTC m=+283.245765017" watchObservedRunningTime="2026-09-18 03:37:21.489739227 +0000 UTC m=+283.247024680" Sep 18 03:37:22.462613 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:22.462579 2581 generic.go:356] "Generic (PLEG): container finished" podID="1be949b3-5124-4ef9-9906-51cf77f54d2b" containerID="3d01e86c48ead8b7503fcef1ed57df7e66dcf237c56ec17262f882eb19e3f9ba" exitCode=0 Sep 18 03:37:22.463001 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:22.462658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vflbz" event={"ID":"1be949b3-5124-4ef9-9906-51cf77f54d2b","Type":"ContainerDied","Data":"3d01e86c48ead8b7503fcef1ed57df7e66dcf237c56ec17262f882eb19e3f9ba"} Sep 18 03:37:23.468408 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:23.468372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vflbz" event={"ID":"1be949b3-5124-4ef9-9906-51cf77f54d2b","Type":"ContainerStarted","Data":"e90b302a20fd3aaa687ecfeced054f649cc5ee24b65ed43953a0352b3b763bba"} Sep 18 03:37:23.468783 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:23.468424 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vflbz" event={"ID":"1be949b3-5124-4ef9-9906-51cf77f54d2b","Type":"ContainerStarted","Data":"cd549b5a112ae8ee3b41cd07131f1c3f900b42c27843cb998f15a2784defcc1b"} Sep 18 03:37:23.487259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:23.487214 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vflbz" podStartSLOduration=5.449390341 podStartE2EDuration="6.487199953s" totalImagesPullingTime="977.161103ms" totalInitContainerRuntime="60.648509ms" isStatefulPod=true podCreationTimestamp="2026-09-18 03:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:23.486344626 +0000 UTC m=+285.243630077" watchObservedRunningTime="2026-09-18 03:37:23.487199953 +0000 UTC m=+285.244485405" Sep 18 03:37:23.989768 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:23.989731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:37:23.991954 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:23.991925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9ca056-2996-4592-9eaf-41acadb4c18b-metrics-tls\") pod \"dns-default-858r4\" (UID: \"1b9ca056-2996-4592-9eaf-41acadb4c18b\") " pod="openshift-dns/dns-default-858r4" Sep 18 03:37:24.160792 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:24.160763 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fvk6\"" Sep 18 03:37:24.168724 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:24.168703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858r4" Sep 18 03:37:24.434669 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:24.434632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-858r4"] Sep 18 03:37:24.437528 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:37:24.437502 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9ca056_2996_4592_9eaf_41acadb4c18b.slice/crio-369c61d8266dd418c000cf4aeeb05d4e6c7eea9514fe1246fb61f9b6ed3faabe WatchSource:0}: Error finding container 369c61d8266dd418c000cf4aeeb05d4e6c7eea9514fe1246fb61f9b6ed3faabe: Status 404 returned error can't find the container with id 369c61d8266dd418c000cf4aeeb05d4e6c7eea9514fe1246fb61f9b6ed3faabe Sep 18 03:37:24.472277 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:24.472254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858r4" event={"ID":"1b9ca056-2996-4592-9eaf-41acadb4c18b","Type":"ContainerStarted","Data":"369c61d8266dd418c000cf4aeeb05d4e6c7eea9514fe1246fb61f9b6ed3faabe"} Sep 18 03:37:26.395869 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.395842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:26.396215 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.395939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:26.396991 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.396964 2581 patch_prober.go:28] interesting pod/console-6c9799d74b-pxhs6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body= Sep 18 03:37:26.397064 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.397024 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c9799d74b-pxhs6" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" Sep 18 03:37:26.480460 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.480434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858r4" event={"ID":"1b9ca056-2996-4592-9eaf-41acadb4c18b","Type":"ContainerStarted","Data":"a62ddbe2c2c491fd6dd07c7c7fe402c243521dc51298328ed12f0a061c5d17db"} Sep 18 03:37:26.480582 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.480475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858r4" event={"ID":"1b9ca056-2996-4592-9eaf-41acadb4c18b","Type":"ContainerStarted","Data":"7e18dbb93073b89a66c5162b8707072e3ad27df38de92ff79d54635af340f376"} Sep 18 03:37:26.480582 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.480513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-858r4" Sep 18 03:37:26.499017 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:26.498946 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-858r4" podStartSLOduration=250.695072771 podStartE2EDuration="4m12.498931307s" totalImagesPullingTime="1.803858536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:26.497731789 +0000 UTC m=+288.255017238" watchObservedRunningTime="2026-09-18 03:37:26.498931307 +0000 UTC m=+288.256216758" Sep 18 03:37:27.495254 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:27.495226 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:30.207043 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:30.207010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:30.207462 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:30.207081 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:37:30.208518 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:30.208496 2581 patch_prober.go:28] interesting pod/console-7bb6c86758-vwhsh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Sep 18 03:37:30.208643 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:30.208537 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bb6c86758-vwhsh" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Sep 18 03:37:30.795649 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:30.795610 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" podUID="79b2e1d6-85ee-48e0-a53c-aad87a41682d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 03:37:32.428194 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:32.428156 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dxgp9" podUID="c785c2d6-dea7-430c-b917-a07c884f1fd3" Sep 18 03:37:36.486485 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:36.486457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-858r4" Sep 18 03:37:38.519653 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:38.519579 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b425a24-5b97-493e-979d-b0e878980817" containerID="d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b" exitCode=1 Sep 18 03:37:38.519653 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:38.519617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerDied","Data":"d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b"} Sep 18 03:37:38.520143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:38.519671 2581 scope.go:117] "RemoveContainer" containerID="4c0a9dd02dc4af68958e628564849892cd8dbc436c8a1c473b940b0cbb3eefcc" Sep 18 03:37:38.520143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:38.519960 2581 scope.go:117] "RemoveContainer" containerID="d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b" Sep 18 03:37:38.520246 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:38.520140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-567667fbcc-skxnt_open-cluster-management-agent-addon(8b425a24-5b97-493e-979d-b0e878980817)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" podUID="8b425a24-5b97-493e-979d-b0e878980817" Sep 18 03:37:39.152238 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:39.152204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:37:39.524986 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:39.524924 2581 scope.go:117] "RemoveContainer" containerID="d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b" Sep 18 03:37:39.525351 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:39.525065 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-567667fbcc-skxnt_open-cluster-management-agent-addon(8b425a24-5b97-493e-979d-b0e878980817)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" podUID="8b425a24-5b97-493e-979d-b0e878980817" Sep 18 03:37:40.207247 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.207210 2581 patch_prober.go:28] interesting pod/console-7bb6c86758-vwhsh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Sep 18 03:37:40.207428 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.207264 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bb6c86758-vwhsh" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Sep 18 03:37:40.344585 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.344561 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 03:37:40.763686 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.763658 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:37:40.776557 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.764002 2581 scope.go:117] "RemoveContainer" containerID="d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b" Sep 18 03:37:40.776557 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:40.764173 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-567667fbcc-skxnt_open-cluster-management-agent-addon(8b425a24-5b97-493e-979d-b0e878980817)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" podUID="8b425a24-5b97-493e-979d-b0e878980817" Sep 18 03:37:40.795595 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.795560 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" podUID="79b2e1d6-85ee-48e0-a53c-aad87a41682d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 03:37:40.795725 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.795629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" Sep 18 03:37:40.796051 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.796022 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9f132576458f32e880aa7e34ca00fc5629e5f02d09564188041fc02609d685ed"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 18 03:37:40.796115 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:40.796068 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" podUID="79b2e1d6-85ee-48e0-a53c-aad87a41682d" containerName="service-proxy" containerID="cri-o://9f132576458f32e880aa7e34ca00fc5629e5f02d09564188041fc02609d685ed" gracePeriod=30 Sep 18 03:37:41.532472 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:41.532439 2581 generic.go:356] "Generic (PLEG): container finished" podID="79b2e1d6-85ee-48e0-a53c-aad87a41682d" containerID="9f132576458f32e880aa7e34ca00fc5629e5f02d09564188041fc02609d685ed" exitCode=2 Sep 18 03:37:41.532631 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:41.532491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerDied","Data":"9f132576458f32e880aa7e34ca00fc5629e5f02d09564188041fc02609d685ed"} Sep 18 03:37:41.532631 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:41.532522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-df56dc7dc-sdtlt" event={"ID":"79b2e1d6-85ee-48e0-a53c-aad87a41682d","Type":"ContainerStarted","Data":"0b21950467a6b7a2f8230254f6dcea99a21a820118df57deb00363fea7201164"} Sep 18 03:37:43.426557 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:43.426511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:37:48.471227 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:48.471196 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:37:52.513546 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.513486 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c9799d74b-pxhs6" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerName="console" containerID="cri-o://c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2" gracePeriod=15 Sep 18 03:37:52.750466 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.750445 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:52.787775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787720 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.787775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787768 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.787958 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.787958 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787817 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.787958 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787943 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rffh9\" (UniqueName: \"kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.788138 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.787993 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert\") pod \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\" (UID: \"0f5b866f-4b58-4869-9c2f-d813e5e7df7b\") " Sep 18 03:37:52.788201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.788147 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config" (OuterVolumeSpecName: "console-config") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:37:52.788201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.788169 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:37:52.788297 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.788267 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-service-ca\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:52.788400 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.788382 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:52.788469 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.788422 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:37:52.789972 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.789950 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:37:52.790066 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.789989 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:37:52.790066 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.790000 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9" (OuterVolumeSpecName: "kube-api-access-rffh9") pod "0f5b866f-4b58-4869-9c2f-d813e5e7df7b" (UID: "0f5b866f-4b58-4869-9c2f-d813e5e7df7b"). InnerVolumeSpecName "kube-api-access-rffh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:37:52.888906 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.888886 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-oauth-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:52.888906 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.888903 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-console-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:52.889038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.888913 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rffh9\" (UniqueName: \"kubernetes.io/projected/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-kube-api-access-rffh9\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:52.889038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:52.888922 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5b866f-4b58-4869-9c2f-d813e5e7df7b-oauth-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:37:53.427165 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.427136 2581 scope.go:117] "RemoveContainer" containerID="d4d0173ec8c0b7533a419b49fdfa9b1423d56349a3da66f9a32594ee54f7b92b" Sep 18 03:37:53.568638 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.568605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" event={"ID":"8b425a24-5b97-493e-979d-b0e878980817","Type":"ContainerStarted","Data":"0dd5ef76d6bee54512f7e04b0a7a5aeefcef2bf44cf7f7e7c4ef7cf3aeb6430e"} Sep 18 03:37:53.569007 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.568901 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:37:53.570084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570061 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567667fbcc-skxnt" Sep 18 03:37:53.570084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570074 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerID="c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2" exitCode=0 Sep 18 03:37:53.570248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570099 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9799d74b-pxhs6" event={"ID":"0f5b866f-4b58-4869-9c2f-d813e5e7df7b","Type":"ContainerDied","Data":"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2"} Sep 18 03:37:53.570248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570137 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9799d74b-pxhs6" event={"ID":"0f5b866f-4b58-4869-9c2f-d813e5e7df7b","Type":"ContainerDied","Data":"91c6ea979c193d7df839222a0d0ee6c99f3804893213092996333fb3fa1de2d4"} Sep 18 03:37:53.570248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570157 2581 scope.go:117] "RemoveContainer" containerID="c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2" Sep 18 03:37:53.570248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.570169 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9799d74b-pxhs6" Sep 18 03:37:53.578258 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.578237 2581 scope.go:117] "RemoveContainer" containerID="c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2" Sep 18 03:37:53.578509 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:37:53.578491 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2\": container with ID starting with c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2 not found: ID does not exist" containerID="c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2" Sep 18 03:37:53.578571 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.578519 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2"} err="failed to get container status \"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2\": rpc error: code = NotFound desc = could not find container \"c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2\": container with ID starting with c6f279d92d57e0f319c665f3107bc1853b850fb479b4896257c9dcdcdd4d50e2 not found: ID does not exist" Sep 18 03:37:53.598001 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.597981 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:53.605944 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:53.605926 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c9799d74b-pxhs6"] Sep 18 03:37:54.430837 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:37:54.430804 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" path="/var/lib/kubelet/pods/0f5b866f-4b58-4869-9c2f-d813e5e7df7b/volumes" Sep 18 03:38:13.489239 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.489172 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bb6c86758-vwhsh" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" containerID="cri-o://a2ca9e834fda103a0780b156e8631a69390741cfc4e43a85d36ddf508d8846ea" gracePeriod=15 Sep 18 03:38:13.635377 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.635333 2581 generic.go:356] "Generic (PLEG): container finished" podID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerID="a2ca9e834fda103a0780b156e8631a69390741cfc4e43a85d36ddf508d8846ea" exitCode=0 Sep 18 03:38:13.635505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.635398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c86758-vwhsh" event={"ID":"9308d568-22eb-4f7b-be7f-97b2bf3bf739","Type":"ContainerDied","Data":"a2ca9e834fda103a0780b156e8631a69390741cfc4e43a85d36ddf508d8846ea"} Sep 18 03:38:13.721404 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.721382 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:38:13.829897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.829869 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.829911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.829941 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.829960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.829981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830000 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w749n\" (UniqueName: \"kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830337 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830144 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config\") pod \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\" (UID: \"9308d568-22eb-4f7b-be7f-97b2bf3bf739\") " Sep 18 03:38:13.830393 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830360 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca" (OuterVolumeSpecName: "service-ca") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:13.830445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830430 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:13.830501 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830470 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:13.830630 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.830612 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config" (OuterVolumeSpecName: "console-config") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:13.832129 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.832094 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:13.832540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.832522 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:13.832592 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.832550 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n" (OuterVolumeSpecName: "kube-api-access-w749n") pod "9308d568-22eb-4f7b-be7f-97b2bf3bf739" (UID: "9308d568-22eb-4f7b-be7f-97b2bf3bf739"). InnerVolumeSpecName "kube-api-access-w749n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:13.930941 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930918 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w749n\" (UniqueName: \"kubernetes.io/projected/9308d568-22eb-4f7b-be7f-97b2bf3bf739-kube-api-access-w749n\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.930941 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930937 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-oauth-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.931072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930947 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-service-ca\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.931072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930955 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.931072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930963 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-trusted-ca-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.931072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930971 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-console-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:13.931072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:13.930979 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9308d568-22eb-4f7b-be7f-97b2bf3bf739-oauth-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:38:14.640170 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:14.640145 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c86758-vwhsh" Sep 18 03:38:14.640520 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:14.640133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c86758-vwhsh" event={"ID":"9308d568-22eb-4f7b-be7f-97b2bf3bf739","Type":"ContainerDied","Data":"a18ac9b9d18a03db060302625b4891370a47393350405910067c0768d7f00e55"} Sep 18 03:38:14.640520 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:14.640270 2581 scope.go:117] "RemoveContainer" containerID="a2ca9e834fda103a0780b156e8631a69390741cfc4e43a85d36ddf508d8846ea" Sep 18 03:38:14.654426 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:14.654401 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:38:14.658041 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:14.658022 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb6c86758-vwhsh"] Sep 18 03:38:16.431274 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:16.431240 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" path="/var/lib/kubelet/pods/9308d568-22eb-4f7b-be7f-97b2bf3bf739/volumes" Sep 18 03:38:36.197478 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197441 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197659 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerName="console" Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197669 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerName="console" Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197681 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197687 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197724 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f5b866f-4b58-4869-9c2f-d813e5e7df7b" containerName="console" Sep 18 03:38:36.197888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.197732 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9308d568-22eb-4f7b-be7f-97b2bf3bf739" containerName="console" Sep 18 03:38:36.201779 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.201762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.204427 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.204404 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 03:38:36.204553 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.204412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 03:38:36.205379 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 03:38:36.205476 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205426 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 03:38:36.205577 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 03:38:36.205577 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205495 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 03:38:36.205577 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dbvjk\"" Sep 18 03:38:36.205763 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.205634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 03:38:36.209537 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.209521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 03:38:36.211647 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.211627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:38:36.283686 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283805 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283805 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283885 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283885 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58t8\" (UniqueName: \"kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283962 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.283962 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.283932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384588 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58t8\" (UniqueName: \"kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.384949 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.384821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.385467 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.385437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.385570 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.385462 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.385570 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.385465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.385644 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.385617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.387097 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.387075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.387250 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.387230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.392027 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.392004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58t8\" (UniqueName: \"kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8\") pod \"console-cfbf689b5-fmm5d\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.511108 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.511044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:36.778855 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:36.778782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:38:36.782631 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:38:36.782606 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68c46a2_d258_433e_9a82_c35cc3a08540.slice/crio-60c65800d76811f46295ea3464db90c86afceff28069d466276e3fdcc5d456e3 WatchSource:0}: Error finding container 60c65800d76811f46295ea3464db90c86afceff28069d466276e3fdcc5d456e3: Status 404 returned error can't find the container with id 60c65800d76811f46295ea3464db90c86afceff28069d466276e3fdcc5d456e3 Sep 18 03:38:37.715630 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:37.715599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbf689b5-fmm5d" event={"ID":"d68c46a2-d258-433e-9a82-c35cc3a08540","Type":"ContainerStarted","Data":"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11"} Sep 18 03:38:37.715630 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:37.715643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbf689b5-fmm5d" event={"ID":"d68c46a2-d258-433e-9a82-c35cc3a08540","Type":"ContainerStarted","Data":"60c65800d76811f46295ea3464db90c86afceff28069d466276e3fdcc5d456e3"} Sep 18 03:38:37.732050 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:37.732007 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cfbf689b5-fmm5d" podStartSLOduration=1.7319941939999999 podStartE2EDuration="1.731994194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:38:37.730730216 +0000 UTC m=+359.488015668" watchObservedRunningTime="2026-09-18 03:38:37.731994194 +0000 UTC m=+359.489279646" Sep 18 03:38:46.512171 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:46.512136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:46.512628 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:46.512202 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:46.516680 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:46.516660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:46.749266 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:46.749239 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:38:54.200111 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.200077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:38:54.202407 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.202373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c785c2d6-dea7-430c-b917-a07c884f1fd3-metrics-certs\") pod \"network-metrics-daemon-dxgp9\" (UID: \"c785c2d6-dea7-430c-b917-a07c884f1fd3\") " pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:38:54.229431 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.229408 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p5fh\"" Sep 18 03:38:54.237355 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.237333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dxgp9" Sep 18 03:38:54.502447 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.502377 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dxgp9"] Sep 18 03:38:54.506864 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:38:54.506834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc785c2d6_dea7_430c_b917_a07c884f1fd3.slice/crio-70aaafa14fef45dacbe5e71dda3feddb20979a5fb1bb3e1421a1554873949eb5 WatchSource:0}: Error finding container 70aaafa14fef45dacbe5e71dda3feddb20979a5fb1bb3e1421a1554873949eb5: Status 404 returned error can't find the container with id 70aaafa14fef45dacbe5e71dda3feddb20979a5fb1bb3e1421a1554873949eb5 Sep 18 03:38:54.508753 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.508734 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:38:54.775045 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:54.774966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxgp9" event={"ID":"c785c2d6-dea7-430c-b917-a07c884f1fd3","Type":"ContainerStarted","Data":"70aaafa14fef45dacbe5e71dda3feddb20979a5fb1bb3e1421a1554873949eb5"} Sep 18 03:38:55.780264 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:55.780228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxgp9" event={"ID":"c785c2d6-dea7-430c-b917-a07c884f1fd3","Type":"ContainerStarted","Data":"e84697130b97b72487fd338da0645ce8e34ba7ae0967615ec067b0a80b6dc3c1"} Sep 18 03:38:55.780629 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:55.780281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dxgp9" event={"ID":"c785c2d6-dea7-430c-b917-a07c884f1fd3","Type":"ContainerStarted","Data":"f92cc966ef6b56a903fcdaeb67f52ca29982ce538bf69c16a46951fe957eda3c"} Sep 18 03:38:55.795611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:38:55.795566 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dxgp9" podStartSLOduration=374.729252162 podStartE2EDuration="6m15.795551574s" totalImagesPullingTime="1.066299412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:38:55.794300784 +0000 UTC m=+377.551586235" watchObservedRunningTime="2026-09-18 03:38:55.795551574 +0000 UTC m=+377.552837023" Sep 18 03:39:51.864732 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.864697 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8"] Sep 18 03:39:51.868540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.868523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:51.871197 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.871169 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p89h2\"" Sep 18 03:39:51.871305 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.871205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 03:39:51.872488 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.872469 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 03:39:51.873967 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.873945 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8"] Sep 18 03:39:51.964918 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.964889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bgr\" (UniqueName: \"kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:51.965018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.964941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:51.965018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:51.964968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.065900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.065875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.065987 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.065902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.065987 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.065935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bgr\" (UniqueName: \"kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.066280 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.066264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.066323 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.066300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.073867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.073843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bgr\" (UniqueName: \"kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.178872 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.178822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:39:52.445396 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.445374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8"] Sep 18 03:39:52.447708 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:52.447684 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8555a219_f59a_4b03_9c0b_2dbc7c46f047.slice/crio-d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1 WatchSource:0}: Error finding container d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1: Status 404 returned error can't find the container with id d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1 Sep 18 03:39:52.912962 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.912932 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8"] Sep 18 03:39:52.915988 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.915971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:52.922547 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.922524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8"] Sep 18 03:39:52.971527 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.971495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerStarted","Data":"d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1"} Sep 18 03:39:52.972721 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.972700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:52.972834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.972736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l56n4\" (UniqueName: \"kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:52.972834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:52.972774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.073632 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.073604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.073632 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.073633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l56n4\" (UniqueName: \"kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.073833 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.073666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.074041 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.074018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.074141 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.074042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.085207 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.085174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l56n4\" (UniqueName: \"kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.227852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.227788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:39:53.508003 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.507926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8"] Sep 18 03:39:53.510956 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:53.510921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfed3163_3cfe_47bd_9e09_5a7d8d492426.slice/crio-474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef WatchSource:0}: Error finding container 474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef: Status 404 returned error can't find the container with id 474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef Sep 18 03:39:53.554196 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.554171 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7"] Sep 18 03:39:53.558684 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.558664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.565113 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.565089 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7"] Sep 18 03:39:53.576977 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.576946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn44b\" (UniqueName: \"kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.577048 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.576997 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.577102 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.577055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.651888 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.651859 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k"] Sep 18 03:39:53.655274 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.655254 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.663112 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.662197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k"] Sep 18 03:39:53.678342 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.678462 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.678462 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.678568 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn44b\" (UniqueName: \"kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.678568 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.678568 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hx5q\" (UniqueName: \"kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.678737 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.678872 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.678851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.686172 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.686153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn44b\" (UniqueName: \"kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.752892 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.752869 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt"] Sep 18 03:39:53.756142 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.756113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.763837 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.763432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt"] Sep 18 03:39:53.779593 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.779706 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.779706 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.779822 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hx5q\" (UniqueName: \"kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.779822 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25wv\" (UniqueName: \"kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.779822 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.779951 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.779902 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.780054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.780035 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.788077 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.788051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hx5q\" (UniqueName: \"kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.852878 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.852790 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr"] Sep 18 03:39:53.856146 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.856074 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.863638 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.863592 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr"] Sep 18 03:39:53.870984 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.870936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:39:53.880328 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.880425 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.880489 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25wv\" (UniqueName: \"kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.880489 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.880595 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59s2x\" (UniqueName: \"kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.880595 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.880921 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.880881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.881043 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.881022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.889326 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.889286 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25wv\" (UniqueName: \"kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:53.966156 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.966113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:39:53.977107 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.977072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerStarted","Data":"474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef"} Sep 18 03:39:53.981200 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.981172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.981304 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.981259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59s2x\" (UniqueName: \"kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.981361 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.981311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.981611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.981580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.981701 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.981616 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:53.991046 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:53.991018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59s2x\" (UniqueName: \"kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:54.066435 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.066400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:39:54.154732 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.154255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7"] Sep 18 03:39:54.161249 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:54.161214 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa3365e_abe5_48a5_94e5_6c234f6eb2d4.slice/crio-bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0 WatchSource:0}: Error finding container bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0: Status 404 returned error can't find the container with id bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0 Sep 18 03:39:54.167309 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.167265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:39:54.250514 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.250481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k"] Sep 18 03:39:54.255098 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:54.255071 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ffa166_5b3f_4477_90a9_21a9becab3b7.slice/crio-c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c WatchSource:0}: Error finding container c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c: Status 404 returned error can't find the container with id c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c Sep 18 03:39:54.348933 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.348855 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt"] Sep 18 03:39:54.351856 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:54.351801 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f57538_61b3_43ca_889f_57777c2c2bfb.slice/crio-a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f WatchSource:0}: Error finding container a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f: Status 404 returned error can't find the container with id a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f Sep 18 03:39:54.451757 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.451725 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr"] Sep 18 03:39:54.455971 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:54.455940 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f07db4_c2d6_49c0_9754_4edc3ecd935f.slice/crio-cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7 WatchSource:0}: Error finding container cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7: Status 404 returned error can't find the container with id cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7 Sep 18 03:39:54.992632 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.992556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" event={"ID":"71f57538-61b3-43ca-889f-57777c2c2bfb","Type":"ContainerStarted","Data":"a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f"} Sep 18 03:39:54.996312 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:54.996279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" event={"ID":"14ffa166-5b3f-4477-90a9-21a9becab3b7","Type":"ContainerStarted","Data":"c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c"} Sep 18 03:39:55.000210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:55.000138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" event={"ID":"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4","Type":"ContainerStarted","Data":"bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0"} Sep 18 03:39:55.005917 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:55.005757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerStarted","Data":"cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7"} Sep 18 03:39:56.385514 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.384205 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr"] Sep 18 03:39:56.387759 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.387735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.393533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.392672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 03:39:56.393533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.392915 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-maas-gateway-class-dockercfg-kqgck\"" Sep 18 03:39:56.393533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.393158 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 03:39:56.393533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.393377 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 03:39:56.398555 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.398193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr"] Sep 18 03:39:56.401072 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-podinfo\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401177 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-credential-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401177 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-envoy\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401286 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz6km\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-kube-api-access-tz6km\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401286 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-certs\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401286 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401439 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-data\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401439 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f8fccd-e37a-40b5-b415-12ff68efe92f-istiod-ca-cert\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.401439 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.401356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-token\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.451142 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.450160 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52"] Sep 18 03:39:56.454875 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.453962 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.457654 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.457213 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-qnlx8\"" Sep 18 03:39:56.483276 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.475993 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52"] Sep 18 03:39:56.501934 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.501887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-certs\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.501934 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.501929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.502134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.501972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.502134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.502134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-data\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.502134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f8fccd-e37a-40b5-b415-12ff68efe92f-istiod-ca-cert\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.502134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-token\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.502559 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-certs\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.502834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.502809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-data\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.503745 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.503467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f8fccd-e37a-40b5-b415-12ff68efe92f-istiod-ca-cert\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.503847 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.503691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-workload-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.504195 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504195 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504369 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6zs\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-kube-api-access-2f6zs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504369 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-podinfo\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.504369 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-credential-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.504369 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504369 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99247e30-c704-43dd-82dd-be97bce7f8c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-envoy\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.504611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz6km\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-kube-api-access-tz6km\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.504611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.504611 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.504466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.505227 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.505103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-credential-socket\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.509419 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.509395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-envoy\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.524407 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.517598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-token\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.524407 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.518656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz6km\" (UniqueName: \"kubernetes.io/projected/54f8fccd-e37a-40b5-b415-12ff68efe92f-kube-api-access-tz6km\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.525716 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.525595 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f8fccd-e37a-40b5-b415-12ff68efe92f-istio-podinfo\") pod \"maas-default-gateway-maas-gateway-class-5766995b44-t6cbr\" (UID: \"54f8fccd-e37a-40b5-b415-12ff68efe92f\") " pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.605892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.605950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.605994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6zs\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-kube-api-access-2f6zs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.606221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99247e30-c704-43dd-82dd-be97bce7f8c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.607004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99247e30-c704-43dd-82dd-be97bce7f8c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.607478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.608331 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.608002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.609834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.609516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.609834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.609774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.612600 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.612560 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.617041 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.617019 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.621824 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.621799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.623518 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.623493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6zs\" (UniqueName: \"kubernetes.io/projected/99247e30-c704-43dd-82dd-be97bce7f8c1-kube-api-access-2f6zs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52\" (UID: \"99247e30-c704-43dd-82dd-be97bce7f8c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:56.707689 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.707523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:39:56.777261 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:56.776944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:39:57.016877 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:57.016803 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr"] Sep 18 03:39:57.089804 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:57.089741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52"] Sep 18 03:39:57.096138 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:39:57.096084 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99247e30_c704_43dd_82dd_be97bce7f8c1.slice/crio-db91581d91c31981ded944c90be131cfe2729af7db064ed0c4773185db3a6c0f WatchSource:0}: Error finding container db91581d91c31981ded944c90be131cfe2729af7db064ed0c4773185db3a6c0f: Status 404 returned error can't find the container with id db91581d91c31981ded944c90be131cfe2729af7db064ed0c4773185db3a6c0f Sep 18 03:39:58.035251 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:58.035165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" event={"ID":"99247e30-c704-43dd-82dd-be97bce7f8c1","Type":"ContainerStarted","Data":"db91581d91c31981ded944c90be131cfe2729af7db064ed0c4773185db3a6c0f"} Sep 18 03:39:58.039644 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:39:58.039610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" event={"ID":"54f8fccd-e37a-40b5-b415-12ff68efe92f","Type":"ContainerStarted","Data":"b031e28ceee5a2538ca9532d81752a0bc96542d5e402e27a895447ef84fc6553"} Sep 18 03:40:02.062422 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.062334 2581 generic.go:356] "Generic (PLEG): container finished" podID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerID="4a6cd6d03abcdd54fbcf98671ba1cea289950b87bc6be67b6e90fa74ab6b203f" exitCode=0 Sep 18 03:40:02.062901 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.062449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerDied","Data":"4a6cd6d03abcdd54fbcf98671ba1cea289950b87bc6be67b6e90fa74ab6b203f"} Sep 18 03:40:02.064541 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.064441 2581 generic.go:356] "Generic (PLEG): container finished" podID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerID="13f19e0c26ef2f82d2c343fa85ad24dccb065dfdd112d34bdb80257a9d205561" exitCode=0 Sep 18 03:40:02.064541 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.064476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerDied","Data":"13f19e0c26ef2f82d2c343fa85ad24dccb065dfdd112d34bdb80257a9d205561"} Sep 18 03:40:02.067311 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.067289 2581 generic.go:356] "Generic (PLEG): container finished" podID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerID="d5eb72203ad1f08d4f9b1f43dfcf3876a9931ab6ae780cf75a8401b70262b811" exitCode=0 Sep 18 03:40:02.067400 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.067390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" event={"ID":"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4","Type":"ContainerDied","Data":"d5eb72203ad1f08d4f9b1f43dfcf3876a9931ab6ae780cf75a8401b70262b811"} Sep 18 03:40:02.069732 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.069708 2581 generic.go:356] "Generic (PLEG): container finished" podID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerID="132ac665369dd656e7654acb976149504939ab221e764b6d823a64e84da4ceb0" exitCode=0 Sep 18 03:40:02.069824 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.069785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" event={"ID":"71f57538-61b3-43ca-889f-57777c2c2bfb","Type":"ContainerDied","Data":"132ac665369dd656e7654acb976149504939ab221e764b6d823a64e84da4ceb0"} Sep 18 03:40:02.072775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.072720 2581 generic.go:356] "Generic (PLEG): container finished" podID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerID="b9c71cdbb58114a1a9cd5b6eab72def35dee86739ef772bea72e7790afd1b4e5" exitCode=0 Sep 18 03:40:02.072835 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.072800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" event={"ID":"14ffa166-5b3f-4477-90a9-21a9becab3b7","Type":"ContainerDied","Data":"b9c71cdbb58114a1a9cd5b6eab72def35dee86739ef772bea72e7790afd1b4e5"} Sep 18 03:40:02.074714 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.074690 2581 generic.go:356] "Generic (PLEG): container finished" podID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerID="90cce2114c31739169384424812d892320a52de5c57ceddd11e13ff719d02e4e" exitCode=0 Sep 18 03:40:02.074877 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:02.074738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerDied","Data":"90cce2114c31739169384424812d892320a52de5c57ceddd11e13ff719d02e4e"} Sep 18 03:40:03.699173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.699114 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:03.699417 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.699223 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:03.699417 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.699265 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:03.708201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.708174 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:03.708270 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.708231 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:03.708270 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:03.708260 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:04.090808 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.090770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" event={"ID":"54f8fccd-e37a-40b5-b415-12ff68efe92f","Type":"ContainerStarted","Data":"b5f09967e537eed747c585c8c7fe9d6556470fdeddb37c6b95e986e941cfe612"} Sep 18 03:40:04.092965 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.092936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" event={"ID":"99247e30-c704-43dd-82dd-be97bce7f8c1","Type":"ContainerStarted","Data":"9ece4b1babf778580d51ffef23f823f8027b22b005ab75f6d347b30a099d0004"} Sep 18 03:40:04.094998 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.094974 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerStarted","Data":"489bf77d44b9012bfac2215d44e40ee570fb54dd0a21d01855a120e95cf1c2f7"} Sep 18 03:40:04.110794 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.110684 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" podStartSLOduration=1.444205106 podStartE2EDuration="8.11066611s" totalImagesPullingTime="6.666461004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:04.108500016 +0000 UTC m=+445.865785487" watchObservedRunningTime="2026-09-18 03:40:04.11066611 +0000 UTC m=+445.867951564" Sep 18 03:40:04.140134 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.140086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" podStartSLOduration=1.5342704889999998 podStartE2EDuration="8.140073612s" totalImagesPullingTime="6.605803123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:04.139327761 +0000 UTC m=+445.896613211" watchObservedRunningTime="2026-09-18 03:40:04.140073612 +0000 UTC m=+445.897359064" Sep 18 03:40:04.708393 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.708320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:40:04.714214 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.714186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:40:04.778098 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.778069 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:40:04.783080 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:04.783058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:40:05.101658 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.101620 2581 generic.go:356] "Generic (PLEG): container finished" podID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerID="8daed125e1dcbaca6b57749ab131d677b684bafbf277d728bd423d93c9b46589" exitCode=0 Sep 18 03:40:05.102153 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.101743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" event={"ID":"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4","Type":"ContainerDied","Data":"8daed125e1dcbaca6b57749ab131d677b684bafbf277d728bd423d93c9b46589"} Sep 18 03:40:05.104180 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.104154 2581 generic.go:356] "Generic (PLEG): container finished" podID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerID="af1d067358f8f1bb1d2979518c33bd222c4d87b1ce104c01d4dd7e5b32be4502" exitCode=0 Sep 18 03:40:05.104289 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.104245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" event={"ID":"71f57538-61b3-43ca-889f-57777c2c2bfb","Type":"ContainerDied","Data":"af1d067358f8f1bb1d2979518c33bd222c4d87b1ce104c01d4dd7e5b32be4502"} Sep 18 03:40:05.106666 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.106634 2581 generic.go:356] "Generic (PLEG): container finished" podID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerID="79de2df330951e1116eeb37b7746ac4d8e61394e9b48ac2d88fddc1eddbedb15" exitCode=0 Sep 18 03:40:05.106775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.106706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" event={"ID":"14ffa166-5b3f-4477-90a9-21a9becab3b7","Type":"ContainerDied","Data":"79de2df330951e1116eeb37b7746ac4d8e61394e9b48ac2d88fddc1eddbedb15"} Sep 18 03:40:05.108987 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.108967 2581 generic.go:356] "Generic (PLEG): container finished" podID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerID="279bf259f35f04907f9b9e10bfcee3fcd25281c4c0ee6409b4c1193f58ef5aa8" exitCode=0 Sep 18 03:40:05.109080 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.109051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerDied","Data":"279bf259f35f04907f9b9e10bfcee3fcd25281c4c0ee6409b4c1193f58ef5aa8"} Sep 18 03:40:05.111186 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.111164 2581 generic.go:356] "Generic (PLEG): container finished" podID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerID="489bf77d44b9012bfac2215d44e40ee570fb54dd0a21d01855a120e95cf1c2f7" exitCode=0 Sep 18 03:40:05.111278 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.111248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerDied","Data":"489bf77d44b9012bfac2215d44e40ee570fb54dd0a21d01855a120e95cf1c2f7"} Sep 18 03:40:05.111897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.111468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:40:05.111897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.111795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:40:05.112505 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.112489 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52" Sep 18 03:40:05.112995 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:05.112974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-maas-gateway-class-5766995b44-t6cbr" Sep 18 03:40:06.141260 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:06.139603 2581 generic.go:356] "Generic (PLEG): container finished" podID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerID="8addff969459712978b9487d569c566daa4f6eb53d6e4f5791b427421862647f" exitCode=0 Sep 18 03:40:06.141260 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:06.139869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerDied","Data":"8addff969459712978b9487d569c566daa4f6eb53d6e4f5791b427421862647f"} Sep 18 03:40:14.721606 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.721573 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6"] Sep 18 03:40:14.725379 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.725359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.728096 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.728021 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 18 03:40:14.728096 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.728063 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:40:14.728375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.728201 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mnj6p\"" Sep 18 03:40:14.737507 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.737486 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6"] Sep 18 03:40:14.881514 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.881454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd73052-adca-43e3-bab6-638815dc66fe-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.881734 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.881535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5pwc\" (UniqueName: \"kubernetes.io/projected/8bd73052-adca-43e3-bab6-638815dc66fe-kube-api-access-f5pwc\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.982835 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.982770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd73052-adca-43e3-bab6-638815dc66fe-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.982835 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.982807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5pwc\" (UniqueName: \"kubernetes.io/projected/8bd73052-adca-43e3-bab6-638815dc66fe-kube-api-access-f5pwc\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.983214 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.983192 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd73052-adca-43e3-bab6-638815dc66fe-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:14.990833 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:14.990811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5pwc\" (UniqueName: \"kubernetes.io/projected/8bd73052-adca-43e3-bab6-638815dc66fe-kube-api-access-f5pwc\") pod \"cert-manager-operator-controller-manager-684f79c9b9-dqlh6\" (UID: \"8bd73052-adca-43e3-bab6-638815dc66fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:15.036618 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.036594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" Sep 18 03:40:15.204731 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.204698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerStarted","Data":"6e8daf4694716f865287402c256b4476629a672bb5588305cc1204a8ee7f775c"} Sep 18 03:40:15.206797 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.206766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerStarted","Data":"43ef6536e76e990bdaee39276891fa11dff861a7edff8a635b0727630c4a6343"} Sep 18 03:40:15.208785 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.208761 2581 generic.go:356] "Generic (PLEG): container finished" podID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerID="bc7ce1affa19a70741f0928551b7cdf024f5d5e3e1cd3d0308b5f9bedbb8c77f" exitCode=0 Sep 18 03:40:15.208905 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.208810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" event={"ID":"71f57538-61b3-43ca-889f-57777c2c2bfb","Type":"ContainerDied","Data":"bc7ce1affa19a70741f0928551b7cdf024f5d5e3e1cd3d0308b5f9bedbb8c77f"} Sep 18 03:40:15.220997 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.220937 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" podStartSLOduration=3.277838417 podStartE2EDuration="22.220924862s" totalImagesPullingTime="18.943086445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:39:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:15.220485634 +0000 UTC m=+456.977771085" watchObservedRunningTime="2026-09-18 03:40:15.220924862 +0000 UTC m=+456.978210313" Sep 18 03:40:15.252619 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.252544 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" podStartSLOduration=3.222774306 podStartE2EDuration="24.252527015s" totalImagesPullingTime="21.029752709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:39:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:15.252048578 +0000 UTC m=+457.009334031" watchObservedRunningTime="2026-09-18 03:40:15.252527015 +0000 UTC m=+457.009812468" Sep 18 03:40:15.314178 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:15.314156 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6"] Sep 18 03:40:15.336946 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:15.336919 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd73052_adca_43e3_bab6_638815dc66fe.slice/crio-c80569355d65d826a381491536557498517dde5eb02e09b60e06830173c07f67 WatchSource:0}: Error finding container c80569355d65d826a381491536557498517dde5eb02e09b60e06830173c07f67: Status 404 returned error can't find the container with id c80569355d65d826a381491536557498517dde5eb02e09b60e06830173c07f67 Sep 18 03:40:16.215461 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.215423 2581 generic.go:356] "Generic (PLEG): container finished" podID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerID="f7fc03a76415af4c82987d65ae888d53eb0a1e2b767e0877a2927ba27088fe3f" exitCode=0 Sep 18 03:40:16.215852 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.215496 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" event={"ID":"14ffa166-5b3f-4477-90a9-21a9becab3b7","Type":"ContainerDied","Data":"f7fc03a76415af4c82987d65ae888d53eb0a1e2b767e0877a2927ba27088fe3f"} Sep 18 03:40:16.217712 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.217689 2581 generic.go:356] "Generic (PLEG): container finished" podID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerID="6e8daf4694716f865287402c256b4476629a672bb5588305cc1204a8ee7f775c" exitCode=0 Sep 18 03:40:16.217823 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.217778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerDied","Data":"6e8daf4694716f865287402c256b4476629a672bb5588305cc1204a8ee7f775c"} Sep 18 03:40:16.219769 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.219747 2581 generic.go:356] "Generic (PLEG): container finished" podID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerID="78c26ef97609997a1b3919a278eb8b0dbf5122b541d0acc34c430d71b770b91c" exitCode=0 Sep 18 03:40:16.219866 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.219818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerDied","Data":"78c26ef97609997a1b3919a278eb8b0dbf5122b541d0acc34c430d71b770b91c"} Sep 18 03:40:16.221133 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.221095 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" event={"ID":"8bd73052-adca-43e3-bab6-638815dc66fe","Type":"ContainerStarted","Data":"c80569355d65d826a381491536557498517dde5eb02e09b60e06830173c07f67"} Sep 18 03:40:16.223055 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.223034 2581 generic.go:356] "Generic (PLEG): container finished" podID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerID="43ef6536e76e990bdaee39276891fa11dff861a7edff8a635b0727630c4a6343" exitCode=0 Sep 18 03:40:16.223171 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.223103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerDied","Data":"43ef6536e76e990bdaee39276891fa11dff861a7edff8a635b0727630c4a6343"} Sep 18 03:40:16.225060 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.225040 2581 generic.go:356] "Generic (PLEG): container finished" podID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerID="f32a7959831b4654e698c9951c22f617eb90dec4aa6db18ea23106ba71d1f14c" exitCode=0 Sep 18 03:40:16.225167 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.225095 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" event={"ID":"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4","Type":"ContainerDied","Data":"f32a7959831b4654e698c9951c22f617eb90dec4aa6db18ea23106ba71d1f14c"} Sep 18 03:40:16.361238 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.361214 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:40:16.496084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.496005 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle\") pod \"71f57538-61b3-43ca-889f-57777c2c2bfb\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " Sep 18 03:40:16.496084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.496078 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l25wv\" (UniqueName: \"kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv\") pod \"71f57538-61b3-43ca-889f-57777c2c2bfb\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " Sep 18 03:40:16.496313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.496115 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util\") pod \"71f57538-61b3-43ca-889f-57777c2c2bfb\" (UID: \"71f57538-61b3-43ca-889f-57777c2c2bfb\") " Sep 18 03:40:16.496825 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.496786 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle" (OuterVolumeSpecName: "bundle") pod "71f57538-61b3-43ca-889f-57777c2c2bfb" (UID: "71f57538-61b3-43ca-889f-57777c2c2bfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:16.499563 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.499534 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv" (OuterVolumeSpecName: "kube-api-access-l25wv") pod "71f57538-61b3-43ca-889f-57777c2c2bfb" (UID: "71f57538-61b3-43ca-889f-57777c2c2bfb"). InnerVolumeSpecName "kube-api-access-l25wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:16.504981 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.504954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util" (OuterVolumeSpecName: "util") pod "71f57538-61b3-43ca-889f-57777c2c2bfb" (UID: "71f57538-61b3-43ca-889f-57777c2c2bfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:16.597458 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.597424 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:16.597458 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.597461 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l25wv\" (UniqueName: \"kubernetes.io/projected/71f57538-61b3-43ca-889f-57777c2c2bfb-kube-api-access-l25wv\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:16.597691 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:16.597477 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71f57538-61b3-43ca-889f-57777c2c2bfb-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:17.233173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:17.233095 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" Sep 18 03:40:17.233173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:17.233152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bk6kt" event={"ID":"71f57538-61b3-43ca-889f-57777c2c2bfb","Type":"ContainerDied","Data":"a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f"} Sep 18 03:40:17.233660 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:17.233194 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a544dcd85f5aabf945db84de9928f39fcd868db92cc0236822212262f2babc4f" Sep 18 03:40:18.021544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.021514 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:40:18.041814 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.041783 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:40:18.053731 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.053706 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:40:18.113584 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.113546 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util\") pod \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " Sep 18 03:40:18.113775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.113599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle\") pod \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " Sep 18 03:40:18.113775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.113663 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59s2x\" (UniqueName: \"kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x\") pod \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\" (UID: \"c5f07db4-c2d6-49c0-9754-4edc3ecd935f\") " Sep 18 03:40:18.114201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.114170 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle" (OuterVolumeSpecName: "bundle") pod "c5f07db4-c2d6-49c0-9754-4edc3ecd935f" (UID: "c5f07db4-c2d6-49c0-9754-4edc3ecd935f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.116109 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.116077 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x" (OuterVolumeSpecName: "kube-api-access-59s2x") pod "c5f07db4-c2d6-49c0-9754-4edc3ecd935f" (UID: "c5f07db4-c2d6-49c0-9754-4edc3ecd935f"). InnerVolumeSpecName "kube-api-access-59s2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:18.120620 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.120593 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util" (OuterVolumeSpecName: "util") pod "c5f07db4-c2d6-49c0-9754-4edc3ecd935f" (UID: "c5f07db4-c2d6-49c0-9754-4edc3ecd935f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.215082 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215049 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle\") pod \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " Sep 18 03:40:18.215245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215107 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hx5q\" (UniqueName: \"kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q\") pod \"14ffa166-5b3f-4477-90a9-21a9becab3b7\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " Sep 18 03:40:18.215245 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7bgr\" (UniqueName: \"kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr\") pod \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " Sep 18 03:40:18.215329 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215254 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle\") pod \"14ffa166-5b3f-4477-90a9-21a9becab3b7\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " Sep 18 03:40:18.215367 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215352 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util\") pod \"14ffa166-5b3f-4477-90a9-21a9becab3b7\" (UID: \"14ffa166-5b3f-4477-90a9-21a9becab3b7\") " Sep 18 03:40:18.215408 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215379 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util\") pod \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\" (UID: \"8555a219-f59a-4b03-9c0b-2dbc7c46f047\") " Sep 18 03:40:18.215490 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215467 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle" (OuterVolumeSpecName: "bundle") pod "8555a219-f59a-4b03-9c0b-2dbc7c46f047" (UID: "8555a219-f59a-4b03-9c0b-2dbc7c46f047"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.215632 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215612 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.215632 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215634 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.215818 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215647 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59s2x\" (UniqueName: \"kubernetes.io/projected/c5f07db4-c2d6-49c0-9754-4edc3ecd935f-kube-api-access-59s2x\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.215818 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.215659 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.216206 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.216167 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle" (OuterVolumeSpecName: "bundle") pod "14ffa166-5b3f-4477-90a9-21a9becab3b7" (UID: "14ffa166-5b3f-4477-90a9-21a9becab3b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.217900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.217733 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr" (OuterVolumeSpecName: "kube-api-access-g7bgr") pod "8555a219-f59a-4b03-9c0b-2dbc7c46f047" (UID: "8555a219-f59a-4b03-9c0b-2dbc7c46f047"). InnerVolumeSpecName "kube-api-access-g7bgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:18.217900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.217837 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q" (OuterVolumeSpecName: "kube-api-access-7hx5q") pod "14ffa166-5b3f-4477-90a9-21a9becab3b7" (UID: "14ffa166-5b3f-4477-90a9-21a9becab3b7"). InnerVolumeSpecName "kube-api-access-7hx5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:18.221497 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.221475 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util" (OuterVolumeSpecName: "util") pod "8555a219-f59a-4b03-9c0b-2dbc7c46f047" (UID: "8555a219-f59a-4b03-9c0b-2dbc7c46f047"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.223227 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.222984 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util" (OuterVolumeSpecName: "util") pod "14ffa166-5b3f-4477-90a9-21a9becab3b7" (UID: "14ffa166-5b3f-4477-90a9-21a9becab3b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.240211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.240150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" event={"ID":"8555a219-f59a-4b03-9c0b-2dbc7c46f047","Type":"ContainerDied","Data":"d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1"} Sep 18 03:40:18.240211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.240176 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eczsj8" Sep 18 03:40:18.240609 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.240240 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d32bc8eb8a908ab4382e79f10689aad86dd8708156eb4414ff27ec6ac84151e1" Sep 18 03:40:18.242578 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.242561 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" Sep 18 03:40:18.242681 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.242575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjq9k" event={"ID":"14ffa166-5b3f-4477-90a9-21a9becab3b7","Type":"ContainerDied","Data":"c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c"} Sep 18 03:40:18.242681 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.242615 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4cac49fe26b2fe1c4b63082b7223c78117dc7eb1bc79c48bc94b24eb4ee669c" Sep 18 03:40:18.244810 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.244778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" event={"ID":"c5f07db4-c2d6-49c0-9754-4edc3ecd935f","Type":"ContainerDied","Data":"cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7"} Sep 18 03:40:18.244913 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.244814 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cde6a0eaf9a4a84ff1fca9a98a66fbbbdadf0818780f929f15fe74116f0ad2e7" Sep 18 03:40:18.244913 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.244857 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jngxr" Sep 18 03:40:18.316906 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.316876 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.316906 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.316904 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ffa166-5b3f-4477-90a9-21a9becab3b7-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.316906 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.316913 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8555a219-f59a-4b03-9c0b-2dbc7c46f047-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.317164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.316921 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hx5q\" (UniqueName: \"kubernetes.io/projected/14ffa166-5b3f-4477-90a9-21a9becab3b7-kube-api-access-7hx5q\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.317164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.316932 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7bgr\" (UniqueName: \"kubernetes.io/projected/8555a219-f59a-4b03-9c0b-2dbc7c46f047-kube-api-access-g7bgr\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.513358 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.513299 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:40:18.535343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.535319 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:40:18.618831 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618803 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn44b\" (UniqueName: \"kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b\") pod \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " Sep 18 03:40:18.618831 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618835 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l56n4\" (UniqueName: \"kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4\") pod \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " Sep 18 03:40:18.619018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618856 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util\") pod \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " Sep 18 03:40:18.619018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618884 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle\") pod \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\" (UID: \"bfed3163-3cfe-47bd-9e09-5a7d8d492426\") " Sep 18 03:40:18.619018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618923 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util\") pod \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " Sep 18 03:40:18.619018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.618954 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle\") pod \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\" (UID: \"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4\") " Sep 18 03:40:18.619547 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.619525 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle" (OuterVolumeSpecName: "bundle") pod "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" (UID: "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.619639 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.619574 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle" (OuterVolumeSpecName: "bundle") pod "bfed3163-3cfe-47bd-9e09-5a7d8d492426" (UID: "bfed3163-3cfe-47bd-9e09-5a7d8d492426"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.620938 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.620916 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b" (OuterVolumeSpecName: "kube-api-access-hn44b") pod "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" (UID: "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4"). InnerVolumeSpecName "kube-api-access-hn44b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:18.621260 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.621234 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4" (OuterVolumeSpecName: "kube-api-access-l56n4") pod "bfed3163-3cfe-47bd-9e09-5a7d8d492426" (UID: "bfed3163-3cfe-47bd-9e09-5a7d8d492426"). InnerVolumeSpecName "kube-api-access-l56n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:18.623723 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.623703 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util" (OuterVolumeSpecName: "util") pod "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" (UID: "3fa3365e-abe5-48a5-94e5-6c234f6eb2d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.624087 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.624068 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util" (OuterVolumeSpecName: "util") pod "bfed3163-3cfe-47bd-9e09-5a7d8d492426" (UID: "bfed3163-3cfe-47bd-9e09-5a7d8d492426"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:18.720018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.719994 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn44b\" (UniqueName: \"kubernetes.io/projected/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-kube-api-access-hn44b\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.720018 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.720017 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l56n4\" (UniqueName: \"kubernetes.io/projected/bfed3163-3cfe-47bd-9e09-5a7d8d492426-kube-api-access-l56n4\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.720164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.720030 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.720164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.720042 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfed3163-3cfe-47bd-9e09-5a7d8d492426-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.720164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.720053 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-util\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:18.720164 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:18.720063 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa3365e-abe5-48a5-94e5-6c234f6eb2d4-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:40:19.251930 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.251854 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" Sep 18 03:40:19.252340 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.251850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpm9x7" event={"ID":"3fa3365e-abe5-48a5-94e5-6c234f6eb2d4","Type":"ContainerDied","Data":"bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0"} Sep 18 03:40:19.252340 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.251972 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd64eb1157c67ad1638114635fae8a5321628c5ad223e8cfc369c3d15f3d50f0" Sep 18 03:40:19.253839 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.253817 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" Sep 18 03:40:19.253980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.253809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e678m8" event={"ID":"bfed3163-3cfe-47bd-9e09-5a7d8d492426","Type":"ContainerDied","Data":"474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef"} Sep 18 03:40:19.253980 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.253924 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="474e090e19c128148e9f63931392b1b1bd6b73c838a518be1b7c0d7db03876ef" Sep 18 03:40:19.255739 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.255697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" event={"ID":"8bd73052-adca-43e3-bab6-638815dc66fe","Type":"ContainerStarted","Data":"5be8896cb900fa727b28b4746e63afaf4a580d64909c097d45ef689863659239"} Sep 18 03:40:19.276824 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.276778 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-dqlh6" podStartSLOduration=1.7051094359999999 podStartE2EDuration="5.276761004s" totalImagesPullingTime="3.571651568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:19.275853832 +0000 UTC m=+461.033139284" watchObservedRunningTime="2026-09-18 03:40:19.276761004 +0000 UTC m=+461.034046458" Sep 18 03:40:19.844446 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844410 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9zzmz"] Sep 18 03:40:19.844685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844672 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="extract" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844687 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="extract" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844702 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="util" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844709 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="util" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844718 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="extract" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844722 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="extract" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844728 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="pull" Sep 18 03:40:19.844735 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844734 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844739 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844744 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844753 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844757 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844763 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844767 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844775 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844782 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844791 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844796 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844801 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844805 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844810 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844814 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844820 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844825 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844830 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844835 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844841 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844846 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844853 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844860 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="pull" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844869 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844875 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844881 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844885 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="util" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844890 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844895 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844940 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f57538-61b3-43ca-889f-57777c2c2bfb" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844950 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f07db4-c2d6-49c0-9754-4edc3ecd935f" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844957 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8555a219-f59a-4b03-9c0b-2dbc7c46f047" containerName="extract" Sep 18 03:40:19.844950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844963 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa3365e-abe5-48a5-94e5-6c234f6eb2d4" containerName="extract" Sep 18 03:40:19.845819 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844970 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ffa166-5b3f-4477-90a9-21a9becab3b7" containerName="extract" Sep 18 03:40:19.845819 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.844976 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfed3163-3cfe-47bd-9e09-5a7d8d492426" containerName="extract" Sep 18 03:40:19.846711 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.846696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:19.849636 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.849613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gh4sq\"" Sep 18 03:40:19.849734 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.849645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 03:40:19.849804 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.849735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 03:40:19.859248 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.859225 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9zzmz"] Sep 18 03:40:19.929446 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.929420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:19.929637 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:19.929492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnq2m\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-kube-api-access-gnq2m\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.030708 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.030676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnq2m\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-kube-api-access-gnq2m\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.030828 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.030725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.047355 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.047323 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.047461 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.047445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnq2m\" (UniqueName: \"kubernetes.io/projected/90e9655a-d58e-467c-a90d-59069181e23c-kube-api-access-gnq2m\") pod \"cert-manager-webhook-6486ffd997-9zzmz\" (UID: \"90e9655a-d58e-467c-a90d-59069181e23c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.155267 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.155214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:20.424336 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:20.424272 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9zzmz"] Sep 18 03:40:20.427440 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:20.427415 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90e9655a_d58e_467c_a90d_59069181e23c.slice/crio-bb2c7033dd1ab41fdad7a68c050e9a5edda7705e925da05189e934903996c5d1 WatchSource:0}: Error finding container bb2c7033dd1ab41fdad7a68c050e9a5edda7705e925da05189e934903996c5d1: Status 404 returned error can't find the container with id bb2c7033dd1ab41fdad7a68c050e9a5edda7705e925da05189e934903996c5d1 Sep 18 03:40:21.265251 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:21.265219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" event={"ID":"90e9655a-d58e-467c-a90d-59069181e23c","Type":"ContainerStarted","Data":"bb2c7033dd1ab41fdad7a68c050e9a5edda7705e925da05189e934903996c5d1"} Sep 18 03:40:24.280923 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.280887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" event={"ID":"90e9655a-d58e-467c-a90d-59069181e23c","Type":"ContainerStarted","Data":"8a38105e2f24356e78e53eae982dadc47eca1fde445c9b5601a8976e892fb9a3"} Sep 18 03:40:24.281314 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.280933 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:24.654817 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.654763 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" podStartSLOduration=2.57761009 podStartE2EDuration="5.654745712s" totalImagesPullingTime="3.077135622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:24.296832462 +0000 UTC m=+466.054117914" watchObservedRunningTime="2026-09-18 03:40:24.654745712 +0000 UTC m=+466.412031164" Sep 18 03:40:24.655683 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.655659 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs"] Sep 18 03:40:24.658921 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.658904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.661847 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.661830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 03:40:24.662092 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.662076 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 03:40:24.662190 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.662109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 03:40:24.662190 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.662111 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 03:40:24.662416 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.662402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-pvhrl\"" Sep 18 03:40:24.662495 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.662479 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 03:40:24.674211 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.674193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs"] Sep 18 03:40:24.769085 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.769205 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.769205 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpj5q\" (UniqueName: \"kubernetes.io/projected/0d66e76f-3331-4b06-885a-966731b967f4-kube-api-access-zpj5q\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.769313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.769313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.769313 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.769256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870406 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870493 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870493 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870493 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870493 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870682 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpj5q\" (UniqueName: \"kubernetes.io/projected/0d66e76f-3331-4b06-885a-966731b967f4-kube-api-access-zpj5q\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.870821 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.870801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.872895 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.872877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d66e76f-3331-4b06-885a-966731b967f4-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.872991 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.872907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.873084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.873065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.873084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.873078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d66e76f-3331-4b06-885a-966731b967f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.877782 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.877763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpj5q\" (UniqueName: \"kubernetes.io/projected/0d66e76f-3331-4b06-885a-966731b967f4-kube-api-access-zpj5q\") pod \"opendatahub-operator-controller-manager-7b6444b484-676gs\" (UID: \"0d66e76f-3331-4b06-885a-966731b967f4\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:24.968836 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:24.968789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:25.242008 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:25.241778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs"] Sep 18 03:40:25.244707 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:25.244681 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d66e76f_3331_4b06_885a_966731b967f4.slice/crio-b3973708a1348bbc3b231b7a74a3262672ca5a509b10dd9eddc01f2fde79efb2 WatchSource:0}: Error finding container b3973708a1348bbc3b231b7a74a3262672ca5a509b10dd9eddc01f2fde79efb2: Status 404 returned error can't find the container with id b3973708a1348bbc3b231b7a74a3262672ca5a509b10dd9eddc01f2fde79efb2 Sep 18 03:40:25.285860 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:25.285825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" event={"ID":"0d66e76f-3331-4b06-885a-966731b967f4","Type":"ContainerStarted","Data":"b3973708a1348bbc3b231b7a74a3262672ca5a509b10dd9eddc01f2fde79efb2"} Sep 18 03:40:28.307445 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:28.307374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" event={"ID":"0d66e76f-3331-4b06-885a-966731b967f4","Type":"ContainerStarted","Data":"c48d8c83f285c340a9d39261ba8962eeaf62c8325e871a51cecbdaf8cd71b9a1"} Sep 18 03:40:29.313602 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:29.313567 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d66e76f-3331-4b06-885a-966731b967f4" containerID="c48d8c83f285c340a9d39261ba8962eeaf62c8325e871a51cecbdaf8cd71b9a1" exitCode=0 Sep 18 03:40:29.314016 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:29.313649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" event={"ID":"0d66e76f-3331-4b06-885a-966731b967f4","Type":"ContainerDied","Data":"c48d8c83f285c340a9d39261ba8962eeaf62c8325e871a51cecbdaf8cd71b9a1"} Sep 18 03:40:30.076740 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.076707 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z"] Sep 18 03:40:30.079988 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.079972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.082576 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.082556 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:40:30.082639 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.082583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 03:40:30.082639 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.082596 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-8rzvt\"" Sep 18 03:40:30.087597 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.087576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z"] Sep 18 03:40:30.114100 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.114075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-tmp\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.114239 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.114135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgmt\" (UniqueName: \"kubernetes.io/projected/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-kube-api-access-gjgmt\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.214843 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.214818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-tmp\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.214966 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.214870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgmt\" (UniqueName: \"kubernetes.io/projected/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-kube-api-access-gjgmt\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.215201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.215184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-tmp\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.223831 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.223812 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgmt\" (UniqueName: \"kubernetes.io/projected/d56f5d8d-6f13-482b-8ce6-541fec47fbcf-kube-api-access-gjgmt\") pod \"jobset-operator-56d489b4b8-lf26z\" (UID: \"d56f5d8d-6f13-482b-8ce6-541fec47fbcf\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.288771 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.288744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9zzmz" Sep 18 03:40:30.320665 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.320634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" event={"ID":"0d66e76f-3331-4b06-885a-966731b967f4","Type":"ContainerStarted","Data":"2b335129f4557a126843e35b05fe6e2d34812e237503d805de5ebb8ee6995b57"} Sep 18 03:40:30.320965 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.320739 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:30.344942 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.344877 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" podStartSLOduration=2.7562647890000003 podStartE2EDuration="6.344864776s" totalImagesPullingTime="3.098926913s" totalInitContainerRuntime="489.673074ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:30.342341829 +0000 UTC m=+472.099627281" watchObservedRunningTime="2026-09-18 03:40:30.344864776 +0000 UTC m=+472.102150231" Sep 18 03:40:30.389217 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.389193 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" Sep 18 03:40:30.668187 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:30.668164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z"] Sep 18 03:40:30.670718 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:30.670691 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd56f5d8d_6f13_482b_8ce6_541fec47fbcf.slice/crio-df3d51c9e953116425d65a584aef421027da12ca32a3e3cd7df6cb3c0fab56f7 WatchSource:0}: Error finding container df3d51c9e953116425d65a584aef421027da12ca32a3e3cd7df6cb3c0fab56f7: Status 404 returned error can't find the container with id df3d51c9e953116425d65a584aef421027da12ca32a3e3cd7df6cb3c0fab56f7 Sep 18 03:40:31.079707 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.079677 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rdgfp"] Sep 18 03:40:31.083882 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.083866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.086530 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.086501 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ggljf\"" Sep 18 03:40:31.098649 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.098629 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rdgfp"] Sep 18 03:40:31.120563 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.120540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-bound-sa-token\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.120665 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.120592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7f5p\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-kube-api-access-f7f5p\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.220880 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.220858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-bound-sa-token\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.220977 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.220912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7f5p\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-kube-api-access-f7f5p\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.229092 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.229057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7f5p\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-kube-api-access-f7f5p\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.229092 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.229074 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1-bound-sa-token\") pod \"cert-manager-55b4d954d5-rdgfp\" (UID: \"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1\") " pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.326355 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.326322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" event={"ID":"d56f5d8d-6f13-482b-8ce6-541fec47fbcf","Type":"ContainerStarted","Data":"df3d51c9e953116425d65a584aef421027da12ca32a3e3cd7df6cb3c0fab56f7"} Sep 18 03:40:31.392853 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.392801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rdgfp" Sep 18 03:40:31.671032 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:31.670994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rdgfp"] Sep 18 03:40:31.673347 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:31.673319 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62ae4ea1_32c7_4e69_95b2_dcef0bc4c2b1.slice/crio-eaa6765ab4ce8228ce10a236ea4ae8aabab1623ce9001bc6ff7b84aae949e438 WatchSource:0}: Error finding container eaa6765ab4ce8228ce10a236ea4ae8aabab1623ce9001bc6ff7b84aae949e438: Status 404 returned error can't find the container with id eaa6765ab4ce8228ce10a236ea4ae8aabab1623ce9001bc6ff7b84aae949e438 Sep 18 03:40:32.334845 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:32.334808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rdgfp" event={"ID":"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1","Type":"ContainerStarted","Data":"a143465365562bfd15ce11a558d1876f85e7b9f2f659cd7044a560d97c6002e5"} Sep 18 03:40:32.335262 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:32.334854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rdgfp" event={"ID":"62ae4ea1-32c7-4e69-95b2-dcef0bc4c2b1","Type":"ContainerStarted","Data":"eaa6765ab4ce8228ce10a236ea4ae8aabab1623ce9001bc6ff7b84aae949e438"} Sep 18 03:40:32.351107 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:32.351058 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rdgfp" podStartSLOduration=1.351040124 podStartE2EDuration="1.351040124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:32.349145875 +0000 UTC m=+474.106431329" watchObservedRunningTime="2026-09-18 03:40:32.351040124 +0000 UTC m=+474.108325575" Sep 18 03:40:33.341213 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:33.341178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" event={"ID":"d56f5d8d-6f13-482b-8ce6-541fec47fbcf","Type":"ContainerStarted","Data":"dcab1f794b5b86cff1a385fd85d688b96688f9091224c33a60bc2371f123af86"} Sep 18 03:40:33.356354 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:33.356309 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-lf26z" podStartSLOduration=1.236170075 podStartE2EDuration="3.356292803s" totalImagesPullingTime="2.120122728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:33.355186725 +0000 UTC m=+475.112472178" watchObservedRunningTime="2026-09-18 03:40:33.356292803 +0000 UTC m=+475.113578255" Sep 18 03:40:40.865029 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.864995 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5"] Sep 18 03:40:40.871345 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.871329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:40.874232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.874212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 03:40:40.874362 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.874285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dd7h4\"" Sep 18 03:40:40.874698 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.874683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 03:40:40.879518 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.879495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5"] Sep 18 03:40:40.880787 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.880752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kktc\" (UniqueName: \"kubernetes.io/projected/f9efbecb-3ee0-4741-aa46-4b5d8f258c9c-kube-api-access-2kktc\") pod \"authorino-operator-6c7cb5c9cb-6csp5\" (UID: \"f9efbecb-3ee0-4741-aa46-4b5d8f258c9c\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:40.982084 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.982055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kktc\" (UniqueName: \"kubernetes.io/projected/f9efbecb-3ee0-4741-aa46-4b5d8f258c9c-kube-api-access-2kktc\") pod \"authorino-operator-6c7cb5c9cb-6csp5\" (UID: \"f9efbecb-3ee0-4741-aa46-4b5d8f258c9c\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:40.998326 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:40.998306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kktc\" (UniqueName: \"kubernetes.io/projected/f9efbecb-3ee0-4741-aa46-4b5d8f258c9c-kube-api-access-2kktc\") pod \"authorino-operator-6c7cb5c9cb-6csp5\" (UID: \"f9efbecb-3ee0-4741-aa46-4b5d8f258c9c\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:41.181749 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:41.181686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:41.329439 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:41.329407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-676gs" Sep 18 03:40:41.454207 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:41.454185 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5"] Sep 18 03:40:41.455748 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:41.455719 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9efbecb_3ee0_4741_aa46_4b5d8f258c9c.slice/crio-28abfb96746f02832afe2ad8c3a255ffb789a859dc480e7dc5e77c941b560d79 WatchSource:0}: Error finding container 28abfb96746f02832afe2ad8c3a255ffb789a859dc480e7dc5e77c941b560d79: Status 404 returned error can't find the container with id 28abfb96746f02832afe2ad8c3a255ffb789a859dc480e7dc5e77c941b560d79 Sep 18 03:40:42.388099 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:42.388052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" event={"ID":"f9efbecb-3ee0-4741-aa46-4b5d8f258c9c","Type":"ContainerStarted","Data":"28abfb96746f02832afe2ad8c3a255ffb789a859dc480e7dc5e77c941b560d79"} Sep 18 03:40:43.393842 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:43.393804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" event={"ID":"f9efbecb-3ee0-4741-aa46-4b5d8f258c9c","Type":"ContainerStarted","Data":"07b4e3d41ac84e86c09182757b89d19e07ed0461821ac6c05fdb61ae547a9b57"} Sep 18 03:40:43.394242 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:43.393981 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:43.412884 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:43.412832 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" podStartSLOduration=2.137335069 podStartE2EDuration="3.412820855s" totalImagesPullingTime="1.275485786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:43.411340332 +0000 UTC m=+485.168625783" watchObservedRunningTime="2026-09-18 03:40:43.412820855 +0000 UTC m=+485.170106308" Sep 18 03:40:49.146384 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.146352 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v"] Sep 18 03:40:49.193835 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.193810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v"] Sep 18 03:40:49.193993 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.193898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.196492 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.196471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gfphp\"" Sep 18 03:40:49.237247 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6l4\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-kube-api-access-bx6l4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237343 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237484 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a5185d-125c-43c0-80a2-4302f35bd5bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237484 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237484 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.237586 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.237489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338228 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338228 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6l4\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-kube-api-access-bx6l4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338473 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338473 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a5185d-125c-43c0-80a2-4302f35bd5bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338473 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338473 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338684 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338684 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338684 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.338684 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.338660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.339087 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.339065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.339267 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.339103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.339375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.339111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.339510 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.339487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a5185d-125c-43c0-80a2-4302f35bd5bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.341357 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.341331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.341471 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.341452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.346581 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.346561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.347664 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.347643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6l4\" (UniqueName: \"kubernetes.io/projected/44a5185d-125c-43c0-80a2-4302f35bd5bd-kube-api-access-bx6l4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v\" (UID: \"44a5185d-125c-43c0-80a2-4302f35bd5bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.503990 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.503907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:49.846998 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.846967 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v"] Sep 18 03:40:49.851425 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:49.851396 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a5185d_125c_43c0_80a2_4302f35bd5bd.slice/crio-09a007af7fb58b530b6ae50c449f4a6284968fe586f80041e1115210fe4cdd1d WatchSource:0}: Error finding container 09a007af7fb58b530b6ae50c449f4a6284968fe586f80041e1115210fe4cdd1d: Status 404 returned error can't find the container with id 09a007af7fb58b530b6ae50c449f4a6284968fe586f80041e1115210fe4cdd1d Sep 18 03:40:49.853652 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.853618 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:49.853743 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.853704 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:49.853803 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.853749 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 03:40:49.894176 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.894150 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd"] Sep 18 03:40:49.916191 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.916167 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd"] Sep 18 03:40:49.916305 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.916255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:49.918935 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.918916 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6hp9s\"" Sep 18 03:40:49.919038 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.918918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 18 03:40:49.943840 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:49.943822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49ctv\" (UniqueName: \"kubernetes.io/projected/2a5b773e-c0f4-4db2-ad81-241b1d9dd122-kube-api-access-49ctv\") pod \"dns-operator-controller-manager-7b449b7679-clbjd\" (UID: \"2a5b773e-c0f4-4db2-ad81-241b1d9dd122\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:50.045341 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.045305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49ctv\" (UniqueName: \"kubernetes.io/projected/2a5b773e-c0f4-4db2-ad81-241b1d9dd122-kube-api-access-49ctv\") pod \"dns-operator-controller-manager-7b449b7679-clbjd\" (UID: \"2a5b773e-c0f4-4db2-ad81-241b1d9dd122\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:50.053296 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.053270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49ctv\" (UniqueName: \"kubernetes.io/projected/2a5b773e-c0f4-4db2-ad81-241b1d9dd122-kube-api-access-49ctv\") pod \"dns-operator-controller-manager-7b449b7679-clbjd\" (UID: \"2a5b773e-c0f4-4db2-ad81-241b1d9dd122\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:50.229897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.229817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:50.434032 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.434001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" event={"ID":"44a5185d-125c-43c0-80a2-4302f35bd5bd","Type":"ContainerStarted","Data":"122a5922f7a0d2956336f3fde6a4f2e9d2b9fd2f5725727fde490a171fbbc771"} Sep 18 03:40:50.434186 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.434040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" event={"ID":"44a5185d-125c-43c0-80a2-4302f35bd5bd","Type":"ContainerStarted","Data":"09a007af7fb58b530b6ae50c449f4a6284968fe586f80041e1115210fe4cdd1d"} Sep 18 03:40:50.459767 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.459726 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" podStartSLOduration=1.459711462 podStartE2EDuration="1.459711462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:50.457560172 +0000 UTC m=+492.214845625" watchObservedRunningTime="2026-09-18 03:40:50.459711462 +0000 UTC m=+492.216996915" Sep 18 03:40:50.504668 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.504603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:50.509363 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.509340 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:50.510555 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:50.510533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd"] Sep 18 03:40:50.512341 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:50.512307 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5b773e_c0f4_4db2_ad81_241b1d9dd122.slice/crio-e6ce8f7473bd72355a902d5b1a38c71b3402376336d577f44e736660d2c5d84f WatchSource:0}: Error finding container e6ce8f7473bd72355a902d5b1a38c71b3402376336d577f44e736660d2c5d84f: Status 404 returned error can't find the container with id e6ce8f7473bd72355a902d5b1a38c71b3402376336d577f44e736660d2c5d84f Sep 18 03:40:51.441502 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:51.441459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" event={"ID":"2a5b773e-c0f4-4db2-ad81-241b1d9dd122","Type":"ContainerStarted","Data":"e6ce8f7473bd72355a902d5b1a38c71b3402376336d577f44e736660d2c5d84f"} Sep 18 03:40:51.442046 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:51.441731 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:51.442857 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:51.442838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v" Sep 18 03:40:52.447401 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.447369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" event={"ID":"2a5b773e-c0f4-4db2-ad81-241b1d9dd122","Type":"ContainerStarted","Data":"990edd6c96de3428b159ea103a03996c0090567eb40d26fbc58b5688a8e77f70"} Sep 18 03:40:52.447787 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.447565 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:40:52.467238 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.467190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" podStartSLOduration=1.997190794 podStartE2EDuration="3.46717601s" totalImagesPullingTime="1.469985216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:52.46480982 +0000 UTC m=+494.222095271" watchObservedRunningTime="2026-09-18 03:40:52.46717601 +0000 UTC m=+494.224461462" Sep 18 03:40:52.645108 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.645073 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf"] Sep 18 03:40:52.647112 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.647097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:52.649534 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.649509 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vvm47\"" Sep 18 03:40:52.657929 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.657905 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf"] Sep 18 03:40:52.770422 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.770365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr9wr\" (UniqueName: \"kubernetes.io/projected/087429dd-58db-4fd8-a0df-79a0f372a503-kube-api-access-zr9wr\") pod \"limitador-operator-controller-manager-6d9b9f85cb-9mqbf\" (UID: \"087429dd-58db-4fd8-a0df-79a0f372a503\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:52.871561 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.871534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr9wr\" (UniqueName: \"kubernetes.io/projected/087429dd-58db-4fd8-a0df-79a0f372a503-kube-api-access-zr9wr\") pod \"limitador-operator-controller-manager-6d9b9f85cb-9mqbf\" (UID: \"087429dd-58db-4fd8-a0df-79a0f372a503\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:52.886037 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.886010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr9wr\" (UniqueName: \"kubernetes.io/projected/087429dd-58db-4fd8-a0df-79a0f372a503-kube-api-access-zr9wr\") pod \"limitador-operator-controller-manager-6d9b9f85cb-9mqbf\" (UID: \"087429dd-58db-4fd8-a0df-79a0f372a503\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:52.956492 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:52.956469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:53.226271 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:53.226248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf"] Sep 18 03:40:53.453207 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:53.453175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" event={"ID":"087429dd-58db-4fd8-a0df-79a0f372a503","Type":"ContainerStarted","Data":"9711710d22b1914b5c2d2339a1f56aa077a3addd3b0373a023bfb168e83770ce"} Sep 18 03:40:54.403499 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:54.403464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-6csp5" Sep 18 03:40:55.464965 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:55.464926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" event={"ID":"087429dd-58db-4fd8-a0df-79a0f372a503","Type":"ContainerStarted","Data":"894b1e303e83e06fa2c026327358f96cd578fbcf64b143d445d43ffa4883f49f"} Sep 18 03:40:55.465431 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:55.465085 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:40:55.493062 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:55.493015 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" podStartSLOduration=1.902808357 podStartE2EDuration="3.492998178s" totalImagesPullingTime="1.590189821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:55.492641021 +0000 UTC m=+497.249926474" watchObservedRunningTime="2026-09-18 03:40:55.492998178 +0000 UTC m=+497.250283644" Sep 18 03:40:58.876766 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.876737 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6"] Sep 18 03:40:58.878975 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.878958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:58.881366 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.881347 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Sep 18 03:40:58.882697 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.882674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Sep 18 03:40:58.882812 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.882679 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-cgg8b\"" Sep 18 03:40:58.882812 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.882718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Sep 18 03:40:58.887316 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.887295 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6"] Sep 18 03:40:58.921543 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.921521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jdp\" (UniqueName: \"kubernetes.io/projected/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-kube-api-access-b8jdp\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:58.921660 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.921642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-cert\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:58.921709 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.921671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-manager-config\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:58.921751 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:58.921726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-metrics-certs\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.022226 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.022194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-cert\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.022388 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.022229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-manager-config\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.022388 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.022261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-metrics-certs\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.022388 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.022298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jdp\" (UniqueName: \"kubernetes.io/projected/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-kube-api-access-b8jdp\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.022832 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.022809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-manager-config\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.024640 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.024618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-cert\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.024717 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.024670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-metrics-certs\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.030023 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.030001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jdp\" (UniqueName: \"kubernetes.io/projected/1a72fa0f-36fa-48c0-afe6-25f88e0f06fd-kube-api-access-b8jdp\") pod \"jobset-controller-manager-6fd7df589f-xftb6\" (UID: \"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd\") " pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.188421 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.188373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:40:59.457801 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.457777 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6"] Sep 18 03:40:59.458827 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:40:59.458801 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a72fa0f_36fa_48c0_afe6_25f88e0f06fd.slice/crio-07c77fbf7638bd12f614632a9e38d1e79660c1e9dd12a4c6275b06d19b5871ba WatchSource:0}: Error finding container 07c77fbf7638bd12f614632a9e38d1e79660c1e9dd12a4c6275b06d19b5871ba: Status 404 returned error can't find the container with id 07c77fbf7638bd12f614632a9e38d1e79660c1e9dd12a4c6275b06d19b5871ba Sep 18 03:40:59.489333 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:40:59.489307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" event={"ID":"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd","Type":"ContainerStarted","Data":"07c77fbf7638bd12f614632a9e38d1e79660c1e9dd12a4c6275b06d19b5871ba"} Sep 18 03:41:02.507480 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:02.507448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" event={"ID":"1a72fa0f-36fa-48c0-afe6-25f88e0f06fd","Type":"ContainerStarted","Data":"122cf4b0dcd82ad64e1980e700a79e548c7440810cb4618800fe79e7c7dcbe96"} Sep 18 03:41:02.507858 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:02.507590 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:41:02.525109 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:02.525060 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" podStartSLOduration=1.9460353540000002 podStartE2EDuration="4.525047356s" totalImagesPullingTime="2.579012002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:02.523306939 +0000 UTC m=+504.280592392" watchObservedRunningTime="2026-09-18 03:41:02.525047356 +0000 UTC m=+504.282332808" Sep 18 03:41:03.456110 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:03.456077 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-clbjd" Sep 18 03:41:06.471622 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:06.471591 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-9mqbf" Sep 18 03:41:13.517854 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:13.517822 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-6fd7df589f-xftb6" Sep 18 03:41:45.102734 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.102695 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7db885c774-prpvr"] Sep 18 03:41:45.110649 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.110622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.113859 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.113838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 03:41:45.113955 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.113876 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 18 03:41:45.114582 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.114565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 03:41:45.115544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.115529 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 03:41:45.115614 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.115533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kccts\"" Sep 18 03:41:45.123269 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.123248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-prpvr"] Sep 18 03:41:45.269950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.269921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-metrics-certs\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.270140 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.269955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvf9c\" (UniqueName: \"kubernetes.io/projected/aabc83b4-a560-4b32-9179-214a1f11e835-kube-api-access-lvf9c\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.270140 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.269989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-cert\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.371266 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.371183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-metrics-certs\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.371266 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.371229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvf9c\" (UniqueName: \"kubernetes.io/projected/aabc83b4-a560-4b32-9179-214a1f11e835-kube-api-access-lvf9c\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.371485 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.371274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-cert\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.373662 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.373637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-cert\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.373780 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.373686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabc83b4-a560-4b32-9179-214a1f11e835-metrics-certs\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.382825 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.382805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvf9c\" (UniqueName: \"kubernetes.io/projected/aabc83b4-a560-4b32-9179-214a1f11e835-kube-api-access-lvf9c\") pod \"odh-model-controller-7db885c774-prpvr\" (UID: \"aabc83b4-a560-4b32-9179-214a1f11e835\") " pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.420815 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.420795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:45.698923 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.698897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-prpvr"] Sep 18 03:41:45.700477 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:41:45.700453 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabc83b4_a560_4b32_9179_214a1f11e835.slice/crio-10b5944c1ba460bae744b4fddfc64a93d122148a77a27bddab71e4181f6c7101 WatchSource:0}: Error finding container 10b5944c1ba460bae744b4fddfc64a93d122148a77a27bddab71e4181f6c7101: Status 404 returned error can't find the container with id 10b5944c1ba460bae744b4fddfc64a93d122148a77a27bddab71e4181f6c7101 Sep 18 03:41:45.716297 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:45.716271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-prpvr" event={"ID":"aabc83b4-a560-4b32-9179-214a1f11e835","Type":"ContainerStarted","Data":"10b5944c1ba460bae744b4fddfc64a93d122148a77a27bddab71e4181f6c7101"} Sep 18 03:41:48.734243 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:48.734155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-prpvr" event={"ID":"aabc83b4-a560-4b32-9179-214a1f11e835","Type":"ContainerStarted","Data":"b27cc5a8ebc4f2c49c2f5064de5a056a928f887edb438de0236f3b6406f041f8"} Sep 18 03:41:48.734650 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:48.734265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:41:48.751533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:48.751487 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7db885c774-prpvr" podStartSLOduration=1.112403462 podStartE2EDuration="3.751475254s" totalImagesPullingTime="2.639071792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:48.749634465 +0000 UTC m=+550.506919913" watchObservedRunningTime="2026-09-18 03:41:48.751475254 +0000 UTC m=+550.508760740" Sep 18 03:41:59.741510 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:41:59.741473 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7db885c774-prpvr" Sep 18 03:43:02.802978 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.802944 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68cc6d5775-76v2b"] Sep 18 03:43:02.806358 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.806337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.817518 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.817498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cc6d5775-76v2b"] Sep 18 03:43:02.958155 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-console-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v48\" (UniqueName: \"kubernetes.io/projected/049d5206-313f-4373-8416-7d0616454b4d-kube-api-access-b6v48\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-service-ca\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958259 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-oauth-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958393 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-trusted-ca-bundle\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:02.958393 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:02.958354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-oauth-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059409 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-trusted-ca-bundle\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059409 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-oauth-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-console-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v48\" (UniqueName: \"kubernetes.io/projected/049d5206-313f-4373-8416-7d0616454b4d-kube-api-access-b6v48\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-service-ca\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.059544 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.059508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-oauth-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.060232 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.060212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-service-ca\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.060317 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.060282 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-console-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.060362 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.060325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-oauth-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.060398 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.060357 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/049d5206-313f-4373-8416-7d0616454b4d-trusted-ca-bundle\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.062169 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.062149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-serving-cert\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.062226 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.062172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/049d5206-313f-4373-8416-7d0616454b4d-console-oauth-config\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.073107 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.073078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v48\" (UniqueName: \"kubernetes.io/projected/049d5206-313f-4373-8416-7d0616454b4d-kube-api-access-b6v48\") pod \"console-68cc6d5775-76v2b\" (UID: \"049d5206-313f-4373-8416-7d0616454b4d\") " pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.115677 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.115652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:03.385066 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:03.385042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cc6d5775-76v2b"] Sep 18 03:43:03.387111 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:43:03.387082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049d5206_313f_4373_8416_7d0616454b4d.slice/crio-f6a0db9774e81b5680577d385c3752502523ed1056274f496470fc5761cc08e0 WatchSource:0}: Error finding container f6a0db9774e81b5680577d385c3752502523ed1056274f496470fc5761cc08e0: Status 404 returned error can't find the container with id f6a0db9774e81b5680577d385c3752502523ed1056274f496470fc5761cc08e0 Sep 18 03:43:04.100774 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:04.100743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc6d5775-76v2b" event={"ID":"049d5206-313f-4373-8416-7d0616454b4d","Type":"ContainerStarted","Data":"49521dc7b74de589d5190d97605011c1859765487346a33166777f191cf9a3d2"} Sep 18 03:43:04.101114 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:04.100792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc6d5775-76v2b" event={"ID":"049d5206-313f-4373-8416-7d0616454b4d","Type":"ContainerStarted","Data":"f6a0db9774e81b5680577d385c3752502523ed1056274f496470fc5761cc08e0"} Sep 18 03:43:04.117615 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:04.117565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68cc6d5775-76v2b" podStartSLOduration=2.117544751 podStartE2EDuration="2.117544751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:43:04.116069699 +0000 UTC m=+625.873355154" watchObservedRunningTime="2026-09-18 03:43:04.117544751 +0000 UTC m=+625.874830203" Sep 18 03:43:13.115928 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:13.115893 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:13.116511 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:13.115949 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:13.120664 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:13.120640 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:13.149254 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:13.149230 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68cc6d5775-76v2b" Sep 18 03:43:13.192648 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:13.192623 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:43:38.159942 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.159896 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x"] Sep 18 03:43:38.164107 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.164083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.166605 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.166577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 03:43:38.166761 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.166617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hhmv2\"" Sep 18 03:43:38.167665 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.167640 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 03:43:38.167944 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.167709 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 18 03:43:38.171565 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.171541 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x"] Sep 18 03:43:38.212054 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.212003 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cfbf689b5-fmm5d" podUID="d68c46a2-d258-433e-9a82-c35cc3a08540" containerName="console" containerID="cri-o://016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11" gracePeriod=15 Sep 18 03:43:38.221617 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.221721 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e6d4a8-6c27-477b-b248-0f83692a47be-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.221721 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dxs\" (UniqueName: \"kubernetes.io/projected/b8e6d4a8-6c27-477b-b248-0f83692a47be-kube-api-access-b2dxs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.221721 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.221900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.221900 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.221764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322349 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e6d4a8-6c27-477b-b248-0f83692a47be-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322435 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dxs\" (UniqueName: \"kubernetes.io/projected/b8e6d4a8-6c27-477b-b248-0f83692a47be-kube-api-access-b2dxs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322435 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322515 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322515 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322624 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322983 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.322983 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.322972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.323143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.323021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.324774 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.324749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e6d4a8-6c27-477b-b248-0f83692a47be-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.325171 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.325149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e6d4a8-6c27-477b-b248-0f83692a47be-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.331636 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.331604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dxs\" (UniqueName: \"kubernetes.io/projected/b8e6d4a8-6c27-477b-b248-0f83692a47be-kube-api-access-b2dxs\") pod \"e2e-embedding-simulated-kserve-698db7d589-sgl5x\" (UID: \"b8e6d4a8-6c27-477b-b248-0f83692a47be\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.448624 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.448600 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:43:38.476479 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.476459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:38.524885 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.524843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.524901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k58t8\" (UniqueName: \"kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.524942 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.524981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.525023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.525079 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.525153 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config\") pod \"d68c46a2-d258-433e-9a82-c35cc3a08540\" (UID: \"d68c46a2-d258-433e-9a82-c35cc3a08540\") " Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.525768 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config" (OuterVolumeSpecName: "console-config") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.526161 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca" (OuterVolumeSpecName: "service-ca") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:43:38.526444 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.526374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:43:38.527203 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.526560 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:43:38.528427 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.528390 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:43:38.528685 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.528657 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:43:38.529154 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.529106 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8" (OuterVolumeSpecName: "kube-api-access-k58t8") pod "d68c46a2-d258-433e-9a82-c35cc3a08540" (UID: "d68c46a2-d258-433e-9a82-c35cc3a08540"). InnerVolumeSpecName "kube-api-access-k58t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:43:38.625772 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625743 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-oauth-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.625772 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625767 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-console-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.625772 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625776 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-serving-cert\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.626031 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625784 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k58t8\" (UniqueName: \"kubernetes.io/projected/d68c46a2-d258-433e-9a82-c35cc3a08540-kube-api-access-k58t8\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.626031 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625794 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d68c46a2-d258-433e-9a82-c35cc3a08540-console-oauth-config\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.626031 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625802 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-service-ca\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.626031 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.625810 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c46a2-d258-433e-9a82-c35cc3a08540-trusted-ca-bundle\") on node \"ip-10-0-142-107.ec2.internal\" DevicePath \"\"" Sep 18 03:43:38.746356 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:38.746334 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x"] Sep 18 03:43:38.748472 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:43:38.748445 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e6d4a8_6c27_477b_b248_0f83692a47be.slice/crio-b7fa1a4f9f0835d60b8eda3c17178a1dbc9224204c3d9696684dc38225f41897 WatchSource:0}: Error finding container b7fa1a4f9f0835d60b8eda3c17178a1dbc9224204c3d9696684dc38225f41897: Status 404 returned error can't find the container with id b7fa1a4f9f0835d60b8eda3c17178a1dbc9224204c3d9696684dc38225f41897 Sep 18 03:43:39.279449 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.279412 2581 generic.go:356] "Generic (PLEG): container finished" podID="d68c46a2-d258-433e-9a82-c35cc3a08540" containerID="016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11" exitCode=0 Sep 18 03:43:39.279851 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.279477 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbf689b5-fmm5d" Sep 18 03:43:39.279851 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.279504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbf689b5-fmm5d" event={"ID":"d68c46a2-d258-433e-9a82-c35cc3a08540","Type":"ContainerDied","Data":"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11"} Sep 18 03:43:39.279851 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.279556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbf689b5-fmm5d" event={"ID":"d68c46a2-d258-433e-9a82-c35cc3a08540","Type":"ContainerDied","Data":"60c65800d76811f46295ea3464db90c86afceff28069d466276e3fdcc5d456e3"} Sep 18 03:43:39.279851 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.279586 2581 scope.go:117] "RemoveContainer" containerID="016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11" Sep 18 03:43:39.281168 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.281080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" event={"ID":"b8e6d4a8-6c27-477b-b248-0f83692a47be","Type":"ContainerStarted","Data":"b7fa1a4f9f0835d60b8eda3c17178a1dbc9224204c3d9696684dc38225f41897"} Sep 18 03:43:39.290327 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.290301 2581 scope.go:117] "RemoveContainer" containerID="016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11" Sep 18 03:43:39.290631 ip-10-0-142-107 kubenswrapper[2581]: E0918 03:43:39.290606 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11\": container with ID starting with 016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11 not found: ID does not exist" containerID="016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11" Sep 18 03:43:39.290741 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.290637 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11"} err="failed to get container status \"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11\": rpc error: code = NotFound desc = could not find container \"016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11\": container with ID starting with 016abd7e8344a0cc55f9af551709e0c28e719b3287a1aa52189e76e288dafd11 not found: ID does not exist" Sep 18 03:43:39.303997 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.303972 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:43:39.313746 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:39.313727 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cfbf689b5-fmm5d"] Sep 18 03:43:40.288849 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:40.288820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" event={"ID":"b8e6d4a8-6c27-477b-b248-0f83692a47be","Type":"ContainerStarted","Data":"0fadd85c6da15bb2c868196bd8cf55e3e48fcd43cb244c27f51b0b120c29d9b0"} Sep 18 03:43:40.307051 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:40.307002 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" podStartSLOduration=1.331870799 podStartE2EDuration="2.306988932s" totalImagesPullingTime="975.118133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:43:40.304762058 +0000 UTC m=+662.062047510" watchObservedRunningTime="2026-09-18 03:43:40.306988932 +0000 UTC m=+662.064274384" Sep 18 03:43:40.431867 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:40.431840 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68c46a2-d258-433e-9a82-c35cc3a08540" path="/var/lib/kubelet/pods/d68c46a2-d258-433e-9a82-c35cc3a08540/volumes" Sep 18 03:43:40.476718 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:40.476698 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:48.477600 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:48.477567 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:48.489814 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:48.489785 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:43:49.344714 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:43:49.344690 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-sgl5x" Sep 18 03:44:31.842604 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.842569 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c"] Sep 18 03:44:31.843193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.843057 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c46a2-d258-433e-9a82-c35cc3a08540" containerName="console" Sep 18 03:44:31.843193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.843076 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c46a2-d258-433e-9a82-c35cc3a08540" containerName="console" Sep 18 03:44:31.843193 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.843187 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68c46a2-d258-433e-9a82-c35cc3a08540" containerName="console" Sep 18 03:44:31.846448 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.846424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.848944 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.848925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 18 03:44:31.853738 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.853705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c"] Sep 18 03:44:31.921368 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qhf\" (UniqueName: \"kubernetes.io/projected/1339c149-0d10-40fe-9efd-bcd4e21dd584-kube-api-access-r7qhf\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.921503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.921503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.921503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.921503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:31.921648 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:31.921534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1339c149-0d10-40fe-9efd-bcd4e21dd584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.021905 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.021872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.021905 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.021909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.021939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.021960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.021988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1339c149-0d10-40fe-9efd-bcd4e21dd584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022158 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.022015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qhf\" (UniqueName: \"kubernetes.io/projected/1339c149-0d10-40fe-9efd-bcd4e21dd584-kube-api-access-r7qhf\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.022342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.022354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.022463 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.022428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.024270 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.024248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1339c149-0d10-40fe-9efd-bcd4e21dd584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.024413 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.024394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1339c149-0d10-40fe-9efd-bcd4e21dd584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.046242 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.046218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qhf\" (UniqueName: \"kubernetes.io/projected/1339c149-0d10-40fe-9efd-bcd4e21dd584-kube-api-access-r7qhf\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-2l22c\" (UID: \"1339c149-0d10-40fe-9efd-bcd4e21dd584\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.156883 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.156830 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:32.429623 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:44:32.429592 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1339c149_0d10_40fe_9efd_bcd4e21dd584.slice/crio-83740a0817362e12ff5ef126bda9b7efb62a238149f55b4426ac76ddf291d24a WatchSource:0}: Error finding container 83740a0817362e12ff5ef126bda9b7efb62a238149f55b4426ac76ddf291d24a: Status 404 returned error can't find the container with id 83740a0817362e12ff5ef126bda9b7efb62a238149f55b4426ac76ddf291d24a Sep 18 03:44:32.431143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.431109 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:44:32.433592 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.433573 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c"] Sep 18 03:44:32.544533 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:32.544507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" event={"ID":"1339c149-0d10-40fe-9efd-bcd4e21dd584","Type":"ContainerStarted","Data":"83740a0817362e12ff5ef126bda9b7efb62a238149f55b4426ac76ddf291d24a"} Sep 18 03:44:33.551216 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:33.551180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" event={"ID":"1339c149-0d10-40fe-9efd-bcd4e21dd584","Type":"ContainerStarted","Data":"34a0ddd888caab23472d0283b6c90348c9ce6cd19ba4fca1baf2520ce9db0b25"} Sep 18 03:44:33.567182 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:33.567137 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" podStartSLOduration=2.390005681 podStartE2EDuration="2.567110004s" totalImagesPullingTime="177.104323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:44:33.565646567 +0000 UTC m=+715.322932019" watchObservedRunningTime="2026-09-18 03:44:33.567110004 +0000 UTC m=+715.324395453" Sep 18 03:44:34.157799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:34.157769 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:42.157204 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:42.157167 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:42.169659 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:42.169632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:44:42.604958 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:44:42.604929 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-2l22c" Sep 18 03:45:00.139588 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.139547 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6"] Sep 18 03:45:00.142950 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.142931 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" Sep 18 03:45:00.145531 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.145506 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4m2x8\"" Sep 18 03:45:00.149474 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.149451 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6"] Sep 18 03:45:00.154503 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.154485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" Sep 18 03:45:00.422414 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.422390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6"] Sep 18 03:45:00.424723 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:45:00.424611 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cddaf6_bf8a_408f_abe5_b1e16e9d8117.slice/crio-7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0 WatchSource:0}: Error finding container 7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0: Status 404 returned error can't find the container with id 7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0 Sep 18 03:45:00.686800 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:00.686721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" event={"ID":"50cddaf6-bf8a-408f-abe5-b1e16e9d8117","Type":"ContainerStarted","Data":"7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0"} Sep 18 03:45:04.708097 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:04.708062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" event={"ID":"50cddaf6-bf8a-408f-abe5-b1e16e9d8117","Type":"ContainerStarted","Data":"e238c9e8329d294e50ea90aa8d59e6b3e690f2d71d9a3f4bfac5e4110fd68e39"} Sep 18 03:45:04.724190 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:04.724147 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" podStartSLOduration=0.884082533 podStartE2EDuration="4.724110378s" totalImagesPullingTime="3.840027845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:45:04.723030749 +0000 UTC m=+746.480316201" watchObservedRunningTime="2026-09-18 03:45:04.724110378 +0000 UTC m=+746.481395830" Sep 18 03:45:05.714201 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:05.714168 2581 generic.go:356] "Generic (PLEG): container finished" podID="50cddaf6-bf8a-408f-abe5-b1e16e9d8117" containerID="e238c9e8329d294e50ea90aa8d59e6b3e690f2d71d9a3f4bfac5e4110fd68e39" exitCode=0 Sep 18 03:45:05.714556 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:05.714256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" event={"ID":"50cddaf6-bf8a-408f-abe5-b1e16e9d8117","Type":"ContainerDied","Data":"e238c9e8329d294e50ea90aa8d59e6b3e690f2d71d9a3f4bfac5e4110fd68e39"} Sep 18 03:45:06.840068 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:06.840046 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" Sep 18 03:45:07.724972 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:07.724946 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" Sep 18 03:45:07.725152 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:07.724944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828385-hd4s6" event={"ID":"50cddaf6-bf8a-408f-abe5-b1e16e9d8117","Type":"ContainerDied","Data":"7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0"} Sep 18 03:45:07.725152 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:07.725068 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e0cd8d056f830ca4df99d19bd9fa791f1a6c32b78dc8018f28367d6fb4628a0" Sep 18 03:45:59.199851 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:59.199817 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-prpvr_aabc83b4-a560-4b32-9179-214a1f11e835/manager/0.log" Sep 18 03:45:59.630847 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:45:59.630823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29828385-hd4s6_50cddaf6-bf8a-408f-abe5-b1e16e9d8117/cleanup/0.log" Sep 18 03:46:00.574321 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:00.574284 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-6csp5_f9efbecb-3ee0-4741-aa46-4b5d8f258c9c/manager/0.log" Sep 18 03:46:00.681907 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:00.681876 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-clbjd_2a5b773e-c0f4-4db2-ad81-241b1d9dd122/manager/0.log" Sep 18 03:46:01.134857 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:01.134828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-9mqbf_087429dd-58db-4fd8-a0df-79a0f372a503/manager/0.log" Sep 18 03:46:01.475960 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:01.475883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v_44a5185d-125c-43c0-80a2-4302f35bd5bd/istio-proxy/0.log" Sep 18 03:46:01.926520 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:01.926490 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-maas-gateway-class-5766995b44-t6cbr_54f8fccd-e37a-40b5-b415-12ff68efe92f/istio-proxy/0.log" Sep 18 03:46:02.030914 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:02.030885 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52_99247e30-c704-43dd-82dd-be97bce7f8c1/istio-proxy/0.log" Sep 18 03:46:02.906662 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:02.906630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-sgl5x_b8e6d4a8-6c27-477b-b248-0f83692a47be/main/0.log" Sep 18 03:46:03.370422 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:03.370395 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-2l22c_1339c149-0d10-40fe-9efd-bcd4e21dd584/main/0.log" Sep 18 03:46:08.982149 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.982101 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6cb42/must-gather-prdkp"] Sep 18 03:46:08.982540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.982435 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cddaf6-bf8a-408f-abe5-b1e16e9d8117" containerName="cleanup" Sep 18 03:46:08.982540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.982447 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cddaf6-bf8a-408f-abe5-b1e16e9d8117" containerName="cleanup" Sep 18 03:46:08.982540 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.982495 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cddaf6-bf8a-408f-abe5-b1e16e9d8117" containerName="cleanup" Sep 18 03:46:08.985465 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.985450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:08.988066 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.988039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6cb42\"/\"default-dockercfg-hl7tk\"" Sep 18 03:46:08.988195 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.988081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cb42\"/\"openshift-service-ca.crt\"" Sep 18 03:46:08.988195 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.988108 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cb42\"/\"kube-root-ca.crt\"" Sep 18 03:46:08.998498 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:08.998474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/must-gather-prdkp"] Sep 18 03:46:09.062633 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.062606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/757327d6-0026-43b8-a9a0-899fd968adfd-must-gather-output\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.062741 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.062638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcfq\" (UniqueName: \"kubernetes.io/projected/757327d6-0026-43b8-a9a0-899fd968adfd-kube-api-access-lxcfq\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.163876 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.163847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/757327d6-0026-43b8-a9a0-899fd968adfd-must-gather-output\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.163876 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.163879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcfq\" (UniqueName: \"kubernetes.io/projected/757327d6-0026-43b8-a9a0-899fd968adfd-kube-api-access-lxcfq\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.164210 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.164192 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/757327d6-0026-43b8-a9a0-899fd968adfd-must-gather-output\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.178775 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.178752 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcfq\" (UniqueName: \"kubernetes.io/projected/757327d6-0026-43b8-a9a0-899fd968adfd-kube-api-access-lxcfq\") pod \"must-gather-prdkp\" (UID: \"757327d6-0026-43b8-a9a0-899fd968adfd\") " pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.299040 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.298986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/must-gather-prdkp" Sep 18 03:46:09.569834 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:09.569808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/must-gather-prdkp"] Sep 18 03:46:09.571324 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:46:09.571297 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod757327d6_0026_43b8_a9a0_899fd968adfd.slice/crio-ac546ee3d6b03c38d371a954ea18b63bf04b507bb9e1779d5cdeaf827d3d0b28 WatchSource:0}: Error finding container ac546ee3d6b03c38d371a954ea18b63bf04b507bb9e1779d5cdeaf827d3d0b28: Status 404 returned error can't find the container with id ac546ee3d6b03c38d371a954ea18b63bf04b507bb9e1779d5cdeaf827d3d0b28 Sep 18 03:46:10.037057 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:10.036981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/must-gather-prdkp" event={"ID":"757327d6-0026-43b8-a9a0-899fd968adfd","Type":"ContainerStarted","Data":"ac546ee3d6b03c38d371a954ea18b63bf04b507bb9e1779d5cdeaf827d3d0b28"} Sep 18 03:46:11.044496 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.044461 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/must-gather-prdkp" event={"ID":"757327d6-0026-43b8-a9a0-899fd968adfd","Type":"ContainerStarted","Data":"3374969363a3d116b15964bf3cbe0d2aeb692530ce6844268af147d4e1d9ea5c"} Sep 18 03:46:11.044496 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.044510 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/must-gather-prdkp" event={"ID":"757327d6-0026-43b8-a9a0-899fd968adfd","Type":"ContainerStarted","Data":"914f024f1224273ae2236aa082e03782c102730532d6cecebf887ff629e407c5"} Sep 18 03:46:11.058474 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.058410 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6cb42/must-gather-prdkp" podStartSLOduration=2.4066764640000002 podStartE2EDuration="3.058390343s" totalImagesPullingTime="651.713879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:46:11.058228354 +0000 UTC m=+812.815513809" watchObservedRunningTime="2026-09-18 03:46:11.058390343 +0000 UTC m=+812.815675796" Sep 18 03:46:11.699861 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.699823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fkndc_99ecca74-c07c-4d46-aebc-7b2e25ce9d5e/global-pull-secret-syncer/0.log" Sep 18 03:46:11.862871 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.862842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sbvzt_61553150-97d9-4af2-902f-4ce7d64d315d/konnectivity-agent/0.log" Sep 18 03:46:11.923591 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:11.923561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-107.ec2.internal_270f868183fab9ab5ab8a92fee0e783a/haproxy/0.log" Sep 18 03:46:16.578394 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:16.578366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-6csp5_f9efbecb-3ee0-4741-aa46-4b5d8f258c9c/manager/0.log" Sep 18 03:46:16.609780 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:16.609744 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-clbjd_2a5b773e-c0f4-4db2-ad81-241b1d9dd122/manager/0.log" Sep 18 03:46:16.747588 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:16.747555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-9mqbf_087429dd-58db-4fd8-a0df-79a0f372a503/manager/0.log" Sep 18 03:46:18.476462 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:18.476429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vflbz_1be949b3-5124-4ef9-9906-51cf77f54d2b/node-exporter/0.log" Sep 18 03:46:18.504321 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:18.504299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vflbz_1be949b3-5124-4ef9-9906-51cf77f54d2b/kube-rbac-proxy/0.log" Sep 18 03:46:18.531358 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:18.531330 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vflbz_1be949b3-5124-4ef9-9906-51cf77f54d2b/init-textfile/0.log" Sep 18 03:46:21.618067 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.618032 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx"] Sep 18 03:46:21.621577 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.621546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.632099 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.632072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx"] Sep 18 03:46:21.639366 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.639321 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68cc6d5775-76v2b_049d5206-313f-4373-8416-7d0616454b4d/console/0.log" Sep 18 03:46:21.705143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.704575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pbd\" (UniqueName: \"kubernetes.io/projected/1e9eb1c8-5921-4583-9b58-cea1870ab96e-kube-api-access-z9pbd\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.705143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.704627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-podres\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.705143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.704655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-lib-modules\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.705143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.704681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-proc\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.705143 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.704708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-sys\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.805951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pbd\" (UniqueName: \"kubernetes.io/projected/1e9eb1c8-5921-4583-9b58-cea1870ab96e-kube-api-access-z9pbd\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-podres\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-lib-modules\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-proc\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-sys\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-sys\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-podres\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-proc\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.806573 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.806533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e9eb1c8-5921-4583-9b58-cea1870ab96e-lib-modules\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.813959 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.813931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pbd\" (UniqueName: \"kubernetes.io/projected/1e9eb1c8-5921-4583-9b58-cea1870ab96e-kube-api-access-z9pbd\") pod \"perf-node-gather-daemonset-wk8lx\" (UID: \"1e9eb1c8-5921-4583-9b58-cea1870ab96e\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:21.935264 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:21.935155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:22.231033 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:22.231009 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx"] Sep 18 03:46:22.233687 ip-10-0-142-107 kubenswrapper[2581]: W0918 03:46:22.233652 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1e9eb1c8_5921_4583_9b58_cea1870ab96e.slice/crio-b6b8f3022f5a7b354cf8686812c4e8e53dfc8ac7aedb80653845a0d0431cc9aa WatchSource:0}: Error finding container b6b8f3022f5a7b354cf8686812c4e8e53dfc8ac7aedb80653845a0d0431cc9aa: Status 404 returned error can't find the container with id b6b8f3022f5a7b354cf8686812c4e8e53dfc8ac7aedb80653845a0d0431cc9aa Sep 18 03:46:23.135841 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.135801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" event={"ID":"1e9eb1c8-5921-4583-9b58-cea1870ab96e","Type":"ContainerStarted","Data":"1575d758a35e3f74d393f0fe4f646424e5c950a54e00173726b26377d324e6f0"} Sep 18 03:46:23.136237 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.135874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:23.136237 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.135900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" event={"ID":"1e9eb1c8-5921-4583-9b58-cea1870ab96e","Type":"ContainerStarted","Data":"b6b8f3022f5a7b354cf8686812c4e8e53dfc8ac7aedb80653845a0d0431cc9aa"} Sep 18 03:46:23.152010 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.151576 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" podStartSLOduration=2.15155755 podStartE2EDuration="2.15155755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:46:23.150469168 +0000 UTC m=+824.907754620" watchObservedRunningTime="2026-09-18 03:46:23.15155755 +0000 UTC m=+824.908843002" Sep 18 03:46:23.349941 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.349911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-858r4_1b9ca056-2996-4592-9eaf-41acadb4c18b/dns/0.log" Sep 18 03:46:23.368406 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.368382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-858r4_1b9ca056-2996-4592-9eaf-41acadb4c18b/kube-rbac-proxy/0.log" Sep 18 03:46:23.454803 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:23.454731 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfv5s_827580c5-03af-41a9-a342-5287291ef1b3/dns-node-resolver/0.log" Sep 18 03:46:24.008237 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:24.008201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pqcz_15adfd16-0a62-45e5-a764-615dd8b45f27/node-ca/0.log" Sep 18 03:46:24.916192 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:24.916162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v_44a5185d-125c-43c0-80a2-4302f35bd5bd/istio-proxy/0.log" Sep 18 03:46:25.036513 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:25.036481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-maas-gateway-class-5766995b44-t6cbr_54f8fccd-e37a-40b5-b415-12ff68efe92f/istio-proxy/0.log" Sep 18 03:46:25.066623 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:25.066594 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52_99247e30-c704-43dd-82dd-be97bce7f8c1/istio-proxy/0.log" Sep 18 03:46:25.784587 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:25.784561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4r56_cecd1955-20ac-45cf-9330-f072207d8360/serve-healthcheck-canary/0.log" Sep 18 03:46:26.360946 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:26.360911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mfpdc_b1dc928f-289f-4da5-998b-62644550177b/kube-rbac-proxy/0.log" Sep 18 03:46:26.382946 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:26.382920 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mfpdc_b1dc928f-289f-4da5-998b-62644550177b/exporter/0.log" Sep 18 03:46:26.403606 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:26.403580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mfpdc_b1dc928f-289f-4da5-998b-62644550177b/extractor/0.log" Sep 18 03:46:28.471650 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:28.471623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7b6444b484-676gs_0d66e76f-3331-4b06-885a-966731b967f4/manager/0.log" Sep 18 03:46:28.491398 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:28.491375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7b6444b484-676gs_0d66e76f-3331-4b06-885a-966731b967f4/copy-manifests/0.log" Sep 18 03:46:29.152731 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:29.152703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-wk8lx" Sep 18 03:46:29.652398 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:29.652365 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-6fd7df589f-xftb6_1a72fa0f-36fa-48c0-afe6-25f88e0f06fd/manager/0.log" Sep 18 03:46:29.679093 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:29.679062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-lf26z_d56f5d8d-6f13-482b-8ce6-541fec47fbcf/jobset-operator/0.log" Sep 18 03:46:30.259673 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:30.259643 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v_44a5185d-125c-43c0-80a2-4302f35bd5bd/istio-proxy/0.log" Sep 18 03:46:30.348213 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:30.348176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-maas-gateway-class-5766995b44-t6cbr_54f8fccd-e37a-40b5-b415-12ff68efe92f/istio-proxy/0.log" Sep 18 03:46:30.362523 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:30.362499 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52_99247e30-c704-43dd-82dd-be97bce7f8c1/istio-proxy/0.log" Sep 18 03:46:30.495694 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:30.495661 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-prpvr_aabc83b4-a560-4b32-9179-214a1f11e835/manager/0.log" Sep 18 03:46:31.648281 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:31.648249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tlt5v_44a5185d-125c-43c0-80a2-4302f35bd5bd/istio-proxy/0.log" Sep 18 03:46:31.745197 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:31.745169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-maas-gateway-class-5766995b44-t6cbr_54f8fccd-e37a-40b5-b415-12ff68efe92f/istio-proxy/0.log" Sep 18 03:46:31.763275 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:31.763246 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-v6w52_99247e30-c704-43dd-82dd-be97bce7f8c1/istio-proxy/0.log" Sep 18 03:46:36.697799 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:36.697767 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-24hdf_af94729f-d2df-447d-bf96-be4ddb151bb1/kube-multus/0.log" Sep 18 03:46:37.014734 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.014668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/kube-multus-additional-cni-plugins/0.log" Sep 18 03:46:37.051516 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.051484 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/egress-router-binary-copy/0.log" Sep 18 03:46:37.087068 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.087044 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/cni-plugins/0.log" Sep 18 03:46:37.118091 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.118065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/bond-cni-plugin/0.log" Sep 18 03:46:37.153993 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.153974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/routeoverride-cni/0.log" Sep 18 03:46:37.188141 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.188094 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/whereabouts-cni-bincopy/0.log" Sep 18 03:46:37.220375 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.220349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shffj_2ac0f76f-8c98-4f73-bfb4-183600d2755b/whereabouts-cni/0.log" Sep 18 03:46:37.320173 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.320147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dxgp9_c785c2d6-dea7-430c-b917-a07c884f1fd3/network-metrics-daemon/0.log" Sep 18 03:46:37.352529 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:37.352504 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dxgp9_c785c2d6-dea7-430c-b917-a07c884f1fd3/kube-rbac-proxy/0.log" Sep 18 03:46:38.247302 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.247227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/ovn-controller/0.log" Sep 18 03:46:38.263224 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.263197 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/ovn-acl-logging/0.log" Sep 18 03:46:38.290742 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.290701 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/kube-rbac-proxy-node/0.log" Sep 18 03:46:38.316332 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.316293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 03:46:38.334089 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.334066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/northd/0.log" Sep 18 03:46:38.357897 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.357873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/nbdb/0.log" Sep 18 03:46:38.380215 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.380178 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/sbdb/0.log" Sep 18 03:46:38.442746 ip-10-0-142-107 kubenswrapper[2581]: I0918 03:46:38.442713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94h9r_9f90a687-e356-4069-a07d-ebf00e33424e/ovnkube-controller/0.log"