Sep 18 14:50:37.882612 ip-10-0-136-56 systemd[1]: Starting Kubernetes Kubelet... Sep 18 14:50:38.313625 ip-10-0-136-56 kubenswrapper[2587]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:38.313625 ip-10-0-136-56 kubenswrapper[2587]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 14:50:38.313625 ip-10-0-136-56 kubenswrapper[2587]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:38.313625 ip-10-0-136-56 kubenswrapper[2587]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 14:50:38.313625 ip-10-0-136-56 kubenswrapper[2587]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:38.314409 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.313730 2587 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320345 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320364 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320367 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320371 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320374 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.320371 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320378 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320382 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320385 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320388 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320391 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320394 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320396 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320399 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320402 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320405 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320407 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320410 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320412 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320415 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320418 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320422 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320426 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320428 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320431 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320434 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.320598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320437 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320439 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320442 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320445 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320450 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320453 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320456 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320458 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320461 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320465 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320467 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320469 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320472 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320475 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320478 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320481 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320484 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320487 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320489 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320492 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.321075 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320494 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320497 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320500 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320502 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320505 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320507 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320510 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320512 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320514 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320518 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320520 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320523 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320525 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320528 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320532 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320536 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320538 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320541 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320544 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320546 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.321603 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320549 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320551 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320554 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320558 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320561 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320564 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320567 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320569 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320572 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320575 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320577 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320580 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320582 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320585 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320587 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320589 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320592 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320595 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320598 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320603 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.322080 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320606 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320609 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320612 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320615 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320617 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320620 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320622 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320625 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320627 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320630 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320633 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320635 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320638 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.320641 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321356 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321365 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321369 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321373 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.322584 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321379 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321382 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321386 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321389 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321392 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321396 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321399 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321412 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321416 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321419 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321422 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321425 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321428 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321431 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321434 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321437 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321440 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321442 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321445 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321447 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.323063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321450 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321452 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321455 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321458 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321460 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321463 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321466 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321468 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321471 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321474 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321477 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321480 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321483 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321486 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321488 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321491 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321494 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321496 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321499 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321502 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.323593 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321504 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321507 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321510 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321512 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321514 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321517 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321520 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321522 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321525 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321528 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321530 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321533 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321537 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321541 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321544 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321546 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321549 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321551 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321554 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321556 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.324090 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321559 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321561 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321564 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321567 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321570 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321573 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321575 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321578 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321581 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321583 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321586 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321588 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321592 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321594 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321597 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321599 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321602 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321605 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321607 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321612 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.324605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321615 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321618 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321620 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321623 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321626 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321628 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321631 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321634 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321636 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321639 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321642 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321644 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321647 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321650 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.321653 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322014 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322019 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322022 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322024 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322027 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.325093 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322030 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322032 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322035 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322038 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322041 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322043 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322046 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322048 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322051 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322053 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322056 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322059 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322062 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322065 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322067 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322070 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322072 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322075 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322078 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322080 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.325597 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322083 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322086 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322089 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322092 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322095 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322098 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322101 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322103 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322109 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322111 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322114 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322117 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322119 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322122 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322124 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322127 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322130 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322132 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322135 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322138 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.326078 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322140 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322143 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322145 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322148 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322151 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322154 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322157 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322161 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322164 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322167 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322170 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322174 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322176 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322179 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322182 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322186 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322188 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322191 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322194 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.326605 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322196 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322201 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322204 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322207 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322210 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322214 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322217 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322220 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322222 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322225 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322227 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322230 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322233 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322236 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322238 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322240 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322243 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322246 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322249 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.327063 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322251 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322256 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322259 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322261 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322264 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322266 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322270 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322273 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322276 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322279 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322281 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322284 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322287 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322289 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322293 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.322296 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322388 2587 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322423 2587 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322429 2587 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322434 2587 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322438 2587 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 14:50:38.327592 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322441 2587 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322445 2587 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322449 2587 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322453 2587 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322456 2587 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322459 2587 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322463 2587 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322467 2587 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322470 2587 flags.go:64] FLAG: --cgroup-root="" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322473 2587 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322476 2587 flags.go:64] FLAG: --client-ca-file="" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322480 2587 flags.go:64] FLAG: --cloud-provider="external" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322483 2587 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322488 2587 flags.go:64] FLAG: --cluster-domain="" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322491 2587 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322494 2587 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322497 2587 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322501 2587 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322505 2587 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322508 2587 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322511 2587 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322515 2587 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322518 2587 flags.go:64] FLAG: --contention-profiling="false" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322521 2587 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 14:50:38.328096 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322524 2587 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322529 2587 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322532 2587 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322536 2587 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322539 2587 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322542 2587 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322545 2587 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322548 2587 flags.go:64] FLAG: --enable-server="true" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322551 2587 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322556 2587 flags.go:64] FLAG: --event-burst="100" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322559 2587 flags.go:64] FLAG: --event-qps="50" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322562 2587 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322565 2587 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322568 2587 flags.go:64] FLAG: --eviction-hard="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322573 2587 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322576 2587 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322581 2587 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322586 2587 flags.go:64] FLAG: --eviction-soft="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322591 2587 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322596 2587 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322601 2587 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322606 2587 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322610 2587 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322613 2587 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322616 2587 flags.go:64] FLAG: --feature-gates="" Sep 18 14:50:38.328693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322620 2587 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322623 2587 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322626 2587 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322629 2587 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322634 2587 flags.go:64] FLAG: --healthz-port="10248" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322637 2587 flags.go:64] FLAG: --help="false" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322640 2587 flags.go:64] FLAG: --hostname-override="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322644 2587 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322648 2587 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322651 2587 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322654 2587 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322657 2587 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322661 2587 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322663 2587 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322666 2587 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322669 2587 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322672 2587 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322675 2587 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322678 2587 flags.go:64] FLAG: --kube-reserved="" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322681 2587 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322684 2587 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322687 2587 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322707 2587 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322711 2587 flags.go:64] FLAG: --lock-file="" Sep 18 14:50:38.329311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322714 2587 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322717 2587 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322721 2587 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322726 2587 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322730 2587 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322733 2587 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322736 2587 flags.go:64] FLAG: --logging-format="text" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322739 2587 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322742 2587 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322745 2587 flags.go:64] FLAG: --manifest-url="" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322748 2587 flags.go:64] FLAG: --manifest-url-header="" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322752 2587 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322756 2587 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322760 2587 flags.go:64] FLAG: --max-pods="110" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322763 2587 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322767 2587 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322770 2587 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322773 2587 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322776 2587 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322780 2587 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322783 2587 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322790 2587 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322793 2587 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322796 2587 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 14:50:38.329950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322799 2587 flags.go:64] FLAG: --pod-cidr="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322802 2587 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322808 2587 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322811 2587 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322814 2587 flags.go:64] FLAG: --pods-per-core="0" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322818 2587 flags.go:64] FLAG: --port="10250" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322821 2587 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322824 2587 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05a630a64607a7156" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322827 2587 flags.go:64] FLAG: --qos-reserved="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322831 2587 flags.go:64] FLAG: --read-only-port="10255" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322834 2587 flags.go:64] FLAG: --register-node="true" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322836 2587 flags.go:64] FLAG: --register-with-taints="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322840 2587 flags.go:64] FLAG: --registry-burst="10" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322843 2587 flags.go:64] FLAG: --registry-qps="5" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322846 2587 flags.go:64] FLAG: --reserved-cpus="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322849 2587 flags.go:64] FLAG: --reserved-memory="" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322853 2587 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322856 2587 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322859 2587 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322862 2587 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322866 2587 flags.go:64] FLAG: --runonce="false" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322869 2587 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322872 2587 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322875 2587 flags.go:64] FLAG: --seccomp-default="false" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322878 2587 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 14:50:38.330549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322882 2587 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322885 2587 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322888 2587 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322891 2587 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322894 2587 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322898 2587 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322901 2587 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322904 2587 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322907 2587 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322910 2587 flags.go:64] FLAG: --system-cgroups="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322913 2587 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322918 2587 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322921 2587 flags.go:64] FLAG: --tls-cert-file="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322924 2587 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322928 2587 flags.go:64] FLAG: --tls-min-version="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322931 2587 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322934 2587 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322937 2587 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322940 2587 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322943 2587 flags.go:64] FLAG: --v="2" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322947 2587 flags.go:64] FLAG: --version="false" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322952 2587 flags.go:64] FLAG: --vmodule="" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322956 2587 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.322960 2587 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323073 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.331186 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323076 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323080 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323086 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323089 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323092 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323095 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323098 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323101 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323103 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323106 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323109 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323112 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323116 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323119 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323122 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323126 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323129 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323132 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323135 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323138 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.331797 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323141 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323143 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323146 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323149 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323152 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323154 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323157 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323159 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323162 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323182 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323185 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323188 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323191 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323193 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323197 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323200 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323202 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323205 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323207 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323211 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.332292 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323214 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323217 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323219 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323222 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323225 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323228 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323230 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323233 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323236 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323238 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323241 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323244 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323247 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323249 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323252 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323254 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323258 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323260 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323263 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.332786 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323265 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323268 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323271 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323277 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323281 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323283 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323286 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323290 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323293 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323297 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323301 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323305 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323310 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323325 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323328 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323331 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323334 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323336 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323339 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323342 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.333260 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323345 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323348 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323350 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323353 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323356 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323359 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323361 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323365 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323369 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323372 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323375 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323378 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323380 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323384 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323388 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323391 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323395 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323398 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.333768 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.323401 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.323408 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.330941 2587 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.330956 2587 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.330975 2587 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.330981 2587 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331038 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331042 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331045 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331049 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331052 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331054 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331058 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331061 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331063 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.334197 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331066 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331069 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331072 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331075 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331077 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331080 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331083 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331086 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331088 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331091 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331093 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331096 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331099 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331102 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331104 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331107 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331110 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331112 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331117 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331120 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.334666 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331125 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331128 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331131 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331134 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331137 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331139 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331142 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331145 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331147 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331150 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331153 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331155 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331158 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331161 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331165 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331168 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331171 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331174 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331177 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331179 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.335241 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331182 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331185 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331187 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331191 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331195 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331199 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331202 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331204 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331207 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331210 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331213 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331215 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331218 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331222 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331225 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331228 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331231 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331233 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331236 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.335767 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331239 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331242 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331245 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331247 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331250 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331253 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331256 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331258 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331261 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331263 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331266 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331269 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331272 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331274 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331277 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331280 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331283 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331285 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331288 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331290 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.336234 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331293 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331296 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331298 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331301 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331304 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331307 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331310 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331330 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331334 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331337 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331340 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.331345 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331456 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331461 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331464 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331467 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:38.336729 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331470 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331473 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331476 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331479 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331482 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331484 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331487 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331490 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331492 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331495 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331498 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331500 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331503 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331506 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331508 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331511 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331513 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331516 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331519 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:38.337124 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331522 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331524 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331528 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331531 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331534 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331537 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331540 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331543 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331545 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331548 2587 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331550 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331553 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331556 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331558 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331561 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331564 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331566 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331569 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331572 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331574 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:38.337596 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331577 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331579 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331582 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331585 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331587 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331590 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331592 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331595 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331598 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331602 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331606 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331608 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331611 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331614 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331616 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331619 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331623 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331627 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331630 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331633 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:38.338071 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331636 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331639 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331641 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331644 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331647 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331649 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331652 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331655 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331657 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331660 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331664 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331667 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331670 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331673 2587 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331676 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331679 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331683 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331685 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331688 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:38.338616 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331691 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331694 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331696 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331699 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331702 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331704 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331707 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331710 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331713 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331716 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331718 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331721 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331724 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331727 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331729 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331732 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:38.339074 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:38.331735 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.331740 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.331850 2587 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.334224 2587 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.335337 2587 server.go:1019] "Starting client certificate rotation" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.335433 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.335462 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.338178 2587 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:50:38.339719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.339255 2587 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:50:38.351876 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.351856 2587 log.go:25] "Validated CRI v1 runtime API" Sep 18 14:50:38.355583 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.355569 2587 log.go:25] "Validated CRI v1 image API" Sep 18 14:50:38.356429 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.356413 2587 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 14:50:38.359770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.359753 2587 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7aa215c8-f71f-4554-a6fa-60472f4136b8:/dev/nvme0n1p4 c113b13a-f2cd-4599-a3f1-26e32a37c183:/dev/nvme0n1p3] Sep 18 14:50:38.359832 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.359769 2587 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 14:50:38.364922 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.364817 2587 manager.go:216] Machine: {Timestamp:2026-09-18 14:50:38.363393557 +0000 UTC m=+0.371757959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101327 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22f594c503d4de67a840b0de6470eb SystemUUID:ec22f594-c503-d4de-67a8-40b0de6470eb BootID:ffe02970-be43-4ac2-991d-e6445d4053b3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dc:29:59:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dc:29:59:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:3a:1c:01:6c:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 14:50:38.364922 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.364917 2587 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 14:50:38.365030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.365018 2587 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 14:50:38.366383 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.366367 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:50:38.368372 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.368346 2587 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 14:50:38.368496 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.368375 2587 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-56.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 14:50:38.369258 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.369249 2587 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 14:50:38.369289 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.369261 2587 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 14:50:38.369289 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.369269 2587 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:50:38.369289 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.369282 2587 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:50:38.369449 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.369359 2587 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 14:50:38.373802 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373791 2587 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:50:38.373905 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373896 2587 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 14:50:38.373945 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373922 2587 kubelet.go:486] "Attempting to sync node with API server" Sep 18 14:50:38.373945 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373931 2587 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 14:50:38.373945 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373945 2587 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 14:50:38.374055 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373954 2587 kubelet.go:398] "Adding apiserver pod source" Sep 18 14:50:38.374055 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.373969 2587 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 14:50:38.374305 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.374284 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:50:38.374305 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.374301 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:50:38.376677 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.376658 2587 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 14:50:38.379649 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.379635 2587 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 14:50:38.379703 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.379666 2587 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 14:50:38.381259 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381240 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381267 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381275 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381280 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381288 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381293 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381307 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 14:50:38.381311 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381312 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 14:50:38.381526 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381335 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 14:50:38.381526 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381341 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 14:50:38.381526 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381350 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 14:50:38.381526 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.381355 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 14:50:38.382229 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.382218 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 14:50:38.382262 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.382229 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 14:50:38.386086 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.386065 2587 server.go:1268] "Started kubelet" Sep 18 14:50:38.386195 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.386154 2587 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 14:50:38.386257 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.386202 2587 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-56.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 14:50:38.386257 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.386213 2587 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 14:50:38.386369 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.386284 2587 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 14:50:38.386423 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.386397 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 14:50:38.386528 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.386503 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 14:50:38.386997 ip-10-0-136-56 systemd[1]: Started Kubernetes Kubelet. Sep 18 14:50:38.387971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.387953 2587 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 14:50:38.391248 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.391213 2587 server.go:310] "Adding debug handlers to kubelet server" Sep 18 14:50:38.394956 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.394925 2587 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 14:50:38.397716 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.396632 2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-56.ec2.internal.18d671cf9a3a5f4c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-56.ec2.internal,UID:ip-10-0-136-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-56.ec2.internal,},FirstTimestamp:2026-09-18 14:50:38.386036556 +0000 UTC m=+0.394400937,LastTimestamp:2026-09-18 14:50:38.386036556 +0000 UTC m=+0.394400937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-56.ec2.internal,}" Sep 18 14:50:38.399785 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.399770 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 14:50:38.400455 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.400438 2587 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 14:50:38.400975 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.400948 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.401158 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401144 2587 factory.go:55] Registering systemd factory Sep 18 14:50:38.401216 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401163 2587 factory.go:223] Registration of the systemd container factory successfully Sep 18 14:50:38.401216 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401204 2587 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 14:50:38.401297 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401207 2587 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 14:50:38.401297 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401232 2587 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 14:50:38.401399 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401298 2587 reconstruct.go:97] "Volume reconstruction finished" Sep 18 14:50:38.401399 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401307 2587 reconciler.go:29] "Reconciler: start to sync state" Sep 18 14:50:38.401502 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401416 2587 factory.go:153] Registering CRI-O factory Sep 18 14:50:38.401502 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401432 2587 factory.go:223] Registration of the crio container factory successfully Sep 18 14:50:38.401502 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401483 2587 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 14:50:38.401631 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401504 2587 factory.go:103] Registering Raw factory Sep 18 14:50:38.401631 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401520 2587 manager.go:1196] Started watching for new ooms in manager Sep 18 14:50:38.401862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.401849 2587 manager.go:349] Starting recovery of all containers Sep 18 14:50:38.409399 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.409373 2587 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 14:50:38.409573 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.409549 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 14:50:38.411625 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.411607 2587 manager.go:354] Recovery completed Sep 18 14:50:38.413060 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.413041 2587 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 14:50:38.414369 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.414347 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7slk" Sep 18 14:50:38.416100 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.416087 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.418784 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.418769 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.418858 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.418802 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.418858 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.418821 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.419408 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.419384 2587 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 14:50:38.419408 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.419398 2587 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 14:50:38.419535 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.419416 2587 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:50:38.419535 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.419428 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.420050 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.420037 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7slk" Sep 18 14:50:38.420372 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.420354 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.420470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.420380 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.420470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.420395 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.501745 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.501578 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.562596 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.562577 2587 policy_none.go:49] "None policy: Start" Sep 18 14:50:38.562662 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.562601 2587 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 14:50:38.562662 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.562614 2587 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 14:50:38.564695 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.564640 2587 policy_none.go:47] "Start" Sep 18 14:50:38.599766 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.599738 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 14:50:38.600982 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.600965 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 14:50:38.601077 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.601014 2587 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 14:50:38.601077 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.601035 2587 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 14:50:38.601183 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.601132 2587 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 18 14:50:38.601792 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.601773 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.603024 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603003 2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:38.603112 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603047 2587 manager.go:337] "Starting Device Plugin manager" Sep 18 14:50:38.603112 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.603090 2587 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 14:50:38.603112 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603103 2587 server.go:87] "Starting device plugin registration server" Sep 18 14:50:38.603546 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603525 2587 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 14:50:38.603661 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603546 2587 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 14:50:38.603720 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603682 2587 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 14:50:38.603770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603757 2587 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 14:50:38.603770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.603766 2587 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 14:50:38.604513 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.604494 2587 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 14:50:38.604620 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.604537 2587 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.613099 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.613081 2587 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-56.ec2.internal\" not found" node="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.701277 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.701245 2587 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal"] Sep 18 14:50:38.701416 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.701368 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.702418 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.702402 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.702495 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.702431 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.702495 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.702442 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.704557 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.704544 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.704753 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.704739 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.704859 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.704845 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.704895 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.704878 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.705374 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705357 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705380 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705389 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705436 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705419 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705480 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.705524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705514 2587 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.705820 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705557 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.705820 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705582 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.705820 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.705597 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.707579 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.707566 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.707621 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.707590 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:38.708274 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.708259 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:38.708389 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.708288 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:38.708389 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.708301 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:38.714180 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.714166 2587 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.714251 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.714184 2587 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-56.ec2.internal\": node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.720848 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.720831 2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-56.ec2.internal\" not found" node="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.725217 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.725201 2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-56.ec2.internal\" not found" node="ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.732920 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.732906 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.833124 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.833061 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:38.902658 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.902638 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.902722 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.902664 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.902722 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:38.902679 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bb35ee79734ff1cf6984dd2bb703b59-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"1bb35ee79734ff1cf6984dd2bb703b59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:38.933744 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:38.933723 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.003089 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003059 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bb35ee79734ff1cf6984dd2bb703b59-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"1bb35ee79734ff1cf6984dd2bb703b59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.003089 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003094 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.003184 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003113 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.003184 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003159 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.003184 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003164 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bb35ee79734ff1cf6984dd2bb703b59-config\") pod \"kube-apiserver-proxy-ip-10-0-136-56.ec2.internal\" (UID: \"1bb35ee79734ff1cf6984dd2bb703b59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.003269 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.003169 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6fcd66477100f8d6ba3bb24e379bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal\" (UID: \"a8e6fcd66477100f8d6ba3bb24e379bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.024207 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.024187 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.029272 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.029252 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.034031 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:39.034013 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.134531 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:39.134467 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.235598 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:39.235572 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.334632 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.334600 2587 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 14:50:39.335141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.334738 2587 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 14:50:39.335758 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:39.335743 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.428181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.428119 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 14:45:38 +0000 UTC" deadline="2028-02-22 06:05:34.968884709 +0000 UTC" Sep 18 14:50:39.428181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.428150 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12519h14m55.540739063s" Sep 18 14:50:39.436538 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:39.436523 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-56.ec2.internal\" not found" Sep 18 14:50:39.444236 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.444218 2587 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:39.501323 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.501288 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.511499 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.511474 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:50:39.513609 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.513590 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" Sep 18 14:50:39.525836 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.525816 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:50:39.618383 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:39.618347 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e6fcd66477100f8d6ba3bb24e379bf.slice/crio-9617712cb697462bb6d95d17cf391602a8a7aaa5240fabed8a157f07801a062f WatchSource:0}: Error finding container 9617712cb697462bb6d95d17cf391602a8a7aaa5240fabed8a157f07801a062f: Status 404 returned error can't find the container with id 9617712cb697462bb6d95d17cf391602a8a7aaa5240fabed8a157f07801a062f Sep 18 14:50:39.618747 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:39.618711 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb35ee79734ff1cf6984dd2bb703b59.slice/crio-3600ed0a3c51f86ee79b7bb2058af4236186f7cf6f1111332d66d0018d79c857 WatchSource:0}: Error finding container 3600ed0a3c51f86ee79b7bb2058af4236186f7cf6f1111332d66d0018d79c857: Status 404 returned error can't find the container with id 3600ed0a3c51f86ee79b7bb2058af4236186f7cf6f1111332d66d0018d79c857 Sep 18 14:50:39.625473 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.625457 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:50:39.798477 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.798401 2587 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:39.979606 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:39.979578 2587 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:40.155598 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.155521 2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:40.375238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.375209 2587 apiserver.go:52] "Watching apiserver" Sep 18 14:50:40.383009 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.382981 2587 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 14:50:40.383565 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.383539 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4","openshift-cluster-node-tuning-operator/tuned-sjfvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal","openshift-network-operator/iptables-alerter-wdt7x","openshift-ovn-kubernetes/ovnkube-node-mhw4t","kube-system/global-pull-secret-syncer-chcx5","kube-system/konnectivity-agent-46j7z","openshift-dns/node-resolver-z7zsk","openshift-image-registry/node-ca-4h5lv","openshift-multus/multus-additional-cni-plugins-2pdnx","openshift-multus/multus-x8fb6","openshift-multus/network-metrics-daemon-fmggv","openshift-network-diagnostics/network-check-target-mfpqc","kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal"] Sep 18 14:50:40.386408 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.386388 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.391141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.390164 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 14:50:40.391141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.390312 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.391141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.390660 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.391141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.390967 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.391685 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.391651 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 14:50:40.391918 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.391899 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xjw5v\"" Sep 18 14:50:40.392541 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.392522 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.394586 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.394566 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4w64w\"" Sep 18 14:50:40.394682 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.394631 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 14:50:40.394762 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.394737 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 14:50:40.394841 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.394823 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 14:50:40.395110 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.395084 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.395726 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.395552 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.396507 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.396425 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xzdch\"" Sep 18 14:50:40.396660 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.396628 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.397572 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.397550 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.397824 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.397774 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 14:50:40.397908 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.397889 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.398063 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.398046 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jn4pq\"" Sep 18 14:50:40.398696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.398359 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.400351 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.400331 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.400829 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.400985 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401001 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401016 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401033 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k5vbt\"" Sep 18 14:50:40.401550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401220 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 14:50:40.401897 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401618 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.401897 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.401844 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.401992 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.401924 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:40.404140 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.404121 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.407105 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.407076 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 14:50:40.407208 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.407169 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 14:50:40.407280 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.407079 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.407450 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.407354 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2s2kj\"" Sep 18 14:50:40.410126 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.409543 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.410227 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.410164 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.410227 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.410171 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pks6x\"" Sep 18 14:50:40.410472 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.410447 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.411910 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.411603 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 14:50:40.411910 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.411862 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5qzb4\"" Sep 18 14:50:40.412065 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.411862 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-hostroot\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412065 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412019 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-ovn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412065 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412047 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-log-socket\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412071 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-netd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412097 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412123 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-system-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412147 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-daemon-config\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412160 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412173 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412199 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412246 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-env-overrides\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412278 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412304 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-bin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412330 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-kubelet\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412384 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-etc-kubernetes\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412408 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412430 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cnibin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412452 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-systemd-units\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412480 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/147b5ed9-531a-4f52-8080-92272c0acd32-ovn-node-metrics-cert\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412509 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-kubelet-config\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412535 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-multus\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412559 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-conf-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.412618 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412582 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-host-slash\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412631 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-device-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412652 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412657 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-script-lib\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412681 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-dbus\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412686 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412704 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-node-log\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412730 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-multus-certs\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412755 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cni-binary-copy\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412801 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412780 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cnibin\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412846 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412930 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412957 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-slash\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.412997 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413027 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413079 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmvx\" (UniqueName: \"kubernetes.io/projected/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-kube-api-access-stmvx\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413115 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt67t\" (UniqueName: \"kubernetes.io/projected/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-kube-api-access-dt67t\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.413223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413166 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-config\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413208 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-socket-dir-parent\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413238 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-k8s-cni-cncf-io\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413295 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413349 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-kubelet\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413383 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-systemd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413412 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-netns\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413437 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-iptables-alerter-script\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413470 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/7602a24b-4d95-45b9-95c7-0a5e53d1b067-kube-api-access-xmmb2\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413494 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413533 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413617 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-bin\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413693 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-sys-fs\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413719 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-socket-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413744 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h5x2\" (UniqueName: \"kubernetes.io/projected/f637132f-bf90-426e-aa11-645802b79e26-kube-api-access-6h5x2\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413768 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-netns\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413791 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-etc-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413818 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffkpn\" (UniqueName: \"kubernetes.io/projected/147b5ed9-531a-4f52-8080-92272c0acd32-kube-api-access-ffkpn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413873 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-registration-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.414789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.413906 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-var-lib-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.414789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.414403 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:50:40.414789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.414693 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kf2g9\"" Sep 18 14:50:40.415044 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.414993 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 14:50:40.416672 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.415883 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.416672 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.415957 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:40.417507 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.417364 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:40.417507 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.417455 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:40.432617 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.432592 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8z46m" Sep 18 14:50:40.440263 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.440238 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8z46m" Sep 18 14:50:40.502320 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.502294 2587 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 14:50:40.514896 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514867 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-conf-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514908 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-host-slash\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514930 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-device-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514953 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-script-lib\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514977 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-dbus\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.514988 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-conf-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515004 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-lib-modules\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515016 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-host-slash\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.515030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515028 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lp4r\" (UniqueName: \"kubernetes.io/projected/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-kube-api-access-8lp4r\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515056 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-node-log\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515082 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-multus-certs\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515107 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cni-binary-copy\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515132 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cnibin\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515173 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515199 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515203 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-device-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515307 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-slash\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515333 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-dbus\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515346 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cnibin\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515357 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515405 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-modprobe-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515432 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515458 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-conf\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.515500 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515490 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-tuned\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515528 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-tmp\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515554 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5f9012-4406-4848-ac62-d64e3024d752-agent-certs\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515581 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-tmp-dir\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515589 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-script-lib\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515609 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515637 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stmvx\" (UniqueName: \"kubernetes.io/projected/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-kube-api-access-stmvx\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515658 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-slash\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515693 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt67t\" (UniqueName: \"kubernetes.io/projected/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-kube-api-access-dt67t\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515705 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-multus-certs\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515733 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-config\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515747 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-node-log\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515751 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-systemd\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515784 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-var-lib-kubelet\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515812 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515847 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-socket-dir-parent\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515910 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.516238 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515948 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cni-binary-copy\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515964 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.515964 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-k8s-cni-cncf-io\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516009 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516019 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516033 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-socket-dir-parent\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516036 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-kubelet\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516051 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-k8s-cni-cncf-io\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516065 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516102 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-kubelet\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516104 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-systemd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516147 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-host\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516159 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-systemd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516177 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516204 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m97b\" (UniqueName: \"kubernetes.io/projected/93296853-4fd6-4d4f-9e02-ee4ec7428545-kube-api-access-9m97b\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516234 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-netns\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516259 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-iptables-alerter-script\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.517164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516286 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/7602a24b-4d95-45b9-95c7-0a5e53d1b067-kube-api-access-xmmb2\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516305 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-run-netns\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516344 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516373 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516399 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-bin\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516429 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmgs\" (UniqueName: \"kubernetes.io/projected/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-kube-api-access-cvmgs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516441 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7602a24b-4d95-45b9-95c7-0a5e53d1b067-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516456 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-sys-fs\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516511 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-bin\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516514 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-socket-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516569 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h5x2\" (UniqueName: \"kubernetes.io/projected/f637132f-bf90-426e-aa11-645802b79e26-kube-api-access-6h5x2\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516597 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-netns\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516602 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-ovnkube-config\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516629 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-etc-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516655 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffkpn\" (UniqueName: \"kubernetes.io/projected/147b5ed9-531a-4f52-8080-92272c0acd32-kube-api-access-ffkpn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516682 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-sys-fs\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516689 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-netns\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516682 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-registration-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516737 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-etc-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516744 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8qn\" (UniqueName: \"kubernetes.io/projected/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-kube-api-access-hp8qn\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516789 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-var-lib-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516790 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-registration-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516656 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f637132f-bf90-426e-aa11-645802b79e26-socket-dir\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516820 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f9012-4406-4848-ac62-d64e3024d752-konnectivity-ca\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516846 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-host\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516852 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-var-lib-openvswitch\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516889 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-kubernetes\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516901 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-iptables-alerter-script\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516926 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-hostroot\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516969 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-ovn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516984 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.516996 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-hostroot\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517054 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-log-socket\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517089 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-run-ovn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.518856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517132 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-netd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517149 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517182 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-system-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.517205 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517232 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-daemon-config\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517260 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.517276 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:41.017255438 +0000 UTC m=+3.025619811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517303 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517328 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-env-overrides\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517351 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-cni-netd\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517361 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysconfig\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517392 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-log-socket\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517509 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-system-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517531 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517304 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517695 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-serviceca\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517736 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.519553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517782 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-bin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517810 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-kubelet\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517858 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-etc-kubernetes\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517882 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/147b5ed9-531a-4f52-8080-92272c0acd32-env-overrides\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517884 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517933 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cnibin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517940 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-bin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517959 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-systemd-units\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.517970 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-kubelet\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518005 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/147b5ed9-531a-4f52-8080-92272c0acd32-ovn-node-metrics-cert\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518020 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-cni-dir\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518052 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-etc-kubernetes\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518096 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-cnibin\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518096 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/147b5ed9-531a-4f52-8080-92272c0acd32-systemd-units\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518147 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-kubelet-config\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518051 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-multus-daemon-config\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518195 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-hosts-file\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518238 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb2c9653-03f6-4892-b12f-1aedfee9cf93-kubelet-config\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:40.520288 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518285 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-multus\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518324 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-run\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518373 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-sys\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518344 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-host-var-lib-cni-multus\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518399 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518457 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7602a24b-4d95-45b9-95c7-0a5e53d1b067-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.521241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.518587 2587 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 14:50:40.523235 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.523212 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/147b5ed9-531a-4f52-8080-92272c0acd32-ovn-node-metrics-cert\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.524372 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.524312 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmvx\" (UniqueName: \"kubernetes.io/projected/822d3b6a-db13-4af3-8e57-b7bb7cc592ad-kube-api-access-stmvx\") pod \"multus-x8fb6\" (UID: \"822d3b6a-db13-4af3-8e57-b7bb7cc592ad\") " pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.525971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.525948 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h5x2\" (UniqueName: \"kubernetes.io/projected/f637132f-bf90-426e-aa11-645802b79e26-kube-api-access-6h5x2\") pod \"aws-ebs-csi-driver-node-jmxk4\" (UID: \"f637132f-bf90-426e-aa11-645802b79e26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.526565 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.526530 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt67t\" (UniqueName: \"kubernetes.io/projected/7e19b7bd-848c-4be0-b6c3-913c4ce03ec2-kube-api-access-dt67t\") pod \"iptables-alerter-wdt7x\" (UID: \"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2\") " pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.527475 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.527445 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/7602a24b-4d95-45b9-95c7-0a5e53d1b067-kube-api-access-xmmb2\") pod \"multus-additional-cni-plugins-2pdnx\" (UID: \"7602a24b-4d95-45b9-95c7-0a5e53d1b067\") " pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.528820 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.528798 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffkpn\" (UniqueName: \"kubernetes.io/projected/147b5ed9-531a-4f52-8080-92272c0acd32-kube-api-access-ffkpn\") pod \"ovnkube-node-mhw4t\" (UID: \"147b5ed9-531a-4f52-8080-92272c0acd32\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.605636 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.605589 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"a8e6fcd66477100f8d6ba3bb24e379bf","Type":"ContainerStarted","Data":"9617712cb697462bb6d95d17cf391602a8a7aaa5240fabed8a157f07801a062f"} Sep 18 14:50:40.606671 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.606638 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" event={"ID":"1bb35ee79734ff1cf6984dd2bb703b59","Type":"ContainerStarted","Data":"3600ed0a3c51f86ee79b7bb2058af4236186f7cf6f1111332d66d0018d79c857"} Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.618966 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-lib-modules\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619088 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lp4r\" (UniqueName: \"kubernetes.io/projected/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-kube-api-access-8lp4r\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619139 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-modprobe-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619157 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-lib-modules\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619172 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619202 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-conf\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619226 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-tuned\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619255 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-tmp\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619288 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-modprobe-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619285 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5f9012-4406-4848-ac62-d64e3024d752-agent-certs\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619338 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-tmp-dir\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619388 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-systemd\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619413 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-var-lib-kubelet\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619443 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619477 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-host\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619508 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m97b\" (UniqueName: \"kubernetes.io/projected/93296853-4fd6-4d4f-9e02-ee4ec7428545-kube-api-access-9m97b\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.622424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619540 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmgs\" (UniqueName: \"kubernetes.io/projected/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-kube-api-access-cvmgs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619579 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8qn\" (UniqueName: \"kubernetes.io/projected/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-kube-api-access-hp8qn\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619612 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f9012-4406-4848-ac62-d64e3024d752-konnectivity-ca\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619646 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-host\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619676 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-kubernetes\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619732 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysconfig\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619751 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-conf\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.619761 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-serviceca\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620219 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-serviceca\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620273 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-hosts-file\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620313 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-run\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620339 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-sys\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620373 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.620537 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.620604 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:41.120586269 +0000 UTC m=+3.128950662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620868 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-systemd\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.620941 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-var-lib-kubelet\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.621215 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-host\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.623324 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622308 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-host\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622383 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f9012-4406-4848-ac62-d64e3024d752-konnectivity-ca\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622680 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-tmp-dir\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622732 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-kubernetes\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622742 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-hosts-file\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622821 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-sys\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622845 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-run\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.622854 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysconfig\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624064 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.623017 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-sysctl-d\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624939 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.624688 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-tmp\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.624939 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.624726 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93296853-4fd6-4d4f-9e02-ee4ec7428545-etc-tuned\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.625480 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.625455 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5f9012-4406-4848-ac62-d64e3024d752-agent-certs\") pod \"konnectivity-agent-46j7z\" (UID: \"3a5f9012-4406-4848-ac62-d64e3024d752\") " pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.627290 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.627269 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:40.627403 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.627295 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:40.627403 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.627311 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:40.627403 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:40.627402 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:41.127382716 +0000 UTC m=+3.135747107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:40.627758 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.627738 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lp4r\" (UniqueName: \"kubernetes.io/projected/1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05-kube-api-access-8lp4r\") pod \"node-ca-4h5lv\" (UID: \"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05\") " pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.629826 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.629801 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m97b\" (UniqueName: \"kubernetes.io/projected/93296853-4fd6-4d4f-9e02-ee4ec7428545-kube-api-access-9m97b\") pod \"tuned-sjfvg\" (UID: \"93296853-4fd6-4d4f-9e02-ee4ec7428545\") " pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:40.631258 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.631240 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8qn\" (UniqueName: \"kubernetes.io/projected/5062fc02-6bd1-4530-b7e3-60c8f9e36e9d-kube-api-access-hp8qn\") pod \"node-resolver-z7zsk\" (UID: \"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d\") " pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.631442 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.631418 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmgs\" (UniqueName: \"kubernetes.io/projected/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-kube-api-access-cvmgs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:40.705231 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.705172 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" Sep 18 14:50:40.711870 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.711851 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fb6" Sep 18 14:50:40.723915 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.723891 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdt7x" Sep 18 14:50:40.730799 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.730779 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" Sep 18 14:50:40.740717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.740695 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:50:40.748600 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.748583 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:50:40.757298 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.757276 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7zsk" Sep 18 14:50:40.762983 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.762967 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4h5lv" Sep 18 14:50:40.769709 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:40.769692 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" Sep 18 14:50:41.023565 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.023478 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:41.023734 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.023653 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:41.023734 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.023724 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:42.023707345 +0000 UTC m=+4.032071714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:41.124326 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.124290 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:41.124513 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.124459 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:41.124567 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.124539 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:42.124521216 +0000 UTC m=+4.132885591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:41.225428 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.225385 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:41.225605 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.225563 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:41.225605 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.225586 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:41.225605 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.225600 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:41.225775 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.225661 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:42.225643152 +0000 UTC m=+4.234007523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:41.444937 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.444843 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:45:40 +0000 UTC" deadline="2028-03-16 09:06:30.044670008 +0000 UTC" Sep 18 14:50:41.444937 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.444889 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13074h15m48.599789388s" Sep 18 14:50:41.602094 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:41.602067 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:41.602253 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:41.602175 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:41.691531 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.691501 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822d3b6a_db13_4af3_8e57_b7bb7cc592ad.slice/crio-04c2a2dc5c7b1dff2947711ed0233ef12408ca91791a99859697bd3f2e51e233 WatchSource:0}: Error finding container 04c2a2dc5c7b1dff2947711ed0233ef12408ca91791a99859697bd3f2e51e233: Status 404 returned error can't find the container with id 04c2a2dc5c7b1dff2947711ed0233ef12408ca91791a99859697bd3f2e51e233 Sep 18 14:50:41.693209 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.692978 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7602a24b_4d95_45b9_95c7_0a5e53d1b067.slice/crio-3ef0c11c365e64c7109d12f4747581e19a26ba2cc36561c3de809969ff674826 WatchSource:0}: Error finding container 3ef0c11c365e64c7109d12f4747581e19a26ba2cc36561c3de809969ff674826: Status 404 returned error can't find the container with id 3ef0c11c365e64c7109d12f4747581e19a26ba2cc36561c3de809969ff674826 Sep 18 14:50:41.696985 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.696958 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147b5ed9_531a_4f52_8080_92272c0acd32.slice/crio-4c31a798e74a6fab8bf0548c5215aa718fb2f2e4f8ee9e1a473b646edd18f5a5 WatchSource:0}: Error finding container 4c31a798e74a6fab8bf0548c5215aa718fb2f2e4f8ee9e1a473b646edd18f5a5: Status 404 returned error can't find the container with id 4c31a798e74a6fab8bf0548c5215aa718fb2f2e4f8ee9e1a473b646edd18f5a5 Sep 18 14:50:41.697691 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.697666 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e19b7bd_848c_4be0_b6c3_913c4ce03ec2.slice/crio-7acb0f104bcd9aafa2c318ad330b2c6c236a894eb5650aceb32a340bd92f65f9 WatchSource:0}: Error finding container 7acb0f104bcd9aafa2c318ad330b2c6c236a894eb5650aceb32a340bd92f65f9: Status 404 returned error can't find the container with id 7acb0f104bcd9aafa2c318ad330b2c6c236a894eb5650aceb32a340bd92f65f9 Sep 18 14:50:41.698586 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.698561 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf637132f_bf90_426e_aa11_645802b79e26.slice/crio-283d69a30fe18f9680a76b46ad0030d73bf84d408c52da0bd660c6c7f4b893f0 WatchSource:0}: Error finding container 283d69a30fe18f9680a76b46ad0030d73bf84d408c52da0bd660c6c7f4b893f0: Status 404 returned error can't find the container with id 283d69a30fe18f9680a76b46ad0030d73bf84d408c52da0bd660c6c7f4b893f0 Sep 18 14:50:41.704303 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.704283 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5f9012_4406_4848_ac62_d64e3024d752.slice/crio-73b334065c6c2c26009d380622de224e27abfe6cd4f8c8f0f9ad04b3344188a3 WatchSource:0}: Error finding container 73b334065c6c2c26009d380622de224e27abfe6cd4f8c8f0f9ad04b3344188a3: Status 404 returned error can't find the container with id 73b334065c6c2c26009d380622de224e27abfe6cd4f8c8f0f9ad04b3344188a3 Sep 18 14:50:41.705418 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:50:41.705369 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d91dd8e_f7f5_46fb_b2ad_f547eb4ffc05.slice/crio-826b028338b881f73836a37fad6240c4d1e3fa2628aae67db50b853abba44b60 WatchSource:0}: Error finding container 826b028338b881f73836a37fad6240c4d1e3fa2628aae67db50b853abba44b60: Status 404 returned error can't find the container with id 826b028338b881f73836a37fad6240c4d1e3fa2628aae67db50b853abba44b60 Sep 18 14:50:42.033796 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.033621 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:42.033940 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.033775 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:42.033940 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.033869 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:44.033852542 +0000 UTC m=+6.042216926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:42.134443 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.134406 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:42.134632 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.134608 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:42.134719 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.134695 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:44.134673726 +0000 UTC m=+6.143038098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:42.235429 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.235158 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:42.235429 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.235338 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:42.235429 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.235386 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:42.235429 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.235401 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:42.235761 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.235468 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:44.235448583 +0000 UTC m=+6.243812976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:42.445409 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.445365 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:45:40 +0000 UTC" deadline="2028-03-20 23:22:53.413573926 +0000 UTC" Sep 18 14:50:42.445409 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.445408 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13184h32m10.968171036s" Sep 18 14:50:42.604109 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.604016 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:42.604258 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.604140 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:42.604560 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.604530 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:42.604761 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:42.604637 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:42.642016 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.641951 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdt7x" event={"ID":"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2","Type":"ContainerStarted","Data":"7acb0f104bcd9aafa2c318ad330b2c6c236a894eb5650aceb32a340bd92f65f9"} Sep 18 14:50:42.649556 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.649524 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"4c31a798e74a6fab8bf0548c5215aa718fb2f2e4f8ee9e1a473b646edd18f5a5"} Sep 18 14:50:42.667408 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.667112 2587 generic.go:356] "Generic (PLEG): container finished" podID="a8e6fcd66477100f8d6ba3bb24e379bf" containerID="642fb2ce6cba3430d2d14c4df9cbf74d1d6e55b84d0dbd48946081acac04eb0c" exitCode=0 Sep 18 14:50:42.667408 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.667197 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"a8e6fcd66477100f8d6ba3bb24e379bf","Type":"ContainerDied","Data":"642fb2ce6cba3430d2d14c4df9cbf74d1d6e55b84d0dbd48946081acac04eb0c"} Sep 18 14:50:42.694625 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.694587 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" event={"ID":"1bb35ee79734ff1cf6984dd2bb703b59","Type":"ContainerStarted","Data":"837df275419675c5bc61c628553a1cf034fcfffdaef443d55466397a64f3cb45"} Sep 18 14:50:42.699610 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.699585 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-46j7z" event={"ID":"3a5f9012-4406-4848-ac62-d64e3024d752","Type":"ContainerStarted","Data":"73b334065c6c2c26009d380622de224e27abfe6cd4f8c8f0f9ad04b3344188a3"} Sep 18 14:50:42.703390 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.703346 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7zsk" event={"ID":"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d","Type":"ContainerStarted","Data":"762eddd7e250275cbf150214c9ab62b2fe8ac354d841ec85793e12f5081a2abb"} Sep 18 14:50:42.711778 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.711744 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" event={"ID":"93296853-4fd6-4d4f-9e02-ee4ec7428545","Type":"ContainerStarted","Data":"eeaaf2eddc40514e953a95dd2e3076f299908cea9bc57d9b58bd481dac5584bf"} Sep 18 14:50:42.720122 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.720098 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerStarted","Data":"3ef0c11c365e64c7109d12f4747581e19a26ba2cc36561c3de809969ff674826"} Sep 18 14:50:42.732284 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.732211 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fb6" event={"ID":"822d3b6a-db13-4af3-8e57-b7bb7cc592ad","Type":"ContainerStarted","Data":"04c2a2dc5c7b1dff2947711ed0233ef12408ca91791a99859697bd3f2e51e233"} Sep 18 14:50:42.758995 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.758968 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4h5lv" event={"ID":"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05","Type":"ContainerStarted","Data":"826b028338b881f73836a37fad6240c4d1e3fa2628aae67db50b853abba44b60"} Sep 18 14:50:42.773274 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:42.773248 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" event={"ID":"f637132f-bf90-426e-aa11-645802b79e26","Type":"ContainerStarted","Data":"283d69a30fe18f9680a76b46ad0030d73bf84d408c52da0bd660c6c7f4b893f0"} Sep 18 14:50:43.601302 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:43.601254 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:43.601942 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:43.601399 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:43.807541 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:43.807431 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" event={"ID":"a8e6fcd66477100f8d6ba3bb24e379bf","Type":"ContainerStarted","Data":"73136c13654ac6842d105cf62ee2e307343589738a5fb038610d80e223b6d6d0"} Sep 18 14:50:43.821701 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:43.820848 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-56.ec2.internal" podStartSLOduration=4.820828355 podStartE2EDuration="4.820828355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:50:42.710641359 +0000 UTC m=+4.719005750" watchObservedRunningTime="2026-09-18 14:50:43.820828355 +0000 UTC m=+5.829192746" Sep 18 14:50:44.049654 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:44.049615 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:44.049834 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.049817 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:44.049893 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.049880 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:48.049862107 +0000 UTC m=+10.058226500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:44.150574 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:44.150492 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:44.150730 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.150705 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:44.150800 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.150769 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:48.150750788 +0000 UTC m=+10.159115161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:44.250950 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:44.250914 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:44.251134 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.251124 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:44.251195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.251147 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:44.251195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.251159 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:44.251308 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.251219 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:48.251200472 +0000 UTC m=+10.259564857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:44.604251 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:44.604173 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:44.604864 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.604306 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:44.604864 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:44.604700 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:44.604864 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:44.604799 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:45.601880 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:45.601846 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:45.602044 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:45.601974 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:46.601444 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:46.601412 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:46.601786 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:46.601558 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:46.601970 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:46.601950 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:46.602063 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:46.602042 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:47.602015 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:47.601977 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:47.602477 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:47.602128 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:48.081145 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:48.081108 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:48.081335 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.081258 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:48.081474 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.081368 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:56.081346571 +0000 UTC m=+18.089710953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:48.182521 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:48.182386 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:48.182673 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.182557 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:48.182673 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.182630 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:56.182609298 +0000 UTC m=+18.190973673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:48.283424 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:48.282812 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:48.283424 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.282970 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:48.283424 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.282988 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:48.283424 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.283000 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:48.283424 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.283066 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:56.283047598 +0000 UTC m=+18.291411969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:48.602582 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:48.602549 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:48.602949 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.602673 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:48.603015 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:48.602989 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:48.603185 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:48.603102 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:49.602379 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:49.601884 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:49.602379 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:49.602015 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:50.601789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:50.601756 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:50.602289 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:50.601756 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:50.602289 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:50.601892 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:50.602289 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:50.601921 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:51.601195 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:51.601167 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:51.601353 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:51.601253 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:52.602167 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:52.602137 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:52.602167 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:52.602156 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:52.602633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:52.602261 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:52.602633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:52.602373 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:53.601465 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:53.601420 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:53.601619 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:53.601564 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:54.602228 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:54.602195 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:54.602674 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:54.602198 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:54.602674 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:54.602347 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:54.602674 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:54.602424 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:55.601744 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:55.601707 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:55.601987 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:55.601816 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:56.141852 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:56.141810 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:56.142273 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.141987 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:56.142273 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.142062 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:12.142046183 +0000 UTC m=+34.150410552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:56.242804 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:56.242765 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:56.242985 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.242890 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:56.242985 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.242967 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:12.242945197 +0000 UTC m=+34.251309586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:56.343613 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:56.343529 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:56.343755 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.343695 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:56.343755 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.343727 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:56.343755 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.343740 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:56.343885 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.343793 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:12.343779294 +0000 UTC m=+34.352143662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:56.601895 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:56.601821 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:56.601895 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:56.601868 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:56.602109 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.601975 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:56.602109 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:56.602086 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:57.601377 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:57.601336 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:57.601759 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:57.601481 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:50:58.602774 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:58.602741 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:50:58.603240 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:58.602858 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:50:58.603240 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:58.602898 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:50:58.603240 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:58.602999 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:50:59.601332 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:50:59.601293 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:50:59.601481 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:50:59.601395 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:00.602663 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.601606 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:00.602663 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:00.602163 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:00.602663 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.601619 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:00.602663 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:00.602620 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:00.840727 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.840690 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4h5lv" event={"ID":"1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05","Type":"ContainerStarted","Data":"ea900ac133ab3d0771d5865aad2c5b3d5cc097e584314b4d03e82a79793595bd"} Sep 18 14:51:00.842472 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.842441 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" event={"ID":"f637132f-bf90-426e-aa11-645802b79e26","Type":"ContainerStarted","Data":"05cd1ea6ba627318518aac020b9aff33f3358773cfc6297e01a47da6ae792488"} Sep 18 14:51:00.845650 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.845631 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:51:00.846071 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846045 2587 generic.go:356] "Generic (PLEG): container finished" podID="147b5ed9-531a-4f52-8080-92272c0acd32" containerID="1b77a38528e43a9cce23fdd70e6891539d9f6fb9732bf1bb49a73321f83ab386" exitCode=1 Sep 18 14:51:00.846176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846121 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"25598b23f6fcc87663c97a5bbfc7b4c17edb9e7143f8f93005a523fbbf6b79ea"} Sep 18 14:51:00.846234 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846208 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"5db6ac1baa3d3e1f36972174cf253c5097735f7fd86bf2e1ae588f59e21ddbbb"} Sep 18 14:51:00.846298 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846264 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"bfb53b57630f289ddacbe7b1a4536cf7c8f5020f5a302e3576ee5256bca597e6"} Sep 18 14:51:00.846366 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846329 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"d185f0c7c831e20643f283bc78bc8be2fd0fbdbbfba8b19f10fca1a5c9c0b28a"} Sep 18 14:51:00.846423 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846379 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerDied","Data":"1b77a38528e43a9cce23fdd70e6891539d9f6fb9732bf1bb49a73321f83ab386"} Sep 18 14:51:00.846468 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.846430 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"8bf0e40adc485e2c5df692d09783a67f110bfe9ae6a9b9fdb807e599af1a7287"} Sep 18 14:51:00.847761 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.847740 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-46j7z" event={"ID":"3a5f9012-4406-4848-ac62-d64e3024d752","Type":"ContainerStarted","Data":"d63bc3a80f072752b79905d4727de4a2e006b62b21a473dd590d302801115e6d"} Sep 18 14:51:00.849259 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.849238 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7zsk" event={"ID":"5062fc02-6bd1-4530-b7e3-60c8f9e36e9d","Type":"ContainerStarted","Data":"9c7b8e2a8c8d7f1f4eb6577ae1ff87809d70c1c5b119eb417459f066ff31e98c"} Sep 18 14:51:00.850844 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.850825 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" event={"ID":"93296853-4fd6-4d4f-9e02-ee4ec7428545","Type":"ContainerStarted","Data":"58f336b772acf6a9c71a079fb452e7b6a44601b331901215b6ad066922308387"} Sep 18 14:51:00.852696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.852671 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="ff23de155ad33115c4cb0494d196ba22f8dd6df34804fd2fc764014aa9c04279" exitCode=0 Sep 18 14:51:00.852787 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.852755 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"ff23de155ad33115c4cb0494d196ba22f8dd6df34804fd2fc764014aa9c04279"} Sep 18 14:51:00.854399 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.854274 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fb6" event={"ID":"822d3b6a-db13-4af3-8e57-b7bb7cc592ad","Type":"ContainerStarted","Data":"6daf141131e72d2d03fde81f315d53e6e8ee919c273a2160509ec8ff394f2d37"} Sep 18 14:51:00.856359 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.856300 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4h5lv" podStartSLOduration=3.837307201 podStartE2EDuration="21.856285825s" totalImagesPullingTime="18.018978624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:00.85621445 +0000 UTC m=+22.864578862" watchObservedRunningTime="2026-09-18 14:51:00.856285825 +0000 UTC m=+22.864650219" Sep 18 14:51:00.856832 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.856749 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-56.ec2.internal" podStartSLOduration=21.856740629 podStartE2EDuration="21.856740629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:50:43.821653856 +0000 UTC m=+5.830018248" watchObservedRunningTime="2026-09-18 14:51:00.856740629 +0000 UTC m=+22.865105019" Sep 18 14:51:00.890154 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.890105 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8fb6" podStartSLOduration=4.288522141 podStartE2EDuration="22.890086149s" totalImagesPullingTime="18.601564008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:00.873691093 +0000 UTC m=+22.882055510" watchObservedRunningTime="2026-09-18 14:51:00.890086149 +0000 UTC m=+22.898450541" Sep 18 14:51:00.890529 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.890492 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sjfvg" podStartSLOduration=3.867844223 podStartE2EDuration="21.890485044s" totalImagesPullingTime="18.022640821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:00.889684842 +0000 UTC m=+22.898049232" watchObservedRunningTime="2026-09-18 14:51:00.890485044 +0000 UTC m=+22.898849435" Sep 18 14:51:00.929165 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.929111 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-46j7z" podStartSLOduration=3.960810397 podStartE2EDuration="21.929091371s" totalImagesPullingTime="17.968280974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:00.928989042 +0000 UTC m=+22.937353445" watchObservedRunningTime="2026-09-18 14:51:00.929091371 +0000 UTC m=+22.937455762" Sep 18 14:51:00.952202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:00.952159 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z7zsk" podStartSLOduration=3.9252140239999997 podStartE2EDuration="21.952142098s" totalImagesPullingTime="18.026928074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:00.951746184 +0000 UTC m=+22.960110595" watchObservedRunningTime="2026-09-18 14:51:00.952142098 +0000 UTC m=+22.960506487" Sep 18 14:51:01.402404 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.402376 2587 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 14:51:01.601838 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.601766 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:01.601996 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:01.601888 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:01.622828 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.622682 2587 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T14:51:01.402394725Z","UUID":"e3c434f1-d78a-4710-b0f6-b768a4a6a1f9","Handler":null,"Name":"","Endpoint":""} Sep 18 14:51:01.624574 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.624373 2587 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 14:51:01.624574 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.624404 2587 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 14:51:01.858571 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.858482 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" event={"ID":"f637132f-bf90-426e-aa11-645802b79e26","Type":"ContainerStarted","Data":"91ea63a50b3010009ceb807ad6cdc0f6241f860b4582e6bee58be576f1b725a0"} Sep 18 14:51:01.860211 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.860179 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdt7x" event={"ID":"7e19b7bd-848c-4be0-b6c3-913c4ce03ec2","Type":"ContainerStarted","Data":"2445f65c826f04aeb1876883671b28dbc0fbbc11a74e3951f9e717194315b67b"} Sep 18 14:51:01.877551 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.877511 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wdt7x" podStartSLOduration=4.852110327 podStartE2EDuration="22.877498443s" totalImagesPullingTime="18.025388116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:01.876799138 +0000 UTC m=+23.885163547" watchObservedRunningTime="2026-09-18 14:51:01.877498443 +0000 UTC m=+23.885862833" Sep 18 14:51:01.893156 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.893132 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:51:01.893643 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:01.893627 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:51:02.602541 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:02.602508 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:02.602644 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:02.602613 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:02.602715 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:02.602671 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:02.602812 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:02.602791 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:02.866061 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:02.865828 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:51:02.866487 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:02.866462 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"46d86eb4ee7d43f05cf3dfda4c23fc8c8f784ef237b0b504fe148db24992b94a"} Sep 18 14:51:03.601391 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:03.601361 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:03.601565 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:03.601485 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:03.871969 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:03.871902 2587 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 14:51:03.871969 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:03.871920 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" event={"ID":"f637132f-bf90-426e-aa11-645802b79e26","Type":"ContainerStarted","Data":"f25ddb5321715a367525b9b431a755a949d7651d9a91bf3b7bbd47a0d3dc474e"} Sep 18 14:51:03.889006 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:03.888954 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmxk4" podStartSLOduration=4.183306354 podStartE2EDuration="24.888935356s" totalImagesPullingTime="20.705629002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:03.88739788 +0000 UTC m=+25.895762291" watchObservedRunningTime="2026-09-18 14:51:03.888935356 +0000 UTC m=+25.897299746" Sep 18 14:51:04.601710 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:04.601654 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:04.601893 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:04.601823 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:04.601893 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:04.601864 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:04.602032 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:04.602004 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:05.601483 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.601181 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:05.601954 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:05.601516 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:05.626232 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.626205 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:51:05.626372 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.626308 2587 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 14:51:05.626763 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.626745 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-46j7z" Sep 18 14:51:05.878436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.878358 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="eb4ee233b00e33ddcfd0dccae9cdff083baabe92f5da78850aa7302dd2cb976b" exitCode=0 Sep 18 14:51:05.878607 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.878445 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"eb4ee233b00e33ddcfd0dccae9cdff083baabe92f5da78850aa7302dd2cb976b"} Sep 18 14:51:05.882446 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.882430 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:51:05.882863 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.882841 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"2b3e544b2653a4aeaf1348d989e2d8698a9383bb6f7e5ce576c9579e97e8c189"} Sep 18 14:51:05.883193 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.883172 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:05.883277 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.883253 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:05.883338 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.883287 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:05.883395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.883345 2587 scope.go:117] "RemoveContainer" containerID="1b77a38528e43a9cce23fdd70e6891539d9f6fb9732bf1bb49a73321f83ab386" Sep 18 14:51:05.898539 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.898518 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:05.898731 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:05.898715 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:06.602244 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.602209 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:06.603357 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.602254 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:06.603357 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:06.602360 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:06.603357 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:06.602478 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:06.825257 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.825226 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmggv"] Sep 18 14:51:06.828140 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.828118 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mfpqc"] Sep 18 14:51:06.829490 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.828895 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chcx5"] Sep 18 14:51:06.829490 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.829023 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:06.829490 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:06.829120 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:06.888788 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.888767 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:51:06.889143 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.889117 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" event={"ID":"147b5ed9-531a-4f52-8080-92272c0acd32","Type":"ContainerStarted","Data":"b67a332a6fd75733b518b73552c424f5635b750afd5f134c7d601af01913b8ac"} Sep 18 14:51:06.889232 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.889167 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:06.889232 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.889134 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:06.889397 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:06.889371 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:06.889521 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:06.889499 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:06.919877 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:06.919835 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" podStartSLOduration=9.744640362 podStartE2EDuration="27.919819571s" totalImagesPullingTime="18.175179209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:06.919431536 +0000 UTC m=+28.927795948" watchObservedRunningTime="2026-09-18 14:51:06.919819571 +0000 UTC m=+28.928183961" Sep 18 14:51:07.892849 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:07.892815 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="102bc84378cdac5b639316c187c3a70fe973434c705b0987dbfda016f78f3b1b" exitCode=0 Sep 18 14:51:07.893449 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:07.892903 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"102bc84378cdac5b639316c187c3a70fe973434c705b0987dbfda016f78f3b1b"} Sep 18 14:51:08.603375 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:08.603330 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:08.603549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:08.603416 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:08.603549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:08.603449 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:08.603549 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:08.603485 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:08.603549 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:08.603535 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:08.603766 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:08.603625 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:09.899654 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:09.899469 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="fecd69fe1160847a19153cd65fe91e7c8205b5887a2e73e8f79edb1d87d71b66" exitCode=0 Sep 18 14:51:09.900030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:09.899553 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"fecd69fe1160847a19153cd65fe91e7c8205b5887a2e73e8f79edb1d87d71b66"} Sep 18 14:51:10.601276 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:10.601247 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:10.601478 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:10.601247 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:10.601478 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:10.601380 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:10.601478 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:10.601384 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:10.601647 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:10.601474 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:10.601647 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:10.601557 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:12.164800 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.164766 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:12.165332 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.164889 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:12.165332 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.164948 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret podName:eb2c9653-03f6-4892-b12f-1aedfee9cf93 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:44.164933449 +0000 UTC m=+66.173297833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret") pod "global-pull-secret-syncer-chcx5" (UID: "eb2c9653-03f6-4892-b12f-1aedfee9cf93") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:12.265290 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.265256 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:12.265461 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.265414 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:12.265511 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.265476 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:44.265456956 +0000 UTC m=+66.273821325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:12.366215 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.366173 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:12.366381 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.366349 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:12.366381 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.366368 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:12.366381 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.366377 2587 projected.go:196] Error preparing data for projected volume kube-api-access-jfsbl for pod openshift-network-diagnostics/network-check-target-mfpqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:12.366479 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.366430 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl podName:a645d280-cd21-4f2f-8ae6-3a23068c4b8d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:44.366414166 +0000 UTC m=+66.374778556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfsbl" (UniqueName: "kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl") pod "network-check-target-mfpqc" (UID: "a645d280-cd21-4f2f-8ae6-3a23068c4b8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:12.601836 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.601751 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:12.602034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.601751 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:12.602034 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.601889 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmggv" podUID="c0273bfa-cbb5-4bca-94c5-e3cc4cb87251" Sep 18 14:51:12.602034 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:12.601759 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:12.602034 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.601982 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mfpqc" podUID="a645d280-cd21-4f2f-8ae6-3a23068c4b8d" Sep 18 14:51:12.602210 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:12.602049 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chcx5" podUID="eb2c9653-03f6-4892-b12f-1aedfee9cf93" Sep 18 14:51:13.320467 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.320433 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-56.ec2.internal" event="NodeReady" Sep 18 14:51:13.320936 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.320590 2587 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 14:51:13.353815 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.353785 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:51:13.358616 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.358591 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.361054 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.361035 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 14:51:13.361303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.361281 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 14:51:13.361450 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.361428 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 14:51:13.361571 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.361519 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9b47f\"" Sep 18 14:51:13.366241 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.366139 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2pfw"] Sep 18 14:51:13.367027 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.367006 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 14:51:13.369553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.369522 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:51:13.369684 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.369663 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.372054 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.372027 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 14:51:13.372159 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.372061 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 14:51:13.372159 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.372079 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr4v6\"" Sep 18 14:51:13.375867 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.375837 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-44m2n"] Sep 18 14:51:13.379125 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.379105 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.380505 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.380483 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2pfw"] Sep 18 14:51:13.381593 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.381575 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 14:51:13.381715 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.381694 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 14:51:13.382017 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.381988 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 14:51:13.382137 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.382115 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2j48j\"" Sep 18 14:51:13.386482 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.386392 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44m2n"] Sep 18 14:51:13.462723 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.462689 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:13.475616 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475589 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b006f29-2007-4d88-b121-bbc4025cb633-cert\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.475616 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475619 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb8a7be-4451-4622-82bb-949093645a72-tmp-dir\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.475810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475666 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8prl\" (UniqueName: \"kubernetes.io/projected/2eb8a7be-4451-4622-82bb-949093645a72-kube-api-access-l8prl\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.475810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475688 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475715 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475739 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475817 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475841 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gltdp\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475909 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475948 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.475987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475975 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb8a7be-4451-4622-82bb-949093645a72-config-volume\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.476175 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.475988 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.476175 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.476010 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.476175 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.476044 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5p6r\" (UniqueName: \"kubernetes.io/projected/5b006f29-2007-4d88-b121-bbc4025cb633-kube-api-access-v5p6r\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.553953 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.553869 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:13.576836 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.576769 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.576836 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.576825 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577032 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.576856 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb8a7be-4451-4622-82bb-949093645a72-config-volume\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.577077 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577044 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.577129 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577082 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577129 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577107 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5p6r\" (UniqueName: \"kubernetes.io/projected/5b006f29-2007-4d88-b121-bbc4025cb633-kube-api-access-v5p6r\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.577202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577142 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b006f29-2007-4d88-b121-bbc4025cb633-cert\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.577202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577170 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb8a7be-4451-4622-82bb-949093645a72-tmp-dir\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.577202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577188 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8prl\" (UniqueName: \"kubernetes.io/projected/2eb8a7be-4451-4622-82bb-949093645a72-kube-api-access-l8prl\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.577301 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577210 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577301 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577229 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577301 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577246 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577301 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577297 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577453 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577327 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gltdp\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.577563 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577534 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb8a7be-4451-4622-82bb-949093645a72-config-volume\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.577823 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.577788 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb8a7be-4451-4622-82bb-949093645a72-tmp-dir\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.578119 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.578132 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:13.578126 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:13.578163 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:13.578178 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:13.578215 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.578177 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.578568 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:13.578221 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:14.078199604 +0000 UTC m=+36.086564190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:13.582740 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:13.579141 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:14.079117581 +0000 UTC m=+36.087481958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:13.582740 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.582079 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.582740 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.582113 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b006f29-2007-4d88-b121-bbc4025cb633-cert\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.583544 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.583520 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.591751 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.591689 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.591751 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.591690 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8prl\" (UniqueName: \"kubernetes.io/projected/2eb8a7be-4451-4622-82bb-949093645a72-kube-api-access-l8prl\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:13.591903 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.591876 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5p6r\" (UniqueName: \"kubernetes.io/projected/5b006f29-2007-4d88-b121-bbc4025cb633-kube-api-access-v5p6r\") pod \"ingress-canary-44m2n\" (UID: \"5b006f29-2007-4d88-b121-bbc4025cb633\") " pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:13.592294 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.592272 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gltdp\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:13.654227 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.654194 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:13.689365 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:13.689327 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44m2n" Sep 18 14:51:14.082094 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.081929 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:14.082189 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:14.082076 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:14.082189 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.082142 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:14.082189 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:14.082175 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:14.082340 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:14.082227 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:15.082211196 +0000 UTC m=+37.090575563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:14.082340 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:14.082253 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:14.082340 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:14.082304 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:15.082289708 +0000 UTC m=+37.090654081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:14.109952 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.109905 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44m2n"] Sep 18 14:51:14.123189 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:51:14.123161 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b006f29_2007_4d88_b121_bbc4025cb633.slice/crio-91024e4080cd47824f832c0074325b7b3035e47a46c8be2786dec2b899d22a40 WatchSource:0}: Error finding container 91024e4080cd47824f832c0074325b7b3035e47a46c8be2786dec2b899d22a40: Status 404 returned error can't find the container with id 91024e4080cd47824f832c0074325b7b3035e47a46c8be2786dec2b899d22a40 Sep 18 14:51:14.493570 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.493530 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:14.594007 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.593955 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:14.601949 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.601928 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:14.602081 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.601932 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:14.602244 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.602226 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:14.605108 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.605086 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:51:14.606070 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.606052 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:51:14.606176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.606057 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:51:14.606176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.606095 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zcj9k\"" Sep 18 14:51:14.606176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.606099 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:51:14.606176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.606099 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gm9b\"" Sep 18 14:51:14.647172 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.647145 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:14.911158 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.911125 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44m2n" event={"ID":"5b006f29-2007-4d88-b121-bbc4025cb633","Type":"ContainerStarted","Data":"91024e4080cd47824f832c0074325b7b3035e47a46c8be2786dec2b899d22a40"} Sep 18 14:51:14.913542 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.913520 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="2857b402142fb5306e36988c1d967da72f1fee857b6c245c8e49291c54167099" exitCode=0 Sep 18 14:51:14.913649 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.913552 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"2857b402142fb5306e36988c1d967da72f1fee857b6c245c8e49291c54167099"} Sep 18 14:51:14.987255 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:14.987218 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:15.089551 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:15.089507 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:15.089700 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:15.089595 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:15.089700 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:15.089661 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:15.089700 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:15.089686 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:15.089700 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:15.089697 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:15.089873 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:15.089744 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:17.089726509 +0000 UTC m=+39.098090887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:15.089873 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:15.089759 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:17.089753376 +0000 UTC m=+39.098117744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:15.920395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:15.920355 2587 generic.go:356] "Generic (PLEG): container finished" podID="7602a24b-4d95-45b9-95c7-0a5e53d1b067" containerID="a653ab68cdff10c5e440ccfdbeadcf5495389140e2c07692239d53017f272d71" exitCode=0 Sep 18 14:51:15.920395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:15.920405 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerDied","Data":"a653ab68cdff10c5e440ccfdbeadcf5495389140e2c07692239d53017f272d71"} Sep 18 14:51:16.444928 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.444899 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:16.928014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.927977 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" event={"ID":"7602a24b-4d95-45b9-95c7-0a5e53d1b067","Type":"ContainerStarted","Data":"a09c413a6c9473c9c4434b94f2246c6fb763783184ca29fb9febc2e76462f4d1"} Sep 18 14:51:16.929427 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.929403 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44m2n" event={"ID":"5b006f29-2007-4d88-b121-bbc4025cb633","Type":"ContainerStarted","Data":"fdca0a4293fcc571fcfdc81a96bda8c699f4e25d740daa6a4732bb508da25947"} Sep 18 14:51:16.952544 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.952503 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2pdnx" podStartSLOduration=10.82752558 podStartE2EDuration="38.952490161s" totalImagesPullingTime="28.124964581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:16.951174343 +0000 UTC m=+38.959538734" watchObservedRunningTime="2026-09-18 14:51:16.952490161 +0000 UTC m=+38.960854550" Sep 18 14:51:16.965663 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.965623 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-44m2n" podStartSLOduration=1.715730188 podStartE2EDuration="3.965609844s" totalImagesPullingTime="2.249879656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:16.965370661 +0000 UTC m=+38.973735054" watchObservedRunningTime="2026-09-18 14:51:16.965609844 +0000 UTC m=+38.973974233" Sep 18 14:51:16.975647 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:16.975621 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:17.081889 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.081812 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:17.105776 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.105755 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:17.105869 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.105857 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:17.105929 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:17.105903 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:17.105979 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:17.105963 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:17.106022 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:17.105978 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:17.106022 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:17.105968 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:21.105949956 +0000 UTC m=+43.114314689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:17.106131 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:17.106042 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:21.10602676 +0000 UTC m=+43.114391138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:17.179205 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.179180 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:17.234795 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.234758 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:17.478232 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.478043 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:17.534842 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:17.534814 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:21.136789 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:21.136751 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:21.136805 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:21.136891 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:21.136902 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:21.136947 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:29.13693339 +0000 UTC m=+51.145297758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:21.136891 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:21.137195 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:21.137011 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:29.136997637 +0000 UTC m=+51.145362022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:27.109709 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:27.109680 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:27.158652 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:27.158619 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:29.196257 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.196220 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.196276 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:29.196399 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:29.196402 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:29.196476 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:45.196458777 +0000 UTC m=+67.204823163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:29.196412 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:29.196633 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:29.196551 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:45.196538745 +0000 UTC m=+67.204903112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:29.591363 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.591254 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:29.649910 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.649875 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:29.707523 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.707491 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:29.947862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:29.947831 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:30.000130 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:30.000098 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:30.427027 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:30.426985 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:30.482531 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:30.482497 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:37.908934 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:37.908907 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhw4t" Sep 18 14:51:38.055333 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:38.055289 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:38.111824 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:38.111796 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.396775 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.396740 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv"] Sep 18 14:51:40.399484 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.399463 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xbs7l"] Sep 18 14:51:40.399612 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.399576 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.401165 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.401144 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.401877 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.401852 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 14:51:40.401992 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.401974 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 14:51:40.402117 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.402098 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-59k7b\"" Sep 18 14:51:40.402269 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.402247 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 14:51:40.403088 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.403074 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 14:51:40.403616 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.403601 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 14:51:40.403714 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.403616 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hvhj2\"" Sep 18 14:51:40.403714 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.403627 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:51:40.403867 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.403853 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 14:51:40.404207 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.404188 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 14:51:40.411137 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.411115 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 14:51:40.413250 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.412933 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv"] Sep 18 14:51:40.413879 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.413861 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xbs7l"] Sep 18 14:51:40.468400 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468376 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-config\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.468534 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468416 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-trusted-ca\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.468534 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468437 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.468534 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468456 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675c8\" (UniqueName: \"kubernetes.io/projected/1521c3f2-8211-4e48-961b-d89280ce07e7-kube-api-access-675c8\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.468534 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468494 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a736611-4489-4a74-9e67-f589498ba4d1-serving-cert\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.468694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468556 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctt9s\" (UniqueName: \"kubernetes.io/projected/4a736611-4489-4a74-9e67-f589498ba4d1-kube-api-access-ctt9s\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.468694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.468617 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1521c3f2-8211-4e48-961b-d89280ce07e7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.569425 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569390 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.569425 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569434 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675c8\" (UniqueName: \"kubernetes.io/projected/1521c3f2-8211-4e48-961b-d89280ce07e7-kube-api-access-675c8\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.569658 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:40.569543 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:40.569658 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569547 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a736611-4489-4a74-9e67-f589498ba4d1-serving-cert\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.569658 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:40.569622 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:41.069604522 +0000 UTC m=+63.077968890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:40.569810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569687 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctt9s\" (UniqueName: \"kubernetes.io/projected/4a736611-4489-4a74-9e67-f589498ba4d1-kube-api-access-ctt9s\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.569810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569754 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1521c3f2-8211-4e48-961b-d89280ce07e7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.569899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569809 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-config\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.569899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.569860 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-trusted-ca\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.570588 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.570568 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1521c3f2-8211-4e48-961b-d89280ce07e7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.570661 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.570610 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-config\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.570719 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.570702 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a736611-4489-4a74-9e67-f589498ba4d1-trusted-ca\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.572660 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.572639 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a736611-4489-4a74-9e67-f589498ba4d1-serving-cert\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.580304 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.580275 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctt9s\" (UniqueName: \"kubernetes.io/projected/4a736611-4489-4a74-9e67-f589498ba4d1-kube-api-access-ctt9s\") pod \"console-operator-fd4bb46c-xbs7l\" (UID: \"4a736611-4489-4a74-9e67-f589498ba4d1\") " pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.581359 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.581338 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-675c8\" (UniqueName: \"kubernetes.io/projected/1521c3f2-8211-4e48-961b-d89280ce07e7-kube-api-access-675c8\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:40.630980 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.630955 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.683862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.683791 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.718930 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.718907 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:40.982862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:40.982792 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xbs7l"] Sep 18 14:51:40.986357 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:51:40.986335 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a736611_4489_4a74_9e67_f589498ba4d1.slice/crio-c4eb16915a5fd0d055066b4142d65bb5d43ec00019629ea109cbcd060caaca58 WatchSource:0}: Error finding container c4eb16915a5fd0d055066b4142d65bb5d43ec00019629ea109cbcd060caaca58: Status 404 returned error can't find the container with id c4eb16915a5fd0d055066b4142d65bb5d43ec00019629ea109cbcd060caaca58 Sep 18 14:51:41.074544 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:41.074517 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:41.074673 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:41.074656 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:41.074736 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:41.074727 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:42.074709958 +0000 UTC m=+64.083074326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:41.986624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:41.986581 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" event={"ID":"4a736611-4489-4a74-9e67-f589498ba4d1","Type":"ContainerStarted","Data":"c4eb16915a5fd0d055066b4142d65bb5d43ec00019629ea109cbcd060caaca58"} Sep 18 14:51:42.081191 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:42.081155 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:42.081394 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:42.081349 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:42.081466 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:42.081427 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:44.081406283 +0000 UTC m=+66.089770669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:42.990290 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:42.990262 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/0.log" Sep 18 14:51:42.990624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:42.990302 2587 generic.go:356] "Generic (PLEG): container finished" podID="4a736611-4489-4a74-9e67-f589498ba4d1" containerID="c777d4d73cc89b19925469cf8185242199d8337a10db521ff927f470aec9c806" exitCode=255 Sep 18 14:51:42.990624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:42.990386 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" event={"ID":"4a736611-4489-4a74-9e67-f589498ba4d1","Type":"ContainerDied","Data":"c777d4d73cc89b19925469cf8185242199d8337a10db521ff927f470aec9c806"} Sep 18 14:51:42.990624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:42.990588 2587 scope.go:117] "RemoveContainer" containerID="c777d4d73cc89b19925469cf8185242199d8337a10db521ff927f470aec9c806" Sep 18 14:51:43.864859 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.864824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:43.953693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.953660 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:43.994160 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994137 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 14:51:43.994584 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994568 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/0.log" Sep 18 14:51:43.994642 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994602 2587 generic.go:356] "Generic (PLEG): container finished" podID="4a736611-4489-4a74-9e67-f589498ba4d1" containerID="26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895" exitCode=255 Sep 18 14:51:43.994696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994636 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" event={"ID":"4a736611-4489-4a74-9e67-f589498ba4d1","Type":"ContainerDied","Data":"26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895"} Sep 18 14:51:43.994757 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994743 2587 scope.go:117] "RemoveContainer" containerID="c777d4d73cc89b19925469cf8185242199d8337a10db521ff927f470aec9c806" Sep 18 14:51:43.994991 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:43.994976 2587 scope.go:117] "RemoveContainer" containerID="26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895" Sep 18 14:51:43.995185 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:43.995167 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xbs7l_openshift-console-operator(4a736611-4489-4a74-9e67-f589498ba4d1)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" podUID="4a736611-4489-4a74-9e67-f589498ba4d1" Sep 18 14:51:44.017076 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.017053 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:44.096525 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.096499 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:44.096883 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:44.096851 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:44.096982 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:44.096923 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:48.096905101 +0000 UTC m=+70.105269473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:44.197061 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.197034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:44.199209 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.199191 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:51:44.210141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.210121 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb2c9653-03f6-4892-b12f-1aedfee9cf93-original-pull-secret\") pod \"global-pull-secret-syncer-chcx5\" (UID: \"eb2c9653-03f6-4892-b12f-1aedfee9cf93\") " pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:44.297775 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.297748 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:51:44.299757 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.299739 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:51:44.308425 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:44.308407 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 14:51:44.308495 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:44.308456 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs podName:c0273bfa-cbb5-4bca-94c5-e3cc4cb87251 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:48.308441876 +0000 UTC m=+130.316806244 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs") pod "network-metrics-daemon-fmggv" (UID: "c0273bfa-cbb5-4bca-94c5-e3cc4cb87251") : secret "metrics-daemon-secret" not found Sep 18 14:51:44.311668 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.311652 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chcx5" Sep 18 14:51:44.398987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.398953 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:44.401634 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.401539 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:51:44.411491 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.411471 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:51:44.422478 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.422454 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/a645d280-cd21-4f2f-8ae6-3a23068c4b8d-kube-api-access-jfsbl\") pod \"network-check-target-mfpqc\" (UID: \"a645d280-cd21-4f2f-8ae6-3a23068c4b8d\") " pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:44.607166 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.607088 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chcx5"] Sep 18 14:51:44.610712 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:51:44.610688 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2c9653_03f6_4892_b12f_1aedfee9cf93.slice/crio-f97a3511b4461efd53992aa117d91867143019dedfcf4008579f91a8126a3d12 WatchSource:0}: Error finding container f97a3511b4461efd53992aa117d91867143019dedfcf4008579f91a8126a3d12: Status 404 returned error can't find the container with id f97a3511b4461efd53992aa117d91867143019dedfcf4008579f91a8126a3d12 Sep 18 14:51:44.627879 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.627860 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gm9b\"" Sep 18 14:51:44.635755 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.635737 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:44.928626 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.928602 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mfpqc"] Sep 18 14:51:44.931598 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:51:44.931574 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda645d280_cd21_4f2f_8ae6_3a23068c4b8d.slice/crio-f51b6558d3cc9b2e00bc48bd24566ad7f8272a6d7fabb0164533bf7c9faba137 WatchSource:0}: Error finding container f51b6558d3cc9b2e00bc48bd24566ad7f8272a6d7fabb0164533bf7c9faba137: Status 404 returned error can't find the container with id f51b6558d3cc9b2e00bc48bd24566ad7f8272a6d7fabb0164533bf7c9faba137 Sep 18 14:51:44.998856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.998832 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 14:51:44.999220 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:44.999160 2587 scope.go:117] "RemoveContainer" containerID="26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895" Sep 18 14:51:44.999347 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:44.999307 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xbs7l_openshift-console-operator(4a736611-4489-4a74-9e67-f589498ba4d1)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" podUID="4a736611-4489-4a74-9e67-f589498ba4d1" Sep 18 14:51:45.000152 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:45.000135 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chcx5" event={"ID":"eb2c9653-03f6-4892-b12f-1aedfee9cf93","Type":"ContainerStarted","Data":"f97a3511b4461efd53992aa117d91867143019dedfcf4008579f91a8126a3d12"} Sep 18 14:51:45.001275 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:45.001255 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mfpqc" event={"ID":"a645d280-cd21-4f2f-8ae6-3a23068c4b8d","Type":"ContainerStarted","Data":"f51b6558d3cc9b2e00bc48bd24566ad7f8272a6d7fabb0164533bf7c9faba137"} Sep 18 14:51:45.205825 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:45.205736 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:51:45.205988 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:45.205831 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:51:45.205988 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:45.205900 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:45.205988 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:45.205924 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c8bd8d7f-rrccz: secret "image-registry-tls" not found Sep 18 14:51:45.205988 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:45.205976 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:45.206135 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:45.205996 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls podName:fa8b37ed-9922-42a3-b79a-483d2d8a8f38 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:17.205971936 +0000 UTC m=+99.214336312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls") pod "image-registry-85c8bd8d7f-rrccz" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38") : secret "image-registry-tls" not found Sep 18 14:51:45.206135 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:45.206026 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls podName:2eb8a7be-4451-4622-82bb-949093645a72 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:17.206009128 +0000 UTC m=+99.214373500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls") pod "dns-default-v2pfw" (UID: "2eb8a7be-4451-4622-82bb-949093645a72") : secret "dns-default-metrics-tls" not found Sep 18 14:51:46.118231 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:46.118184 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.169131 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:46.169096 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.594924 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:46.594819 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.694859 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:46.694812 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.904303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:46.904249 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.005505 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.005448 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.337619 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.337523 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.439623 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.439562 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.452908 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.452879 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x6m4p"] Sep 18 14:51:47.455137 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.455036 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.457375 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.457354 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 14:51:47.457505 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.457401 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 14:51:47.457505 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.457442 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 14:51:47.458589 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.458394 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 14:51:47.458589 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.458422 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xp2tn\"" Sep 18 14:51:47.468335 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.468289 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6m4p"] Sep 18 14:51:47.504634 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.504602 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.524624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.524595 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.524770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.524639 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56117f5b-ac63-41db-ac5b-f8a816237389-crio-socket\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.524770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.524661 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.524770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.524716 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhnh\" (UniqueName: \"kubernetes.io/projected/56117f5b-ac63-41db-ac5b-f8a816237389-kube-api-access-5rhnh\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.524912 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.524829 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56117f5b-ac63-41db-ac5b-f8a816237389-data-volume\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626010 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.625912 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56117f5b-ac63-41db-ac5b-f8a816237389-crio-socket\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626010 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.625965 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626010 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.625996 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhnh\" (UniqueName: \"kubernetes.io/projected/56117f5b-ac63-41db-ac5b-f8a816237389-kube-api-access-5rhnh\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.626050 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56117f5b-ac63-41db-ac5b-f8a816237389-data-volume\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.626131 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.626049 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56117f5b-ac63-41db-ac5b-f8a816237389-crio-socket\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:47.626153 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:47.626238 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:47.626294 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:47.626285 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:48.126256261 +0000 UTC m=+70.134620646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:47.626604 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:47.626338 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:48.126300421 +0000 UTC m=+70.134664795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : configmap "kube-rbac-proxy" not found Sep 18 14:51:47.626604 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.626458 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56117f5b-ac63-41db-ac5b-f8a816237389-data-volume\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.633986 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.633961 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhnh\" (UniqueName: \"kubernetes.io/projected/56117f5b-ac63-41db-ac5b-f8a816237389-kube-api-access-5rhnh\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:47.720180 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.720102 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.819423 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:47.819298 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:48.131447 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:48.131386 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:48.131447 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:48.131446 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:48.131481 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131487 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131564 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:49.131542889 +0000 UTC m=+71.139907261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : configmap "kube-rbac-proxy" not found Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131602 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131655 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:56.131643543 +0000 UTC m=+78.140007911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131602 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:48.131692 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:48.131694 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:49.131684696 +0000 UTC m=+71.140049065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:49.140588 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.140541 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:49.141043 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.140610 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:49.141043 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:49.140667 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:49.141043 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:49.140742 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:51.140723194 +0000 UTC m=+73.149087578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : configmap "kube-rbac-proxy" not found Sep 18 14:51:49.141043 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:49.140750 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:49.141043 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:49.140796 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:51.14078577 +0000 UTC m=+73.149150139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:49.215390 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.215354 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nf58q"] Sep 18 14:51:49.217452 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.217435 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.219670 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.219647 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 14:51:49.219670 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.219659 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 14:51:49.220716 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.220686 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 14:51:49.220779 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.220723 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 14:51:49.220845 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.220695 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q4v6k\"" Sep 18 14:51:49.228059 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.228038 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nf58q"] Sep 18 14:51:49.241898 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.241867 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvbl\" (UniqueName: \"kubernetes.io/projected/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-kube-api-access-8pvbl\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.241996 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.241943 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.241996 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.241983 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-key\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.248658 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.248631 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.342255 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.342234 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.342368 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.342277 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-key\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.342368 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.342349 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvbl\" (UniqueName: \"kubernetes.io/projected/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-kube-api-access-8pvbl\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.343061 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.343040 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-cabundle\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.344591 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.344572 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-signing-key\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.349423 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.349396 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.350992 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.350971 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvbl\" (UniqueName: \"kubernetes.io/projected/c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff-kube-api-access-8pvbl\") pod \"service-ca-55f6fc7b86-nf58q\" (UID: \"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff\") " pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.525925 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.525838 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" Sep 18 14:51:49.608504 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.608484 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7zsk_5062fc02-6bd1-4530-b7e3-60c8f9e36e9d/dns-node-resolver/0.log" Sep 18 14:51:49.791258 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:49.791185 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-nf58q"] Sep 18 14:51:49.794058 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:51:49.794033 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40ff0ed_e31a_49fd_bcf3_9e4fd056c8ff.slice/crio-8d51433454e2d9d0d4eeaf653b26f889c48b5e8e0004861264a151bff1fc7988 WatchSource:0}: Error finding container 8d51433454e2d9d0d4eeaf653b26f889c48b5e8e0004861264a151bff1fc7988: Status 404 returned error can't find the container with id 8d51433454e2d9d0d4eeaf653b26f889c48b5e8e0004861264a151bff1fc7988 Sep 18 14:51:50.016941 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.016910 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" event={"ID":"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff","Type":"ContainerStarted","Data":"8d51433454e2d9d0d4eeaf653b26f889c48b5e8e0004861264a151bff1fc7988"} Sep 18 14:51:50.018450 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.018422 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chcx5" event={"ID":"eb2c9653-03f6-4892-b12f-1aedfee9cf93","Type":"ContainerStarted","Data":"cbbec3ba3918cf9c9a1d9ab9d2f0bafe8b946bb089f93f2170b7efd5505dc8bb"} Sep 18 14:51:50.020799 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.020646 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mfpqc" event={"ID":"a645d280-cd21-4f2f-8ae6-3a23068c4b8d","Type":"ContainerStarted","Data":"e5d00631056e17d93df60e7ce125dc7b9967aa32a8844bf602407889c55c5e31"} Sep 18 14:51:50.021035 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.021013 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:51:50.034743 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.034701 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-chcx5" podStartSLOduration=66.39542437 podStartE2EDuration="1m11.034688787s" totalImagesPullingTime="4.639264417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:50.03424348 +0000 UTC m=+72.042607869" watchObservedRunningTime="2026-09-18 14:51:50.034688787 +0000 UTC m=+72.043053177" Sep 18 14:51:50.049104 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.049032 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mfpqc" podStartSLOduration=66.734755204 podStartE2EDuration="1m11.049020458s" totalImagesPullingTime="4.314265254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:50.048343958 +0000 UTC m=+72.056708371" watchObservedRunningTime="2026-09-18 14:51:50.049020458 +0000 UTC m=+72.057384884" Sep 18 14:51:50.208665 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.208613 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4h5lv_1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05/node-ca/0.log" Sep 18 14:51:50.400990 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.400963 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:50.719482 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.719387 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:50.719482 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.719458 2587 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:51:50.719880 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:50.719863 2587 scope.go:117] "RemoveContainer" containerID="26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895" Sep 18 14:51:50.720055 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:50.720034 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xbs7l_openshift-console-operator(4a736611-4489-4a74-9e67-f589498ba4d1)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" podUID="4a736611-4489-4a74-9e67-f589498ba4d1" Sep 18 14:51:51.022415 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:51.022337 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44m2n_5b006f29-2007-4d88-b121-bbc4025cb633/serve-healthcheck-canary/0.log" Sep 18 14:51:51.156862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:51.156818 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:51.157049 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:51.156878 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:51.157049 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:51.156922 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:51.157049 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:51.157002 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:51.157049 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:51.157007 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:55.156986574 +0000 UTC m=+77.165350949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : configmap "kube-rbac-proxy" not found Sep 18 14:51:51.157236 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:51.157070 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:55.157053622 +0000 UTC m=+77.165417995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:52.029220 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.029183 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" event={"ID":"c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff","Type":"ContainerStarted","Data":"864f63a3aa38418ad92ab50e01ed1e6bb8c639f2c0fea40331d55b791fb59148"} Sep 18 14:51:52.045123 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.045077 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-nf58q" podStartSLOduration=1.400583932 podStartE2EDuration="3.045061223s" totalImagesPullingTime="1.644477291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:52.044441688 +0000 UTC m=+74.052806088" watchObservedRunningTime="2026-09-18 14:51:52.045061223 +0000 UTC m=+74.053425633" Sep 18 14:51:52.484428 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.484388 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.607214 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.607181 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.733948 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.733919 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.833502 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.833418 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.934203 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:52.934167 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.054788 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:53.054755 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.228772 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:53.228742 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.384844 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:53.384811 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.561101 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:53.561021 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.619872 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:53.619839 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.379023 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:54.378985 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.983578 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:54.983535 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.188422 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:55.188389 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.193338 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:55.193302 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:55.193413 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:55.193359 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:51:55.193413 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:55.193390 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:55.193522 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:55.193461 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:03.193445294 +0000 UTC m=+85.201809681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : configmap "kube-rbac-proxy" not found Sep 18 14:51:55.193522 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:55.193469 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:55.193522 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:55.193515 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls podName:56117f5b-ac63-41db-ac5b-f8a816237389 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:03.19350425 +0000 UTC m=+85.201868632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6m4p" (UID: "56117f5b-ac63-41db-ac5b-f8a816237389") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:55.433730 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:55.433704 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.590788 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:55.590752 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.180136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:56.180101 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.201107 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:56.201084 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:51:56.201234 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:56.201219 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:56.201298 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:51:56.201288 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls podName:1521c3f2-8211-4e48-961b-d89280ce07e7 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:12.201273026 +0000 UTC m=+94.209637394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-zlcqv" (UID: "1521c3f2-8211-4e48-961b-d89280ce07e7") : secret "cluster-monitoring-operator-tls" not found Sep 18 14:51:56.291668 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:56.291638 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.575984 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:56.575901 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.986386 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:56.986351 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.043824 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.043793 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.174058 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.174026 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.226443 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.226417 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.349136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.349070 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.399443 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.399422 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.581886 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:57.581833 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:58.577486 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:58.577450 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:58.696231 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:58.696188 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:58.795051 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:58.795015 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.181118 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:59.181084 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.382502 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:59.382467 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.586196 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:51:59.586113 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:00.782334 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:00.782288 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:00.984410 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:00.984250 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:01.187878 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:01.187842 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:01.396285 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:01.396242 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:01.584032 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:01.583953 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:01.973256 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:01.973230 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:02.029857 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:02.029830 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:02.585808 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:02.585775 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:02.601934 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:02.601914 2587 scope.go:117] "RemoveContainer" containerID="26c23dae6e676d12e225c00f399a0e254dea45f1e64ae8777c0ad9b362c40895" Sep 18 14:52:02.783382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:02.783353 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:02.992572 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:02.992545 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.068090 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.068064 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 14:52:03.068240 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.068110 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" event={"ID":"4a736611-4489-4a74-9e67-f589498ba4d1","Type":"ContainerStarted","Data":"5ca991d042b3dae817f99662956e11105abbc7852fb0a5608ddb6f7e8038a2b7"} Sep 18 14:52:03.068368 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.068350 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:52:03.073017 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.072997 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" Sep 18 14:52:03.084823 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.084783 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-xbs7l" podStartSLOduration=21.292234457 podStartE2EDuration="23.084771435s" totalImagesPullingTime="1.792536978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:03.084292462 +0000 UTC m=+85.092656873" watchObservedRunningTime="2026-09-18 14:52:03.084771435 +0000 UTC m=+85.093135824" Sep 18 14:52:03.193665 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.193635 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.263077 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.263000 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:52:03.263205 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.263185 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:52:03.263677 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.263659 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56117f5b-ac63-41db-ac5b-f8a816237389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:52:03.265303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.265281 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56117f5b-ac63-41db-ac5b-f8a816237389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6m4p\" (UID: \"56117f5b-ac63-41db-ac5b-f8a816237389\") " pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:52:03.298136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.298106 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.365437 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.365410 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6m4p" Sep 18 14:52:03.397345 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.396840 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.493987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.493956 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.641596 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.641564 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6m4p"] Sep 18 14:52:03.645499 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:03.645473 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56117f5b_ac63_41db_ac5b_f8a816237389.slice/crio-e72140dca83cf511d8135a7772d1a27ded904da7b673dc1bdbe34ecbb8efe456 WatchSource:0}: Error finding container e72140dca83cf511d8135a7772d1a27ded904da7b673dc1bdbe34ecbb8efe456: Status 404 returned error can't find the container with id e72140dca83cf511d8135a7772d1a27ded904da7b673dc1bdbe34ecbb8efe456 Sep 18 14:52:03.659651 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.659627 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.760234 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.760201 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.871635 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:03.871604 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.065456 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.065374 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.072713 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.072691 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6m4p" event={"ID":"56117f5b-ac63-41db-ac5b-f8a816237389","Type":"ContainerStarted","Data":"24664cd1a29024fdec3564eabd624ea52fd312383a6789a0b9c2ff66280b34f7"} Sep 18 14:52:04.072828 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.072737 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6m4p" event={"ID":"56117f5b-ac63-41db-ac5b-f8a816237389","Type":"ContainerStarted","Data":"e72140dca83cf511d8135a7772d1a27ded904da7b673dc1bdbe34ecbb8efe456"} Sep 18 14:52:04.118058 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.118033 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.465787 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.465754 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.518520 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:04.518491 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:05.076350 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:05.076301 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:05.079380 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:05.079353 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6m4p" event={"ID":"56117f5b-ac63-41db-ac5b-f8a816237389","Type":"ContainerStarted","Data":"3959dc8a6c45f69493a612bd794070596b58d671d583e25997e55c78191d00d3"} Sep 18 14:52:05.131001 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:05.130961 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:05.282417 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:05.282378 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:05.591754 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:05.591715 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:06.084384 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:06.084345 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6m4p" event={"ID":"56117f5b-ac63-41db-ac5b-f8a816237389","Type":"ContainerStarted","Data":"618d812365a8a7678db3c639097507a1a919725f502246886a99b75e6a85cde5"} Sep 18 14:52:06.102059 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:06.101973 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x6m4p" podStartSLOduration=17.067587866 podStartE2EDuration="19.10195772s" totalImagesPullingTime="2.034369854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:06.100991576 +0000 UTC m=+88.109355966" watchObservedRunningTime="2026-09-18 14:52:06.10195772 +0000 UTC m=+88.110322106" Sep 18 14:52:08.059019 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.058989 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2"] Sep 18 14:52:08.062033 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.062015 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.065273 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.065249 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 14:52:08.065391 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.065275 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 14:52:08.066428 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.066413 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 14:52:08.066505 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.066488 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 14:52:08.085848 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.085825 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2"] Sep 18 14:52:08.179214 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.179185 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-69ftf"] Sep 18 14:52:08.182008 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.181990 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:08.184359 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.184342 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9jcps\"" Sep 18 14:52:08.184612 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.184597 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 14:52:08.185069 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.185054 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 14:52:08.198358 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.198340 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-69ftf"] Sep 18 14:52:08.203786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.203736 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:08.205619 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.205600 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c217db-1aad-42f8-9446-a9302365238b-tmp\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.205714 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.205625 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3c217db-1aad-42f8-9446-a9302365238b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.205802 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.205784 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5x7j\" (UniqueName: \"kubernetes.io/projected/b3c217db-1aad-42f8-9446-a9302365238b-kube-api-access-q5x7j\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.292045 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.292019 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:08.306526 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.306503 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-759rg\" (UniqueName: \"kubernetes.io/projected/1fd78b54-16be-45ce-93b5-3227e6dc494b-kube-api-access-759rg\") pod \"downloads-6594f4c75-69ftf\" (UID: \"1fd78b54-16be-45ce-93b5-3227e6dc494b\") " pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:08.306623 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.306535 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5x7j\" (UniqueName: \"kubernetes.io/projected/b3c217db-1aad-42f8-9446-a9302365238b-kube-api-access-q5x7j\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.306623 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.306558 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c217db-1aad-42f8-9446-a9302365238b-tmp\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.306623 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.306601 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3c217db-1aad-42f8-9446-a9302365238b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.306901 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.306885 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c217db-1aad-42f8-9446-a9302365238b-tmp\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.308930 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.308914 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3c217db-1aad-42f8-9446-a9302365238b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.315783 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.315740 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5x7j\" (UniqueName: \"kubernetes.io/projected/b3c217db-1aad-42f8-9446-a9302365238b-kube-api-access-q5x7j\") pod \"klusterlet-addon-workmgr-6f7d959467-768g2\" (UID: \"b3c217db-1aad-42f8-9446-a9302365238b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.373544 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.373522 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:08.408106 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.408070 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-759rg\" (UniqueName: \"kubernetes.io/projected/1fd78b54-16be-45ce-93b5-3227e6dc494b-kube-api-access-759rg\") pod \"downloads-6594f4c75-69ftf\" (UID: \"1fd78b54-16be-45ce-93b5-3227e6dc494b\") " pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:08.416726 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.416658 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-759rg\" (UniqueName: \"kubernetes.io/projected/1fd78b54-16be-45ce-93b5-3227e6dc494b-kube-api-access-759rg\") pod \"downloads-6594f4c75-69ftf\" (UID: \"1fd78b54-16be-45ce-93b5-3227e6dc494b\") " pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:08.489937 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.489908 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:08.640677 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.640650 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2"] Sep 18 14:52:08.643489 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:08.643462 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c217db_1aad_42f8_9446_a9302365238b.slice/crio-055b0e80aeeb1189d7a1c27fefb502871ee7bfda7804b994a0f9e49c4737a07b WatchSource:0}: Error finding container 055b0e80aeeb1189d7a1c27fefb502871ee7bfda7804b994a0f9e49c4737a07b: Status 404 returned error can't find the container with id 055b0e80aeeb1189d7a1c27fefb502871ee7bfda7804b994a0f9e49c4737a07b Sep 18 14:52:08.755434 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:08.755401 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-69ftf"] Sep 18 14:52:08.758953 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:08.758919 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd78b54_16be_45ce_93b5_3227e6dc494b.slice/crio-b66651348862eef3c937e25b37b04b45987bdd65964907e431f2c01b6bcb011f WatchSource:0}: Error finding container b66651348862eef3c937e25b37b04b45987bdd65964907e431f2c01b6bcb011f: Status 404 returned error can't find the container with id b66651348862eef3c937e25b37b04b45987bdd65964907e431f2c01b6bcb011f Sep 18 14:52:09.096037 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:09.095934 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" event={"ID":"b3c217db-1aad-42f8-9446-a9302365238b","Type":"ContainerStarted","Data":"055b0e80aeeb1189d7a1c27fefb502871ee7bfda7804b994a0f9e49c4737a07b"} Sep 18 14:52:09.097024 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:09.097001 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-69ftf" event={"ID":"1fd78b54-16be-45ce-93b5-3227e6dc494b","Type":"ContainerStarted","Data":"b66651348862eef3c937e25b37b04b45987bdd65964907e431f2c01b6bcb011f"} Sep 18 14:52:10.497289 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:10.497185 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:10.548265 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:10.548227 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:10.721548 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:10.721517 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:10.826544 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:10.826165 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:12.241021 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:12.240973 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:52:12.244145 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:12.244111 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1521c3f2-8211-4e48-961b-d89280ce07e7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-zlcqv\" (UID: \"1521c3f2-8211-4e48-961b-d89280ce07e7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:52:12.511857 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:12.511773 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" Sep 18 14:52:13.114133 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:13.114101 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" event={"ID":"b3c217db-1aad-42f8-9446-a9302365238b","Type":"ContainerStarted","Data":"6fbafba0e71e6f5ab45baea3a18b24c82af6cc9059e6662eeaea587b8a466093"} Sep 18 14:52:13.114506 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:13.114486 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:13.115660 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:13.115614 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" podUID="b3c217db-1aad-42f8-9446-a9302365238b" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.13:8000/readyz\": dial tcp 10.132.0.13:8000: connect: connection refused" Sep 18 14:52:13.130334 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:13.130148 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" podStartSLOduration=0.745084531 podStartE2EDuration="5.130134659s" totalImagesPullingTime="4.385050128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:13.12954735 +0000 UTC m=+95.137911765" watchObservedRunningTime="2026-09-18 14:52:13.130134659 +0000 UTC m=+95.138499049" Sep 18 14:52:13.219621 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:13.219595 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv"] Sep 18 14:52:13.222097 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:13.222070 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1521c3f2_8211_4e48_961b_d89280ce07e7.slice/crio-0f31050a57f0687312f3669e545946627b667dc5b4fc2ef3ee47ef46678ab6cd WatchSource:0}: Error finding container 0f31050a57f0687312f3669e545946627b667dc5b4fc2ef3ee47ef46678ab6cd: Status 404 returned error can't find the container with id 0f31050a57f0687312f3669e545946627b667dc5b4fc2ef3ee47ef46678ab6cd Sep 18 14:52:14.118666 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:14.118624 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" event={"ID":"1521c3f2-8211-4e48-961b-d89280ce07e7","Type":"ContainerStarted","Data":"0f31050a57f0687312f3669e545946627b667dc5b4fc2ef3ee47ef46678ab6cd"} Sep 18 14:52:14.120020 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:14.119993 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f7d959467-768g2" Sep 18 14:52:15.123136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.123106 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" event={"ID":"1521c3f2-8211-4e48-961b-d89280ce07e7","Type":"ContainerStarted","Data":"d2bd143ec98b06c49cfcab280353b75d1f7d8663c733c3ca45ff84f8065fc7f2"} Sep 18 14:52:15.376661 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.376575 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.476138 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.476102 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.547610 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.547569 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.550712 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.550681 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb"] Sep 18 14:52:15.553833 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.553816 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:15.556107 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.556088 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 14:52:15.556107 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.556100 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f9vz6\"" Sep 18 14:52:15.563262 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.563241 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb"] Sep 18 14:52:15.668999 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.668961 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/302a2798-5551-4bcf-8470-0d70b4fcaba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zp4zb\" (UID: \"302a2798-5551-4bcf-8470-0d70b4fcaba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:15.727850 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.727814 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.769817 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.769788 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/302a2798-5551-4bcf-8470-0d70b4fcaba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zp4zb\" (UID: \"302a2798-5551-4bcf-8470-0d70b4fcaba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:15.772208 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.772190 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/302a2798-5551-4bcf-8470-0d70b4fcaba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zp4zb\" (UID: \"302a2798-5551-4bcf-8470-0d70b4fcaba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:15.865059 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:15.865021 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:16.137573 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:16.137536 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb"] Sep 18 14:52:16.140751 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:16.140723 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302a2798_5551_4bcf_8470_0d70b4fcaba7.slice/crio-21241fbf2529e8c3cb9b6390d3be659393a23998f5f0138eb7f8d6cc52aa4dab WatchSource:0}: Error finding container 21241fbf2529e8c3cb9b6390d3be659393a23998f5f0138eb7f8d6cc52aa4dab: Status 404 returned error can't find the container with id 21241fbf2529e8c3cb9b6390d3be659393a23998f5f0138eb7f8d6cc52aa4dab Sep 18 14:52:16.143682 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:16.143635 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-zlcqv" podStartSLOduration=34.30236198 podStartE2EDuration="36.143613833s" totalImagesPullingTime="1.841251853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:16.142977467 +0000 UTC m=+98.151341858" watchObservedRunningTime="2026-09-18 14:52:16.143613833 +0000 UTC m=+98.151978224" Sep 18 14:52:17.133934 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.133859 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" event={"ID":"302a2798-5551-4bcf-8470-0d70b4fcaba7","Type":"ContainerStarted","Data":"21241fbf2529e8c3cb9b6390d3be659393a23998f5f0138eb7f8d6cc52aa4dab"} Sep 18 14:52:17.282256 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.281779 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:52:17.282256 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.281836 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:17.284388 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.284339 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eb8a7be-4451-4622-82bb-949093645a72-metrics-tls\") pod \"dns-default-v2pfw\" (UID: \"2eb8a7be-4451-4622-82bb-949093645a72\") " pod="openshift-dns/dns-default-v2pfw" Sep 18 14:52:17.284749 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.284729 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"image-registry-85c8bd8d7f-rrccz\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:17.573357 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.573306 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9b47f\"" Sep 18 14:52:17.581046 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.581020 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zr4v6\"" Sep 18 14:52:17.581204 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.581192 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:17.590218 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.590166 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2pfw" Sep 18 14:52:17.864934 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.864851 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:52:17.866093 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:17.866070 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2pfw"] Sep 18 14:52:17.868102 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:17.868075 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8b37ed_9922_42a3_b79a_483d2d8a8f38.slice/crio-c36e0c9b8a734b45bdbf411b8d3d40466e5f4e85e2c38fe0492e5d043a25bd58 WatchSource:0}: Error finding container c36e0c9b8a734b45bdbf411b8d3d40466e5f4e85e2c38fe0492e5d043a25bd58: Status 404 returned error can't find the container with id c36e0c9b8a734b45bdbf411b8d3d40466e5f4e85e2c38fe0492e5d043a25bd58 Sep 18 14:52:17.868924 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:17.868900 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb8a7be_4451_4622_82bb_949093645a72.slice/crio-962a75ab39eefb331c7a8788da3f4e67311564480c0e9b90ee3a1ba2c50bdfb9 WatchSource:0}: Error finding container 962a75ab39eefb331c7a8788da3f4e67311564480c0e9b90ee3a1ba2c50bdfb9: Status 404 returned error can't find the container with id 962a75ab39eefb331c7a8788da3f4e67311564480c0e9b90ee3a1ba2c50bdfb9 Sep 18 14:52:18.139855 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.139771 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" event={"ID":"302a2798-5551-4bcf-8470-0d70b4fcaba7","Type":"ContainerStarted","Data":"75d46508e5298a4fad5841b1231565d9b45bda2b75437f03707c6df6096acc97"} Sep 18 14:52:18.140525 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.140467 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:18.141774 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.141598 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2pfw" event={"ID":"2eb8a7be-4451-4622-82bb-949093645a72","Type":"ContainerStarted","Data":"962a75ab39eefb331c7a8788da3f4e67311564480c0e9b90ee3a1ba2c50bdfb9"} Sep 18 14:52:18.143861 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.143808 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" event={"ID":"fa8b37ed-9922-42a3-b79a-483d2d8a8f38","Type":"ContainerStarted","Data":"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191"} Sep 18 14:52:18.143861 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.143846 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" event={"ID":"fa8b37ed-9922-42a3-b79a-483d2d8a8f38","Type":"ContainerStarted","Data":"c36e0c9b8a734b45bdbf411b8d3d40466e5f4e85e2c38fe0492e5d043a25bd58"} Sep 18 14:52:18.144047 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.143880 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:18.145769 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.145746 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" Sep 18 14:52:18.155246 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.155198 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zp4zb" podStartSLOduration=2.032954192 podStartE2EDuration="3.155179614s" totalImagesPullingTime="1.122225422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:18.15405702 +0000 UTC m=+100.162421431" watchObservedRunningTime="2026-09-18 14:52:18.155179614 +0000 UTC m=+100.163544008" Sep 18 14:52:18.184477 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.184418 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" podStartSLOduration=99.184046823 podStartE2EDuration="1m39.184046823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:18.183478918 +0000 UTC m=+100.191843334" watchObservedRunningTime="2026-09-18 14:52:18.184046823 +0000 UTC m=+100.192411204" Sep 18 14:52:18.578843 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.578811 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.680338 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.680286 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.780061 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:18.780026 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:19.099890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:19.099855 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:19.164009 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:19.163975 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:19.672944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:19.672902 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:19.733925 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:19.733890 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.044749 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.044668 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:52:20.059888 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.059858 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:52:20.060056 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.059963 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.062377 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.062345 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 14:52:20.062524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.062423 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 14:52:20.062524 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.062345 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 14:52:20.063221 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.063189 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 14:52:20.063351 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.063297 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 14:52:20.063474 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.063455 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kxvmc\"" Sep 18 14:52:20.208223 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208182 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.208435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208244 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.208435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208338 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.208435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208401 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.208435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208432 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.208627 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.208480 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpz9\" (UniqueName: \"kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309142 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309060 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309142 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309121 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309381 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309147 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309381 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309169 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpz9\" (UniqueName: \"kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309381 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309258 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309381 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309333 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.309934 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309907 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.310060 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309907 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.310060 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.309953 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.311824 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.311801 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.311919 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.311882 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.317529 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.317508 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpz9\" (UniqueName: \"kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9\") pod \"console-84d447c76c-vrrt6\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.374689 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.374652 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:20.714949 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.714917 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.813793 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.813759 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.915542 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:20.915507 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:21.833254 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:21.833218 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:21.933920 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:21.933882 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:22.032053 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:22.032020 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mfpqc" Sep 18 14:52:22.700802 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:22.700768 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:22.754838 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:22.754800 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.711781 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.711753 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.883023 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.882981 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.971421 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.970940 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5"] Sep 18 14:52:23.972345 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.972298 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.975092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.975072 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:23.977284 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.977252 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 14:52:23.977396 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.977351 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wqq2c\"" Sep 18 14:52:23.978151 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.978132 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 14:52:23.978257 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.978160 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 14:52:23.985160 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.984990 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5"] Sep 18 14:52:23.993760 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.993739 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bvdxh"] Sep 18 14:52:23.995981 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.995966 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:23.998937 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.998900 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 14:52:23.999761 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:23.998976 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 14:52:24.000470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.000199 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 14:52:24.000470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.000207 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8p92z\"" Sep 18 14:52:24.003246 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.003216 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9mnpv"] Sep 18 14:52:24.005675 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.005656 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.008304 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.008170 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gsrqk\"" Sep 18 14:52:24.008713 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.008497 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 14:52:24.008713 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.008524 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 14:52:24.008713 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.008540 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 14:52:24.015677 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.015655 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9mnpv"] Sep 18 14:52:24.054202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.054158 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.138835 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.138805 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.142705 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142668 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.142839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142710 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.142839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142739 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-textfile\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.142839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142766 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.142839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142796 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdrh\" (UniqueName: \"kubernetes.io/projected/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-kube-api-access-6wdrh\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.142839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142821 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0022f62-a2d7-496f-91c2-f7e6811aed1a-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142846 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-metrics-client-ca\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142891 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/668cd2df-11a4-4096-a682-c77f03cf2321-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142928 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.142987 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143024 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143043 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.143092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143060 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69zg\" (UniqueName: \"kubernetes.io/projected/e0022f62-a2d7-496f-91c2-f7e6811aed1a-kube-api-access-c69zg\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143119 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-sys\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143142 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hrz\" (UniqueName: \"kubernetes.io/projected/668cd2df-11a4-4096-a682-c77f03cf2321-kube-api-access-m4hrz\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143188 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-root\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143207 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-wtmp\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143228 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.143721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.143271 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.204327 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.204237 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.244570 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244488 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-metrics-client-ca\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.244570 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244538 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/668cd2df-11a4-4096-a682-c77f03cf2321-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.244752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244608 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.244752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244652 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.244752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244683 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.244752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244710 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.244752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244734 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69zg\" (UniqueName: \"kubernetes.io/projected/e0022f62-a2d7-496f-91c2-f7e6811aed1a-kube-api-access-c69zg\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244762 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-sys\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244792 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hrz\" (UniqueName: \"kubernetes.io/projected/668cd2df-11a4-4096-a682-c77f03cf2321-kube-api-access-m4hrz\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244827 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-root\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244848 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-wtmp\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244875 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244908 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244940 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244971 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244999 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-textfile\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245014 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.244998 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/668cd2df-11a4-4096-a682-c77f03cf2321-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.245550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.245152 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-metrics-client-ca\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.245302 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.245550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.245365 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdrh\" (UniqueName: \"kubernetes.io/projected/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-kube-api-access-6wdrh\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.245550 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.245392 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0022f62-a2d7-496f-91c2-f7e6811aed1a-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.247074 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0022f62-a2d7-496f-91c2-f7e6811aed1a-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.247436 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-sys\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.247930 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-textfile\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.245531 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.248065 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-root\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.248341 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.248214 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-wtmp\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.254469 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.253033 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.254469 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.253113 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.254469 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:24.254366 2587 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 14:52:24.254469 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:24.254449 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls podName:50ab2591-bd22-4f2a-baeb-7a2d3589db1e nodeName:}" failed. No retries permitted until 2026-09-18 14:52:24.754422679 +0000 UTC m=+106.762787064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls") pod "node-exporter-bvdxh" (UID: "50ab2591-bd22-4f2a-baeb-7a2d3589db1e") : secret "node-exporter-tls" not found Sep 18 14:52:24.255305 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.255095 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.255305 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.255251 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.256961 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.255901 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.259000 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.258480 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hrz\" (UniqueName: \"kubernetes.io/projected/668cd2df-11a4-4096-a682-c77f03cf2321-kube-api-access-m4hrz\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.261047 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.261003 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0022f62-a2d7-496f-91c2-f7e6811aed1a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.262266 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.261617 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/668cd2df-11a4-4096-a682-c77f03cf2321-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9mnpv\" (UID: \"668cd2df-11a4-4096-a682-c77f03cf2321\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.262266 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.261904 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69zg\" (UniqueName: \"kubernetes.io/projected/e0022f62-a2d7-496f-91c2-f7e6811aed1a-kube-api-access-c69zg\") pod \"openshift-state-metrics-86c5bc79d6-7shs5\" (UID: \"e0022f62-a2d7-496f-91c2-f7e6811aed1a\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.265058 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.265031 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdrh\" (UniqueName: \"kubernetes.io/projected/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-kube-api-access-6wdrh\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.287891 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.287865 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" Sep 18 14:52:24.302124 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.302035 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.317251 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.317230 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" Sep 18 14:52:24.500840 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.500708 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.551771 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.551741 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.850985 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.850894 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:24.851460 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:24.851026 2587 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 14:52:24.851460 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:24.851091 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls podName:50ab2591-bd22-4f2a-baeb-7a2d3589db1e nodeName:}" failed. No retries permitted until 2026-09-18 14:52:25.851073379 +0000 UTC m=+107.859437759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls") pod "node-exporter-bvdxh" (UID: "50ab2591-bd22-4f2a-baeb-7a2d3589db1e") : secret "node-exporter-tls" not found Sep 18 14:52:24.881633 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.881593 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:24.982915 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:24.982871 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.083690 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:25.083656 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.774045 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:25.774007 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.861205 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:25.861167 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:25.863730 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:25.863708 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ab2591-bd22-4f2a-baeb-7a2d3589db1e-node-exporter-tls\") pod \"node-exporter-bvdxh\" (UID: \"50ab2591-bd22-4f2a-baeb-7a2d3589db1e\") " pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:26.108011 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.107925 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvdxh" Sep 18 14:52:26.697970 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:26.697932 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ab2591_bd22_4f2a_baeb_7a2d3589db1e.slice/crio-a3a612c7560a39770aba94d7fe263cc903b4a74e693efe8029a1b18f9d5200a4 WatchSource:0}: Error finding container a3a612c7560a39770aba94d7fe263cc903b4a74e693efe8029a1b18f9d5200a4: Status 404 returned error can't find the container with id a3a612c7560a39770aba94d7fe263cc903b4a74e693efe8029a1b18f9d5200a4 Sep 18 14:52:26.928056 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.928017 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:26.975984 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.975957 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5fc875bccc-mwkwk"] Sep 18 14:52:26.979351 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.979329 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:26.982396 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.982359 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 14:52:26.982846 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.982787 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 14:52:26.983004 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.982982 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 14:52:26.983192 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.982788 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c6mfh\"" Sep 18 14:52:26.983597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.983407 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7j1l967b99jr6\"" Sep 18 14:52:26.983597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.983244 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 14:52:26.983597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:26.983596 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 14:52:27.003790 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.003702 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:52:27.003790 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.003765 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9mnpv"] Sep 18 14:52:27.003951 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.003802 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc875bccc-mwkwk"] Sep 18 14:52:27.005814 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.005523 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5"] Sep 18 14:52:27.029547 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.029259 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173382 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-metrics-client-ca\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173471 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173505 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173545 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173570 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhsbq\" (UniqueName: \"kubernetes.io/projected/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-kube-api-access-vhsbq\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173610 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-grpc-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173652 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.173926 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.173681 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.182141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.182075 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" event={"ID":"668cd2df-11a4-4096-a682-c77f03cf2321","Type":"ContainerStarted","Data":"78098f7c802c4179fb4c6879f1b24f043d22f19ad7e66010b57d75e28c0b2c3b"} Sep 18 14:52:27.183688 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.183656 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvdxh" event={"ID":"50ab2591-bd22-4f2a-baeb-7a2d3589db1e","Type":"ContainerStarted","Data":"a3a612c7560a39770aba94d7fe263cc903b4a74e693efe8029a1b18f9d5200a4"} Sep 18 14:52:27.185306 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.185281 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-69ftf" event={"ID":"1fd78b54-16be-45ce-93b5-3227e6dc494b","Type":"ContainerStarted","Data":"8322d4778f6f30542bbaacc57726d78f6c494c145dd6cb2d7283aedfb8a6f4d0"} Sep 18 14:52:27.185963 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.185900 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:27.188204 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.188109 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2pfw" event={"ID":"2eb8a7be-4451-4622-82bb-949093645a72","Type":"ContainerStarted","Data":"7d13d22e6c256d2b888e09c759e39e5d4347fa5816645654c51418885d3a22d1"} Sep 18 14:52:27.188204 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.188166 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2pfw" Sep 18 14:52:27.188204 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.188192 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2pfw" event={"ID":"2eb8a7be-4451-4622-82bb-949093645a72","Type":"ContainerStarted","Data":"bbc8e39557c9dced48becb372378d69035174aa4aed1420b25073dca9cda8fba"} Sep 18 14:52:27.189731 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.189647 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:27.190658 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.190615 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" event={"ID":"e0022f62-a2d7-496f-91c2-f7e6811aed1a","Type":"ContainerStarted","Data":"28d65393d3ffffd098692aeed36478f52cd0a22bef3ea844432a924ee11dd4d8"} Sep 18 14:52:27.190752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.190669 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" event={"ID":"e0022f62-a2d7-496f-91c2-f7e6811aed1a","Type":"ContainerStarted","Data":"63dc0bb0933cfe11f75195b7a1b6a423f9de3feb03e8327f14dbf78b0b33bc6a"} Sep 18 14:52:27.190752 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.190697 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" event={"ID":"e0022f62-a2d7-496f-91c2-f7e6811aed1a","Type":"ContainerStarted","Data":"8b67f208472ede0a1169a3b136fb0736d3eb6950905ce3dae9ca3c3241d8ed96"} Sep 18 14:52:27.192142 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.192098 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d447c76c-vrrt6" event={"ID":"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd","Type":"ContainerStarted","Data":"f795dc3c2b5e48670e587365f869dd9a031829daf4b00cd5da53529785a1f186"} Sep 18 14:52:27.192235 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.192176 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-69ftf" Sep 18 14:52:27.203154 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.202748 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-69ftf" podStartSLOduration=1.201224348 podStartE2EDuration="19.202735322s" totalImagesPullingTime="18.001510974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:27.201430619 +0000 UTC m=+109.209795030" watchObservedRunningTime="2026-09-18 14:52:27.202735322 +0000 UTC m=+109.211099712" Sep 18 14:52:27.257703 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.249110 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2pfw" podStartSLOduration=65.426838957 podStartE2EDuration="1m14.249090438s" totalImagesPullingTime="8.822251481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:27.247342831 +0000 UTC m=+109.255707242" watchObservedRunningTime="2026-09-18 14:52:27.249090438 +0000 UTC m=+109.257454829" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.274884 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.274934 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.274981 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.275009 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhsbq\" (UniqueName: \"kubernetes.io/projected/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-kube-api-access-vhsbq\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.275050 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-grpc-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.275096 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.275129 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.275167 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-metrics-client-ca\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.276448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.276047 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-metrics-client-ca\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.282717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.282651 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.282838 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.282808 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.283421 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.283373 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.283735 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.283683 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-grpc-tls\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.285593 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.285550 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.286966 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.286904 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.290807 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.290767 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhsbq\" (UniqueName: \"kubernetes.io/projected/b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284-kube-api-access-vhsbq\") pod \"thanos-querier-5fc875bccc-mwkwk\" (UID: \"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284\") " pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.293484 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.293456 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:27.394974 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.394937 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:27.495790 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.495535 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:27.604488 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.604001 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc875bccc-mwkwk"] Sep 18 14:52:27.627419 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:27.627371 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1338d1b_7d37_4ed5_b7e9_b2c94c7fa284.slice/crio-198fe866462129adaf5b7066e5ba3ac0a4a6965655049bc3f8ab40a6be58bd82 WatchSource:0}: Error finding container 198fe866462129adaf5b7066e5ba3ac0a4a6965655049bc3f8ab40a6be58bd82: Status 404 returned error can't find the container with id 198fe866462129adaf5b7066e5ba3ac0a4a6965655049bc3f8ab40a6be58bd82 Sep 18 14:52:27.862244 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:27.862146 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:28.204886 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.204849 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"198fe866462129adaf5b7066e5ba3ac0a4a6965655049bc3f8ab40a6be58bd82"} Sep 18 14:52:28.658702 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.658667 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:28.761838 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.761739 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:28.798561 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.797148 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9htjb"] Sep 18 14:52:28.830776 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.830739 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9htjb"] Sep 18 14:52:28.830951 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.830866 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:28.836815 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.836467 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 14:52:28.836815 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.836725 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xjp8s\"" Sep 18 14:52:28.854532 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.854446 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:28.898343 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.896213 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6p9\" (UniqueName: \"kubernetes.io/projected/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-kube-api-access-qb6p9\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:28.898343 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.896305 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:28.999397 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.998733 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:28.999397 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:28.998830 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6p9\" (UniqueName: \"kubernetes.io/projected/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-kube-api-access-qb6p9\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:28.999397 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:28.999163 2587 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 14:52:28.999397 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:28.999226 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert podName:6543725c-90b8-4fbd-9bf5-0c37eb6e6363 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:29.499207162 +0000 UTC m=+111.507571544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-9htjb" (UID: "6543725c-90b8-4fbd-9bf5-0c37eb6e6363") : secret "monitoring-plugin-cert" not found Sep 18 14:52:29.014536 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.014503 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6p9\" (UniqueName: \"kubernetes.io/projected/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-kube-api-access-qb6p9\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:29.061528 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.061492 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:52:29.206882 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.205169 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c887bf746-xr78p"] Sep 18 14:52:29.227443 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.225689 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c887bf746-xr78p"] Sep 18 14:52:29.227443 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.225823 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.236406 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.236205 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 14:52:29.236552 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.236518 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6x5v8\"" Sep 18 14:52:29.236844 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.236825 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 14:52:29.237176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.237060 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 14:52:29.237334 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.237302 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 14:52:29.237625 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.237603 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 14:52:29.242046 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.241971 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302112 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302156 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8qd9\" (UniqueName: \"kubernetes.io/projected/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-kube-api-access-w8qd9\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302197 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302221 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-metrics-client-ca\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302256 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-serving-certs-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302700 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-federate-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302751 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.302913 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.302808 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404584 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404634 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8qd9\" (UniqueName: \"kubernetes.io/projected/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-kube-api-access-w8qd9\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404678 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404705 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-metrics-client-ca\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404744 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-serving-certs-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404771 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-federate-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.404809 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404821 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.405274 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.404882 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.405965 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.405909 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-metrics-client-ca\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.406414 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.406350 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-serving-certs-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.406721 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.406698 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.420817 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.420128 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.420817 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.420758 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8qd9\" (UniqueName: \"kubernetes.io/projected/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-kube-api-access-w8qd9\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.425822 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.425780 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-telemeter-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.426278 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.426237 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-secret-telemeter-client\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.426862 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.426824 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4-federate-client-tls\") pod \"telemeter-client-5c887bf746-xr78p\" (UID: \"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4\") " pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.506999 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.506388 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:29.506999 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:29.506591 2587 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 14:52:29.506999 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:29.506652 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert podName:6543725c-90b8-4fbd-9bf5-0c37eb6e6363 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:30.506634041 +0000 UTC m=+112.514998412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-9htjb" (UID: "6543725c-90b8-4fbd-9bf5-0c37eb6e6363") : secret "monitoring-plugin-cert" not found Sep 18 14:52:29.550330 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.550089 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" Sep 18 14:52:29.870857 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:29.870721 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.187685 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.187647 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:30.192176 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.192142 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.206777 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.206750 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.208599 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.208514 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.210712 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.210906 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.211119 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.211275 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.211480 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.211672 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.211880 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gx8lw\"" Sep 18 14:52:30.212344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.212064 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 14:52:30.215021 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.213727 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 14:52:30.215021 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.213966 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 14:52:30.215021 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.214675 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.215400 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.215424 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.215572 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ic73idl7c82k\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.215646 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.215763 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 14:52:30.216603 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.216198 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 14:52:30.315534 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315492 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315718 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315559 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315718 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315597 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315718 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315638 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315718 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315662 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315718 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315699 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315739 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315765 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315789 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.315987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.315974 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316008 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwrb\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316044 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316067 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316091 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316139 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316186 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316183 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316772 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316205 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316772 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316227 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316772 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316254 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.316772 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.316284 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.336835 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.336809 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.411229 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.411179 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417483 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417522 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417548 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417599 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417638 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417660 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417682 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417713 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417745 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417779 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417829 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417862 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417906 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417929 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.417985 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.418034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.418866 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.418058 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.418082 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.418115 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.418139 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwrb\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.421219 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.421421 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.421899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.421875 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.422381 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.422347 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.425678 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.425412 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.431701 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.431141 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.431701 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.431560 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.433775 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.432837 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.433775 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.433736 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.434291 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.434273 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.443047 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.442971 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.447276 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.447249 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.447470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.447265 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwrb\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.447795 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.447751 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.448403 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.448363 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.449031 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.448620 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.449031 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.448723 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.449031 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.448990 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.449692 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.449637 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.455790 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.455738 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.519203 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.519146 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:30.522795 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.522747 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6543725c-90b8-4fbd-9bf5-0c37eb6e6363-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9htjb\" (UID: \"6543725c-90b8-4fbd-9bf5-0c37eb6e6363\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:30.527854 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.527827 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:30.652525 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.652490 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:30.661259 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.661200 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:52:30.733692 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.733612 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.834452 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.834342 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:30.934339 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:30.934290 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:31.033759 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:31.033617 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:31.977968 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:31.977932 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:32.039664 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:32.039629 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:34.199062 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:34.198961 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9htjb"] Sep 18 14:52:34.901376 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:34.901268 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:34.955923 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:34.955885 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:35.469486 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:35.469340 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6543725c_90b8_4fbd_9bf5_0c37eb6e6363.slice/crio-ce477cca0ac3c362a2bce7ed2656d9a79c193d23f1036706ab4a1528c2119913 WatchSource:0}: Error finding container ce477cca0ac3c362a2bce7ed2656d9a79c193d23f1036706ab4a1528c2119913: Status 404 returned error can't find the container with id ce477cca0ac3c362a2bce7ed2656d9a79c193d23f1036706ab4a1528c2119913 Sep 18 14:52:35.734031 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:35.734008 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c887bf746-xr78p"] Sep 18 14:52:35.737354 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:35.737329 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1cfe37_fa9f_4d19_9ca7_23d9e7b159b4.slice/crio-73f90ced4379e6de8b426452c1fcfef588876384ccdfaca61a60de1ace1a0ec4 WatchSource:0}: Error finding container 73f90ced4379e6de8b426452c1fcfef588876384ccdfaca61a60de1ace1a0ec4: Status 404 returned error can't find the container with id 73f90ced4379e6de8b426452c1fcfef588876384ccdfaca61a60de1ace1a0ec4 Sep 18 14:52:35.930449 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:35.930421 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:35.934735 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:35.934703 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780bc44d_64b7_4242_b891_f21423fcebb9.slice/crio-a252320096d61873ef44a328dcbc1239f9983228d6c50b3c47899ca22bfe546e WatchSource:0}: Error finding container a252320096d61873ef44a328dcbc1239f9983228d6c50b3c47899ca22bfe546e: Status 404 returned error can't find the container with id a252320096d61873ef44a328dcbc1239f9983228d6c50b3c47899ca22bfe546e Sep 18 14:52:36.263988 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.263858 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" event={"ID":"e0022f62-a2d7-496f-91c2-f7e6811aed1a","Type":"ContainerStarted","Data":"e95842403f23cb71b682f7f3469c198313b1a5e8e8831b9db71d09c9c8596f16"} Sep 18 14:52:36.267185 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.267125 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" event={"ID":"668cd2df-11a4-4096-a682-c77f03cf2321","Type":"ContainerStarted","Data":"0f19bf129c1a3a062b9518bd58f84c22c55c46531427cda1586f423fabd57301"} Sep 18 14:52:36.267185 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.267184 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" event={"ID":"668cd2df-11a4-4096-a682-c77f03cf2321","Type":"ContainerStarted","Data":"59a93bff7a2803b49adb168f36b07d2f24740a05a89e95ee3c5ff994e7f9fff5"} Sep 18 14:52:36.267417 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.267215 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" event={"ID":"668cd2df-11a4-4096-a682-c77f03cf2321","Type":"ContainerStarted","Data":"f3b5376754dd5ccf0327db15009cdb0709c7d68221388637c7d0ff5ba32638df"} Sep 18 14:52:36.269260 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.269194 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" event={"ID":"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4","Type":"ContainerStarted","Data":"73f90ced4379e6de8b426452c1fcfef588876384ccdfaca61a60de1ace1a0ec4"} Sep 18 14:52:36.272303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.272139 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"648dcb50b418916d23cd1a2116142a7146f8ed534960ece9047819153b9f7965"} Sep 18 14:52:36.272303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.272216 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"0eda091fb01e3b8d9df4b134a41570b633bff9939e7d84f7c48ffcebdeba47c2"} Sep 18 14:52:36.272303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.272258 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"fc9f38d62987a35cb478604bfd0f6787d42cafcc550df5ec383cf547d66f2a91"} Sep 18 14:52:36.273666 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.273594 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"a252320096d61873ef44a328dcbc1239f9983228d6c50b3c47899ca22bfe546e"} Sep 18 14:52:36.275456 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.275432 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d447c76c-vrrt6" event={"ID":"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd","Type":"ContainerStarted","Data":"5afce9cf9290cc2d369bfe95eee67816d9c93945d418a16550975e7762bc07d7"} Sep 18 14:52:36.278263 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.278236 2587 generic.go:356] "Generic (PLEG): container finished" podID="50ab2591-bd22-4f2a-baeb-7a2d3589db1e" containerID="3893d04dc55f54f7812cb98c6fb6f66384ba5641b07e4d205e2d3959e5e5b063" exitCode=0 Sep 18 14:52:36.278403 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.278342 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvdxh" event={"ID":"50ab2591-bd22-4f2a-baeb-7a2d3589db1e","Type":"ContainerDied","Data":"3893d04dc55f54f7812cb98c6fb6f66384ba5641b07e4d205e2d3959e5e5b063"} Sep 18 14:52:36.280364 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.280268 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-7shs5" podStartSLOduration=5.161820629 podStartE2EDuration="13.280250248s" totalImagesPullingTime="8.118429619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:36.27929871 +0000 UTC m=+118.287663148" watchObservedRunningTime="2026-09-18 14:52:36.280250248 +0000 UTC m=+118.288614639" Sep 18 14:52:36.283249 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.283208 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" event={"ID":"6543725c-90b8-4fbd-9bf5-0c37eb6e6363","Type":"ContainerStarted","Data":"ce477cca0ac3c362a2bce7ed2656d9a79c193d23f1036706ab4a1528c2119913"} Sep 18 14:52:36.314657 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.314590 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-9mnpv" podStartSLOduration=7.087857705 podStartE2EDuration="13.314568226s" totalImagesPullingTime="6.226710521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:36.313569995 +0000 UTC m=+118.321934426" watchObservedRunningTime="2026-09-18 14:52:36.314568226 +0000 UTC m=+118.322932619" Sep 18 14:52:36.331518 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:36.331454 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84d447c76c-vrrt6" podStartSLOduration=7.69106619 podStartE2EDuration="16.331433348s" totalImagesPullingTime="8.640367158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:36.330244571 +0000 UTC m=+118.338608979" watchObservedRunningTime="2026-09-18 14:52:36.331433348 +0000 UTC m=+118.339797736" Sep 18 14:52:37.208678 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:37.208646 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2pfw" Sep 18 14:52:37.292976 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:37.292936 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvdxh" event={"ID":"50ab2591-bd22-4f2a-baeb-7a2d3589db1e","Type":"ContainerStarted","Data":"2e77e98e6292b949a4c199369222aead23bf7491870a04fc01dff4ae1b18ec70"} Sep 18 14:52:37.293205 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:37.293003 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvdxh" event={"ID":"50ab2591-bd22-4f2a-baeb-7a2d3589db1e","Type":"ContainerStarted","Data":"6f5b8d81c82b5cc9f1699911d888ca6e2ee35371f0f93b5622bc23f32f123200"} Sep 18 14:52:37.311556 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:37.311496 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bvdxh" podStartSLOduration=7.649617995 podStartE2EDuration="14.311473221s" totalImagesPullingTime="6.551076516s" totalInitContainerRuntime="110.77871ms" isStatefulPod=true podCreationTimestamp="2026-09-18 14:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:37.309239537 +0000 UTC m=+119.317603946" watchObservedRunningTime="2026-09-18 14:52:37.311473221 +0000 UTC m=+119.319837608" Sep 18 14:52:39.306074 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.306045 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" event={"ID":"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4","Type":"ContainerStarted","Data":"fe58ca39933a09caf5c9768cd53411be596d8ba91a9b647561c799b06c0c4b9e"} Sep 18 14:52:39.306448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.306100 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" event={"ID":"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4","Type":"ContainerStarted","Data":"1c678f534e2750738299789fc70695b9b1b86bf7aa53175f0fab6d5b8ca651dd"} Sep 18 14:52:39.308662 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.308636 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"9e5d530917cee42e839c25cd1970727948ca4e7c3a549f0f7469453eab4ffc58"} Sep 18 14:52:39.308748 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.308691 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"ad4937af0818bcc274875bbe86d7b7154b6c71e82b0b16315a0952aa10bc41b2"} Sep 18 14:52:39.311006 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.310980 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14" exitCode=0 Sep 18 14:52:39.311110 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.311061 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14"} Sep 18 14:52:39.313062 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.313038 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" event={"ID":"6543725c-90b8-4fbd-9bf5-0c37eb6e6363","Type":"ContainerStarted","Data":"b23c28a126730832d4977520e4f84a3cb978de040fc5da1afd7cfbbf9932b3a0"} Sep 18 14:52:39.317440 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.317345 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:39.321963 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.321937 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" Sep 18 14:52:39.352074 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.352023 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9htjb" podStartSLOduration=8.022181275 podStartE2EDuration="11.352008789s" totalImagesPullingTime="3.329827514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:39.350893675 +0000 UTC m=+121.359258086" watchObservedRunningTime="2026-09-18 14:52:39.352008789 +0000 UTC m=+121.360373194" Sep 18 14:52:39.915398 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:39.915366 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:40.018518 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.018488 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:40.078573 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.078546 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:40.327033 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.326951 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" event={"ID":"1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4","Type":"ContainerStarted","Data":"fa73af9a6df1b9d3fc11aaa013c11b08ce4e74661c3cbb6c6d76ddbc849794ef"} Sep 18 14:52:40.330508 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.330480 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" event={"ID":"b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284","Type":"ContainerStarted","Data":"10ad767367e1e2053790f319a58b086cddbe40fcabc089c6814f42e601c73d77"} Sep 18 14:52:40.348202 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.348127 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c887bf746-xr78p" podStartSLOduration=8.109134118 podStartE2EDuration="11.348108694s" totalImagesPullingTime="3.238974576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:40.345902328 +0000 UTC m=+122.354266742" watchObservedRunningTime="2026-09-18 14:52:40.348108694 +0000 UTC m=+122.356473278" Sep 18 14:52:40.367360 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.367299 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" podStartSLOduration=3.42010734 podStartE2EDuration="14.367281701s" totalImagesPullingTime="10.947174361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:40.365327915 +0000 UTC m=+122.373692322" watchObservedRunningTime="2026-09-18 14:52:40.367281701 +0000 UTC m=+122.375646098" Sep 18 14:52:40.375474 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.375452 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:52:40.511554 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.511519 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:40.572690 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.572626 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:40.668132 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:40.668097 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:41.336369 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.336337 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:41.341943 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.341920 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5fc875bccc-mwkwk" Sep 18 14:52:41.670586 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.670555 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:52:41.705761 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.705720 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:52:41.705927 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.705856 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.714581 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.714556 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 14:52:41.841971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.841929 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842029 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842141 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842085 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842431 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842212 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842732 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842572 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842732 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842625 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmsdr\" (UniqueName: \"kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.842732 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.842667 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.893435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.893406 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:41.943646 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943569 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.943791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943650 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.943791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943677 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.943791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943718 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmsdr\" (UniqueName: \"kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.943791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943743 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.943791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943789 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.944028 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.943833 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.944703 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.944676 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.944906 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.944881 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.945013 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.944881 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.945553 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.945533 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.947066 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.947034 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.947808 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.947781 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.954706 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.954682 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmsdr\" (UniqueName: \"kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr\") pod \"console-755b644d46-5cblf\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:41.993918 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:41.993889 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:42.017793 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:42.017758 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:42.560548 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:42.560525 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:52:42.639497 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:42.639463 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879f480e_e9c6_4c96_b7bb_74beee78ad63.slice/crio-ae761ddbcf1152e5fb86c71590f4eb10993b98fb1db61ea5710752c5ccd7a7fa WatchSource:0}: Error finding container ae761ddbcf1152e5fb86c71590f4eb10993b98fb1db61ea5710752c5ccd7a7fa: Status 404 returned error can't find the container with id ae761ddbcf1152e5fb86c71590f4eb10993b98fb1db61ea5710752c5ccd7a7fa Sep 18 14:52:43.347387 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.347352 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b644d46-5cblf" event={"ID":"879f480e-e9c6-4c96-b7bb-74beee78ad63","Type":"ContainerStarted","Data":"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf"} Sep 18 14:52:43.347552 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.347407 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b644d46-5cblf" event={"ID":"879f480e-e9c6-4c96-b7bb-74beee78ad63","Type":"ContainerStarted","Data":"ae761ddbcf1152e5fb86c71590f4eb10993b98fb1db61ea5710752c5ccd7a7fa"} Sep 18 14:52:43.350576 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.350553 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1"} Sep 18 14:52:43.350696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.350611 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176"} Sep 18 14:52:43.350696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.350636 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033"} Sep 18 14:52:43.350696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.350660 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f"} Sep 18 14:52:43.350696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.350688 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c"} Sep 18 14:52:43.365173 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:43.365114 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755b644d46-5cblf" podStartSLOduration=2.36509347 podStartE2EDuration="2.36509347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:43.364640942 +0000 UTC m=+125.373005359" watchObservedRunningTime="2026-09-18 14:52:43.36509347 +0000 UTC m=+125.373457863" Sep 18 14:52:44.112712 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:44.112678 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:44.214080 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:44.214041 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:44.358493 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:44.358455 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerStarted","Data":"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1"} Sep 18 14:52:44.387003 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:44.386918 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.973446954 podStartE2EDuration="14.386901883s" totalImagesPullingTime="6.389315604s" totalInitContainerRuntime="24.139325ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:44.38496608 +0000 UTC m=+126.393330483" watchObservedRunningTime="2026-09-18 14:52:44.386901883 +0000 UTC m=+126.395266273" Sep 18 14:52:45.529069 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:45.529031 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:46.326839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:46.326799 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:46.387911 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:46.387871 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:46.978693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:46.978657 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:47.038193 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:47.038166 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:48.404332 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:48.404294 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:52:48.406722 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:48.406698 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0273bfa-cbb5-4bca-94c5-e3cc4cb87251-metrics-certs\") pod \"network-metrics-daemon-fmggv\" (UID: \"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251\") " pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:52:48.522676 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:48.522648 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zcj9k\"" Sep 18 14:52:48.530501 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:48.530484 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmggv" Sep 18 14:52:48.847039 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:48.847016 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmggv"] Sep 18 14:52:48.848828 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:52:48.848800 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0273bfa_cbb5_4bca_94c5_e3cc4cb87251.slice/crio-5ad8ea12a9f4eb68e7f1982378e0488370ef1248868ee4b4f1535d43db9be828 WatchSource:0}: Error finding container 5ad8ea12a9f4eb68e7f1982378e0488370ef1248868ee4b4f1535d43db9be828: Status 404 returned error can't find the container with id 5ad8ea12a9f4eb68e7f1982378e0488370ef1248868ee4b4f1535d43db9be828 Sep 18 14:52:49.380156 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:49.380120 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmggv" event={"ID":"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251","Type":"ContainerStarted","Data":"5ad8ea12a9f4eb68e7f1982378e0488370ef1248868ee4b4f1535d43db9be828"} Sep 18 14:52:50.392871 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:50.392842 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmggv" event={"ID":"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251","Type":"ContainerStarted","Data":"4b0654eb6b999ebf0e5d027f3fc9f3c1c689f786b526db2055c0c92e0d746d11"} Sep 18 14:52:51.399191 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:51.399153 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmggv" event={"ID":"c0273bfa-cbb5-4bca-94c5-e3cc4cb87251","Type":"ContainerStarted","Data":"4849ec14a2f7c8a3ee6d700bc277f7acb4a56ad782ec3bcdd88d454ecd99303d"} Sep 18 14:52:51.415743 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:51.415695 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fmggv" podStartSLOduration=131.036872846 podStartE2EDuration="2m12.415681801s" totalImagesPullingTime="1.378808955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:51.414412016 +0000 UTC m=+133.422776419" watchObservedRunningTime="2026-09-18 14:52:51.415681801 +0000 UTC m=+133.424046191" Sep 18 14:52:51.504214 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:51.504178 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:51.604843 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:51.604812 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:52.018374 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.018341 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:52.018546 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.018430 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:52.023134 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.023110 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:52.406991 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.406966 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:52:52.555943 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.555911 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:52.607561 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.607529 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:52.665305 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:52.665225 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:54.503046 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:54.503009 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:54.603921 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:54.603887 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:54.663619 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:54.663583 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:55.690562 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:55.690495 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" podUID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" containerName="registry" containerID="cri-o://cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191" gracePeriod=30 Sep 18 14:52:55.976514 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:55.976488 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:56.074147 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074119 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074147 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074151 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gltdp\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074354 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074197 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074402 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074366 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074457 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074425 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074516 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074489 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074570 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074517 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.074626 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074573 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:56.074687 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074624 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token\") pod \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\" (UID: \"fa8b37ed-9922-42a3-b79a-483d2d8a8f38\") " Sep 18 14:52:56.075083 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.074894 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:56.075083 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.075069 2587 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-certificates\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.075276 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.075091 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-trusted-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.076843 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.076808 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp" (OuterVolumeSpecName: "kube-api-access-gltdp") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "kube-api-access-gltdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:56.076944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.076878 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:56.077069 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.077049 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:56.077177 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.077157 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:56.077232 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.077190 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:56.085400 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.085377 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fa8b37ed-9922-42a3-b79a-483d2d8a8f38" (UID: "fa8b37ed-9922-42a3-b79a-483d2d8a8f38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:52:56.175664 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175636 2587 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-ca-trust-extracted\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.175664 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175662 2587 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-installation-pull-secrets\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.175813 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175677 2587 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-bound-sa-token\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.175813 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175691 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gltdp\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-kube-api-access-gltdp\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.175813 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175703 2587 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-registry-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.175813 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.175716 2587 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8b37ed-9922-42a3-b79a-483d2d8a8f38-image-registry-private-configuration\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:52:56.421121 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.421091 2587 generic.go:356] "Generic (PLEG): container finished" podID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" containerID="cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191" exitCode=0 Sep 18 14:52:56.421302 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.421146 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" event={"ID":"fa8b37ed-9922-42a3-b79a-483d2d8a8f38","Type":"ContainerDied","Data":"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191"} Sep 18 14:52:56.421302 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.421204 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" event={"ID":"fa8b37ed-9922-42a3-b79a-483d2d8a8f38","Type":"ContainerDied","Data":"c36e0c9b8a734b45bdbf411b8d3d40466e5f4e85e2c38fe0492e5d043a25bd58"} Sep 18 14:52:56.421302 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.421145 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c8bd8d7f-rrccz" Sep 18 14:52:56.421302 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.421223 2587 scope.go:117] "RemoveContainer" containerID="cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191" Sep 18 14:52:56.430470 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.430422 2587 scope.go:117] "RemoveContainer" containerID="cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191" Sep 18 14:52:56.430820 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:52:56.430795 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191\": container with ID starting with cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191 not found: ID does not exist" containerID="cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191" Sep 18 14:52:56.430904 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.430826 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191"} err="failed to get container status \"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191\": rpc error: code = NotFound desc = could not find container \"cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191\": container with ID starting with cf64569ab820ea27fa4cb6b13f6a8f192bc468cb20616e4a0ef7f31e71d90191 not found: ID does not exist" Sep 18 14:52:56.443730 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.443704 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:52:56.446585 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.446566 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85c8bd8d7f-rrccz"] Sep 18 14:52:56.607030 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:52:56.607001 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" path="/var/lib/kubelet/pods/fa8b37ed-9922-42a3-b79a-483d2d8a8f38/volumes" Sep 18 14:53:01.305665 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.305603 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84d447c76c-vrrt6" podUID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" containerName="console" containerID="cri-o://5afce9cf9290cc2d369bfe95eee67816d9c93945d418a16550975e7762bc07d7" gracePeriod=15 Sep 18 14:53:01.444107 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.444064 2587 generic.go:356] "Generic (PLEG): container finished" podID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" containerID="5afce9cf9290cc2d369bfe95eee67816d9c93945d418a16550975e7762bc07d7" exitCode=0 Sep 18 14:53:01.444276 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.444128 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d447c76c-vrrt6" event={"ID":"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd","Type":"ContainerDied","Data":"5afce9cf9290cc2d369bfe95eee67816d9c93945d418a16550975e7762bc07d7"} Sep 18 14:53:01.547026 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.547004 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:53:01.619132 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619044 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619132 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619081 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619132 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619111 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619136 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619204 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619435 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619264 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tpz9\" (UniqueName: \"kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9\") pod \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\" (UID: \"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd\") " Sep 18 14:53:01.619593 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619560 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.619593 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619570 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config" (OuterVolumeSpecName: "console-config") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.619593 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.619578 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.621573 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.621545 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:01.621731 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.621707 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:01.621779 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.621711 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9" (OuterVolumeSpecName: "kube-api-access-9tpz9") pod "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" (UID: "c0e85138-f643-4c7b-ac7c-4beca9a3a6cd"). InnerVolumeSpecName "kube-api-access-9tpz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:01.720810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720774 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tpz9\" (UniqueName: \"kubernetes.io/projected/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-kube-api-access-9tpz9\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.720810 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720809 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.720983 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720824 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-oauth-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.720983 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720840 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.720983 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720853 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-console-serving-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.720983 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.720864 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd-oauth-serving-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.978976 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:01.978945 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:02.049384 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.049347 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:02.419632 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.419595 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:02.449668 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.449642 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d447c76c-vrrt6" event={"ID":"c0e85138-f643-4c7b-ac7c-4beca9a3a6cd","Type":"ContainerDied","Data":"f795dc3c2b5e48670e587365f869dd9a031829daf4b00cd5da53529785a1f186"} Sep 18 14:53:02.449668 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.449659 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d447c76c-vrrt6" Sep 18 14:53:02.449848 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.449691 2587 scope.go:117] "RemoveContainer" containerID="5afce9cf9290cc2d369bfe95eee67816d9c93945d418a16550975e7762bc07d7" Sep 18 14:53:02.471249 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.471225 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:53:02.474632 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.474609 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84d447c76c-vrrt6"] Sep 18 14:53:02.479673 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.479653 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:02.606486 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:02.606457 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" path="/var/lib/kubelet/pods/c0e85138-f643-4c7b-ac7c-4beca9a3a6cd/volumes" Sep 18 14:53:04.979901 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:04.979870 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:05.081761 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:05.081725 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:15.838532 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:15.838499 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:30.529092 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:30.529055 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:30.548193 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:30.548166 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:30.591247 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:30.591222 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:40.082646 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:40.082615 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:40.143521 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:40.143463 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.210172 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:45.210132 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.267650 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:45.267602 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.386924 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:45.386887 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.447971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:45.447939 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.949127 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:45.949090 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:46.001535 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:46.001502 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:48.610891 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.610861 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611148 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="prometheus" containerID="cri-o://0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c" gracePeriod=600 Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611162 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-web" containerID="cri-o://6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176" gracePeriod=600 Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611186 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="thanos-sidecar" containerID="cri-o://63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033" gracePeriod=600 Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611157 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy" containerID="cri-o://ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1" gracePeriod=600 Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611224 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1" gracePeriod=600 Sep 18 14:53:48.611382 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:48.611172 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="config-reloader" containerID="cri-o://008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f" gracePeriod=600 Sep 18 14:53:49.654146 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654113 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1" exitCode=0 Sep 18 14:53:49.654146 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654138 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1" exitCode=0 Sep 18 14:53:49.654146 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654145 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033" exitCode=0 Sep 18 14:53:49.654146 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654150 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f" exitCode=0 Sep 18 14:53:49.654146 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654156 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c" exitCode=0 Sep 18 14:53:49.654717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654192 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1"} Sep 18 14:53:49.654717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654280 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1"} Sep 18 14:53:49.654717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654343 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033"} Sep 18 14:53:49.654717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654387 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f"} Sep 18 14:53:49.654717 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.654427 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c"} Sep 18 14:53:49.864949 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.864926 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:49.932486 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932402 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932486 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932453 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932486 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932581 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932617 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932642 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932693 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932667 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932709 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932734 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932768 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932797 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932832 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932860 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932893 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.932944 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932934 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932949 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.932973 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933017 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933043 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdwrb\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933047 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933067 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933092 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle\") pod \"780bc44d-64b7-4242-b891-f21423fcebb9\" (UID: \"780bc44d-64b7-4242-b891-f21423fcebb9\") " Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933385 2587 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:49.933436 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933405 2587 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:49.933877 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.933687 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.934187 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.934159 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:49.935051 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.934763 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.935051 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.934814 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.935051 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.935022 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.935425 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.935394 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:49.935506 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.935451 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.936112 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.936078 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.937549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.937307 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.937549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.937436 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config" (OuterVolumeSpecName: "config") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.937549 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.937519 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out" (OuterVolumeSpecName: "config-out") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:49.938107 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.938080 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb" (OuterVolumeSpecName: "kube-api-access-zdwrb") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "kube-api-access-zdwrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:49.938395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.938355 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:49.938395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.938372 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.938712 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.938685 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.938791 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.938742 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.939273 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.939251 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:49.950863 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:49.950836 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config" (OuterVolumeSpecName: "web-config") pod "780bc44d-64b7-4242-b891-f21423fcebb9" (UID: "780bc44d-64b7-4242-b891-f21423fcebb9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:50.033727 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033685 2587 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033727 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033724 2587 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033727 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033735 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdwrb\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-kube-api-access-zdwrb\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033727 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033744 2587 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033753 2587 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033762 2587 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033770 2587 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-metrics-client-certs\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033780 2587 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033789 2587 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-grpc-tls\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033797 2587 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033804 2587 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-secret-kube-rbac-proxy\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033812 2587 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-config-out\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033820 2587 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-configmap-metrics-client-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033827 2587 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/780bc44d-64b7-4242-b891-f21423fcebb9-tls-assets\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033835 2587 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033844 2587 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033852 2587 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/780bc44d-64b7-4242-b891-f21423fcebb9-prometheus-k8s-db\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.033971 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.033860 2587 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/780bc44d-64b7-4242-b891-f21423fcebb9-web-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:53:50.661215 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.661186 2587 generic.go:356] "Generic (PLEG): container finished" podID="780bc44d-64b7-4242-b891-f21423fcebb9" containerID="6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176" exitCode=0 Sep 18 14:53:50.661597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.661261 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.661597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.661261 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176"} Sep 18 14:53:50.661597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.661360 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"780bc44d-64b7-4242-b891-f21423fcebb9","Type":"ContainerDied","Data":"a252320096d61873ef44a328dcbc1239f9983228d6c50b3c47899ca22bfe546e"} Sep 18 14:53:50.661597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.661395 2587 scope.go:117] "RemoveContainer" containerID="8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1" Sep 18 14:53:50.669239 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.669215 2587 scope.go:117] "RemoveContainer" containerID="ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1" Sep 18 14:53:50.679624 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.679604 2587 scope.go:117] "RemoveContainer" containerID="6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176" Sep 18 14:53:50.683712 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.683690 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:50.687559 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.687537 2587 scope.go:117] "RemoveContainer" containerID="63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033" Sep 18 14:53:50.687973 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.687943 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:50.694041 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.694022 2587 scope.go:117] "RemoveContainer" containerID="008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f" Sep 18 14:53:50.700627 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.700608 2587 scope.go:117] "RemoveContainer" containerID="0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c" Sep 18 14:53:50.707840 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.707814 2587 scope.go:117] "RemoveContainer" containerID="93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14" Sep 18 14:53:50.712770 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.712750 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:50.713054 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713040 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="init-config-reloader" Sep 18 14:53:50.713054 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713054 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="init-config-reloader" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713064 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="thanos-sidecar" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713070 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="thanos-sidecar" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713078 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" containerName="console" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713085 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" containerName="console" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713092 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="config-reloader" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713097 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="config-reloader" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713111 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="prometheus" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713116 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="prometheus" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713122 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-web" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713128 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-web" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713135 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" containerName="registry" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713141 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" containerName="registry" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713147 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713152 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713168 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:50.713181 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713175 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713226 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0e85138-f643-4c7b-ac7c-4beca9a3a6cd" containerName="console" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713235 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="thanos-sidecar" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713243 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-web" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713252 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713259 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8b37ed-9922-42a3-b79a-483d2d8a8f38" containerName="registry" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713264 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="config-reloader" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713269 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="prometheus" Sep 18 14:53:50.713736 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.713275 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" containerName="kube-rbac-proxy" Sep 18 14:53:50.715003 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.714984 2587 scope.go:117] "RemoveContainer" containerID="8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1" Sep 18 14:53:50.715331 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.715297 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1\": container with ID starting with 8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1 not found: ID does not exist" containerID="8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1" Sep 18 14:53:50.715430 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715348 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1"} err="failed to get container status \"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1\": rpc error: code = NotFound desc = could not find container \"8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1\": container with ID starting with 8e78f149a82a44a7983462e63b2fa8edaee39c4d0c57b4e78f00638afbcbd5d1 not found: ID does not exist" Sep 18 14:53:50.715430 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715371 2587 scope.go:117] "RemoveContainer" containerID="ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1" Sep 18 14:53:50.715655 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.715636 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1\": container with ID starting with ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1 not found: ID does not exist" containerID="ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1" Sep 18 14:53:50.715701 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715660 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1"} err="failed to get container status \"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1\": rpc error: code = NotFound desc = could not find container \"ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1\": container with ID starting with ba773b674dbad7fc4718ec6e28f258500bcec700f4b53506d32b8a0c42319fd1 not found: ID does not exist" Sep 18 14:53:50.715701 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715675 2587 scope.go:117] "RemoveContainer" containerID="6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176" Sep 18 14:53:50.715917 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.715901 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176\": container with ID starting with 6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176 not found: ID does not exist" containerID="6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176" Sep 18 14:53:50.715952 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715922 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176"} err="failed to get container status \"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176\": rpc error: code = NotFound desc = could not find container \"6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176\": container with ID starting with 6ec916738893f9220bd9be1ef22f8c7bdec99ce2c67158f3b343fa180d9fd176 not found: ID does not exist" Sep 18 14:53:50.715952 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.715935 2587 scope.go:117] "RemoveContainer" containerID="63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033" Sep 18 14:53:50.716174 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.716157 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033\": container with ID starting with 63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033 not found: ID does not exist" containerID="63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033" Sep 18 14:53:50.716209 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716178 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033"} err="failed to get container status \"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033\": rpc error: code = NotFound desc = could not find container \"63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033\": container with ID starting with 63983595c71a7eae7d850d41ef2bf3dcdf4b31ead28139483104bbe91a531033 not found: ID does not exist" Sep 18 14:53:50.716209 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716190 2587 scope.go:117] "RemoveContainer" containerID="008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f" Sep 18 14:53:50.716532 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.716509 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f\": container with ID starting with 008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f not found: ID does not exist" containerID="008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f" Sep 18 14:53:50.716631 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716535 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f"} err="failed to get container status \"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f\": rpc error: code = NotFound desc = could not find container \"008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f\": container with ID starting with 008c7f9abb0a9992cb3fc7f6e7415eb6c750a1b73dd0c76767e74bf98ea48b0f not found: ID does not exist" Sep 18 14:53:50.716631 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716549 2587 scope.go:117] "RemoveContainer" containerID="0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c" Sep 18 14:53:50.716788 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.716771 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c\": container with ID starting with 0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c not found: ID does not exist" containerID="0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c" Sep 18 14:53:50.716832 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716791 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c"} err="failed to get container status \"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c\": rpc error: code = NotFound desc = could not find container \"0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c\": container with ID starting with 0faa1b6b680811120b216170d428a5b12c120318392df5ee575f47d855847b8c not found: ID does not exist" Sep 18 14:53:50.716832 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.716804 2587 scope.go:117] "RemoveContainer" containerID="93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14" Sep 18 14:53:50.717013 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:53:50.716998 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14\": container with ID starting with 93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14 not found: ID does not exist" containerID="93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14" Sep 18 14:53:50.717051 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.717017 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14"} err="failed to get container status \"93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14\": rpc error: code = NotFound desc = could not find container \"93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14\": container with ID starting with 93c155066906ec0b0fdfbc554d42f3a9cfa45cb63c6836e1875bf67b9911fc14 not found: ID does not exist" Sep 18 14:53:50.717106 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.717094 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.719634 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.719618 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 14:53:50.719735 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.719621 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 14:53:50.719829 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.719810 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 14:53:50.720007 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.719989 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 14:53:50.720100 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720014 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gx8lw\"" Sep 18 14:53:50.720100 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720085 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 14:53:50.720100 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720014 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 14:53:50.720348 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720086 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ic73idl7c82k\"" Sep 18 14:53:50.720348 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720096 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 14:53:50.720348 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720212 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 14:53:50.720506 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720470 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 14:53:50.720559 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720517 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 14:53:50.720609 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720593 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 14:53:50.720662 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720624 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 14:53:50.720714 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.720683 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 14:53:50.723870 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.723848 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 14:53:50.726245 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.726224 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 14:53:50.734781 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.734759 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:50.737856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737837 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.737961 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737865 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.737961 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737884 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.737961 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737904 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.737961 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737944 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737975 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.737999 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738018 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738036 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738058 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738085 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738144 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738116 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738163 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738189 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738212 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738243 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738270 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738328 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738362 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.738401 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.738385 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvlb\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-kube-api-access-swvlb\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839563 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839537 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839567 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839586 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839604 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839620 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839648 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839694 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839673 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839771 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839807 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839829 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839871 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839896 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839918 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swvlb\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-kube-api-access-swvlb\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.839989 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.839966 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840002 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840029 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840070 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840096 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840137 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840164 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840364 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.840890 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840410 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.841339 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.840928 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.841339 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.841152 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.841511 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.841489 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.841933 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.841594 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.841933 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.841724 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.843574 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.843550 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844392 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844074 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844392 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844226 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844392 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844264 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844392 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844343 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844654 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844630 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.844848 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.844828 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.845279 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.845250 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.845405 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.845253 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.845590 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.845570 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.845817 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.845795 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-config\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.846379 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.846361 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:50.848552 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:50.848531 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvlb\" (UniqueName: \"kubernetes.io/projected/356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6-kube-api-access-swvlb\") pod \"prometheus-k8s-0\" (UID: \"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:51.027696 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:51.027667 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:51.311840 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:51.311817 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:51.313996 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:53:51.313972 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356cd1b4_8bf5_47e2_8d60_a8a61a5f59e6.slice/crio-efc1588f5b12dae4321524c3830b564a874357d031c150565f14f8432d7d0cb0 WatchSource:0}: Error finding container efc1588f5b12dae4321524c3830b564a874357d031c150565f14f8432d7d0cb0: Status 404 returned error can't find the container with id efc1588f5b12dae4321524c3830b564a874357d031c150565f14f8432d7d0cb0 Sep 18 14:53:51.667164 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:51.667132 2587 generic.go:356] "Generic (PLEG): container finished" podID="356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6" containerID="5afde3b1b78229e2076f6b2aeab1c7373dfc1364da43098cd0227fa2f8bf764e" exitCode=0 Sep 18 14:53:51.667636 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:51.667184 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerDied","Data":"5afde3b1b78229e2076f6b2aeab1c7373dfc1364da43098cd0227fa2f8bf764e"} Sep 18 14:53:51.667636 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:51.667231 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"efc1588f5b12dae4321524c3830b564a874357d031c150565f14f8432d7d0cb0"} Sep 18 14:53:52.014276 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.014251 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:52.115999 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.115957 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:52.607121 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.607089 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780bc44d-64b7-4242-b891-f21423fcebb9" path="/var/lib/kubelet/pods/780bc44d-64b7-4242-b891-f21423fcebb9/volumes" Sep 18 14:53:52.675463 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675431 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"60dce7d97ab49813b03b348b820b85d048f23dc612a93be5f5bb6600e0bdc8ca"} Sep 18 14:53:52.675786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675495 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"ff1cae4d5e73b6dbe886ee991b629bd2a5b6b05804da1421b3747449b116c292"} Sep 18 14:53:52.675786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675522 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"b4327bfa7da64566ca2765b805e416c7d9cbd59796faa0bb4f53d866b3614442"} Sep 18 14:53:52.675786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675559 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"bc8b946905ff4b564e870a6ee0007550371d453fb74e5c7fcf526b08362bb835"} Sep 18 14:53:52.675786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675588 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"26e80a82f02906aa23cadb7fcf8fa1d3c1df112d57de0258083c625df5b76b1d"} Sep 18 14:53:52.675786 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.675614 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6","Type":"ContainerStarted","Data":"b0ed9da55a0476973f73074fb51e1d60149e623b7ebe7446ff6219d68e9b1191"} Sep 18 14:53:52.702152 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:52.702096 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.68472308 podStartE2EDuration="2.702062741s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.339661ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:53:52.699952423 +0000 UTC m=+194.708316832" watchObservedRunningTime="2026-09-18 14:53:52.702062741 +0000 UTC m=+194.710427132" Sep 18 14:53:56.028433 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:56.028402 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:56.158214 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:56.158178 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:53:56.256676 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:56.256645 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:56.363136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:56.363057 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:56.413705 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:53:56.413673 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:02.022754 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:02.022716 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:02.123162 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:02.123126 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:03.635325 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:03.635278 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:10.989103 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:10.989059 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:21.177455 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.177408 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-755b644d46-5cblf" podUID="879f480e-e9c6-4c96-b7bb-74beee78ad63" containerName="console" containerID="cri-o://32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf" gracePeriod=15 Sep 18 14:54:21.406816 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.406793 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:54:21.500477 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500407 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500477 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500444 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500477 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500468 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmsdr\" (UniqueName: \"kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500725 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500492 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500725 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500510 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500725 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500550 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500725 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500567 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca\") pod \"879f480e-e9c6-4c96-b7bb-74beee78ad63\" (UID: \"879f480e-e9c6-4c96-b7bb-74beee78ad63\") " Sep 18 14:54:21.500967 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500940 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config" (OuterVolumeSpecName: "console-config") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.501032 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.500970 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.501032 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.501009 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.501032 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.501026 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca" (OuterVolumeSpecName: "service-ca") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.502613 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.502591 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr" (OuterVolumeSpecName: "kube-api-access-gmsdr") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "kube-api-access-gmsdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:54:21.503037 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.503003 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:54:21.503116 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.503046 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "879f480e-e9c6-4c96-b7bb-74beee78ad63" (UID: "879f480e-e9c6-4c96-b7bb-74beee78ad63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:54:21.601327 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601295 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-serving-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601340 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmsdr\" (UniqueName: \"kubernetes.io/projected/879f480e-e9c6-4c96-b7bb-74beee78ad63-kube-api-access-gmsdr\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601350 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-trusted-ca-bundle\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601358 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-oauth-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601366 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-oauth-serving-cert\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601374 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-service-ca\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.601448 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.601382 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/879f480e-e9c6-4c96-b7bb-74beee78ad63-console-config\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.793579 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.793504 2587 generic.go:356] "Generic (PLEG): container finished" podID="879f480e-e9c6-4c96-b7bb-74beee78ad63" containerID="32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf" exitCode=0 Sep 18 14:54:21.793579 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.793547 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b644d46-5cblf" Sep 18 14:54:21.793579 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.793559 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b644d46-5cblf" event={"ID":"879f480e-e9c6-4c96-b7bb-74beee78ad63","Type":"ContainerDied","Data":"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf"} Sep 18 14:54:21.793909 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.793608 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b644d46-5cblf" event={"ID":"879f480e-e9c6-4c96-b7bb-74beee78ad63","Type":"ContainerDied","Data":"ae761ddbcf1152e5fb86c71590f4eb10993b98fb1db61ea5710752c5ccd7a7fa"} Sep 18 14:54:21.793909 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.793633 2587 scope.go:117] "RemoveContainer" containerID="32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf" Sep 18 14:54:21.802680 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.802660 2587 scope.go:117] "RemoveContainer" containerID="32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf" Sep 18 14:54:21.802926 ip-10-0-136-56 kubenswrapper[2587]: E0918 14:54:21.802905 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf\": container with ID starting with 32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf not found: ID does not exist" containerID="32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf" Sep 18 14:54:21.802973 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.802933 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf"} err="failed to get container status \"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf\": rpc error: code = NotFound desc = could not find container \"32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf\": container with ID starting with 32a632d5bc5d5dc8e726c51731cbd6528dfbebb3215a6ce67b44809bf64ddacf not found: ID does not exist" Sep 18 14:54:21.815377 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.815337 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:54:21.819172 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:21.819152 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755b644d46-5cblf"] Sep 18 14:54:22.607194 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:22.607161 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="879f480e-e9c6-4c96-b7bb-74beee78ad63" path="/var/lib/kubelet/pods/879f480e-e9c6-4c96-b7bb-74beee78ad63/volumes" Sep 18 14:54:43.070244 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:43.070212 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:43.122774 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:43.122749 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:51.028501 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:51.028466 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:51.043716 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:51.043691 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:51.927833 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:51.927807 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:56.098688 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:56.098660 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:56.196484 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:54:56.196455 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:08.005878 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:08.005793 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:08.107713 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:08.107679 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:17.788358 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:17.788282 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:18.576965 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:18.576924 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:21.381774 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:21.381741 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:21.434339 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:21.434296 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:23.632447 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:23.632415 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:23.733148 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:23.733113 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:26.033762 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:26.033727 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:26.209216 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:26.209181 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:26.312720 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:26.312621 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:33.232990 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:33.232937 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:38.411796 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:38.411762 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 14:55:38.416229 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:38.416207 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:55:38.417230 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:38.417210 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 14:55:38.422000 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:38.421980 2587 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 14:55:38.422294 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:38.422279 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 14:55:40.074272 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:40.074232 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:40.169703 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:40.169665 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:46.125400 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:46.125361 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:46.180858 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:46.180824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:50.361634 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:50.361600 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:50.461948 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:50.461914 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:52.186936 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.186905 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m8md6"] Sep 18 14:55:52.187344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.187239 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879f480e-e9c6-4c96-b7bb-74beee78ad63" containerName="console" Sep 18 14:55:52.187344 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.187251 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="879f480e-e9c6-4c96-b7bb-74beee78ad63" containerName="console" Sep 18 14:55:52.187433 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.187353 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="879f480e-e9c6-4c96-b7bb-74beee78ad63" containerName="console" Sep 18 14:55:52.190099 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.190083 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.192342 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.192292 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 14:55:52.192489 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.192471 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:55:52.193195 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.193179 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-r4d2t\"" Sep 18 14:55:52.199117 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.199099 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m8md6"] Sep 18 14:55:52.228507 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.228483 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzsl\" (UniqueName: \"kubernetes.io/projected/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-kube-api-access-4xzsl\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.228600 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.228526 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-tmp\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.329136 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.329101 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzsl\" (UniqueName: \"kubernetes.io/projected/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-kube-api-access-4xzsl\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.329303 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.329150 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-tmp\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.329563 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.329546 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-tmp\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.336715 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.336696 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzsl\" (UniqueName: \"kubernetes.io/projected/95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf-kube-api-access-4xzsl\") pod \"jobset-operator-5bc45f897-m8md6\" (UID: \"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.515025 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.514954 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" Sep 18 14:55:52.782485 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.782293 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m8md6"] Sep 18 14:55:52.785156 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:55:52.785124 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95de76e5_d8c3_4996_ab8d_3fe10cf8ffaf.slice/crio-15d674e3a098ee1cca8617f060e06c1720a283043568371ea07d27731a1dba4c WatchSource:0}: Error finding container 15d674e3a098ee1cca8617f060e06c1720a283043568371ea07d27731a1dba4c: Status 404 returned error can't find the container with id 15d674e3a098ee1cca8617f060e06c1720a283043568371ea07d27731a1dba4c Sep 18 14:55:52.786899 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:52.786881 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:55:53.146326 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:53.146289 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" event={"ID":"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf","Type":"ContainerStarted","Data":"15d674e3a098ee1cca8617f060e06c1720a283043568371ea07d27731a1dba4c"} Sep 18 14:55:55.157103 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:55.157067 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" event={"ID":"95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf","Type":"ContainerStarted","Data":"0a6a488a6ecc8685d9d2f4ce7444cbec9092047ce69413624c77f608d8a5313f"} Sep 18 14:55:55.175229 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:55:55.175177 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m8md6" podStartSLOduration=0.918984345 podStartE2EDuration="3.175162469s" totalImagesPullingTime="2.256178124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:55:55.17412713 +0000 UTC m=+317.182491520" watchObservedRunningTime="2026-09-18 14:55:55.175162469 +0000 UTC m=+317.183526860" Sep 18 14:56:00.825782 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:00.825747 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:02.853943 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:02.853907 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:03.073467 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:03.073432 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:03.131598 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:03.131477 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:19.907689 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:19.907651 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:20.005848 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:20.005806 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:23.184927 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.184893 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:23.187942 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.187916 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5"] Sep 18 14:56:23.193910 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.193893 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.196117 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.196099 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 18 14:56:23.196219 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.196176 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 14:56:23.197069 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.197051 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 14:56:23.197220 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.197189 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 18 14:56:23.197395 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.197105 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-dn6n5\"" Sep 18 14:56:23.199590 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.199567 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5"] Sep 18 14:56:23.245365 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.245340 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:23.294939 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.294906 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkqp5\" (UniqueName: \"kubernetes.io/projected/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kube-api-access-qkqp5\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.295083 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.294952 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.295083 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.294996 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-cert\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.396387 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.396348 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.396575 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.396393 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-cert\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.396575 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.396492 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkqp5\" (UniqueName: \"kubernetes.io/projected/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kube-api-access-qkqp5\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.397098 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.397073 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.398740 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.398719 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-cert\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.404652 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.404628 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkqp5\" (UniqueName: \"kubernetes.io/projected/dd68ebf4-72b1-4c9f-b24a-2f740661a43c-kube-api-access-qkqp5\") pod \"kubeflow-trainer-controller-manager-64ff576dff-wskr5\" (UID: \"dd68ebf4-72b1-4c9f-b24a-2f740661a43c\") " pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.504666 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.504577 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:23.771243 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:23.771207 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5"] Sep 18 14:56:23.773426 ip-10-0-136-56 kubenswrapper[2587]: W0918 14:56:23.773400 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd68ebf4_72b1_4c9f_b24a_2f740661a43c.slice/crio-ea66a94a743595fb01c5bcbef64b8ee6e945f01effaca8d4b0856132aca8ee97 WatchSource:0}: Error finding container ea66a94a743595fb01c5bcbef64b8ee6e945f01effaca8d4b0856132aca8ee97: Status 404 returned error can't find the container with id ea66a94a743595fb01c5bcbef64b8ee6e945f01effaca8d4b0856132aca8ee97 Sep 18 14:56:24.274079 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:24.274017 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" event={"ID":"dd68ebf4-72b1-4c9f-b24a-2f740661a43c","Type":"ContainerStarted","Data":"ea66a94a743595fb01c5bcbef64b8ee6e945f01effaca8d4b0856132aca8ee97"} Sep 18 14:56:26.283723 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:26.283628 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" event={"ID":"dd68ebf4-72b1-4c9f-b24a-2f740661a43c","Type":"ContainerStarted","Data":"43f9477f6e0573191f7ed93745cd6ad53f9ed71cbdb37059f3d39b6d858a275d"} Sep 18 14:56:26.283723 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:26.283685 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:56:26.299630 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:26.299588 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podStartSLOduration=1.117521244 podStartE2EDuration="3.299574401s" totalImagesPullingTime="2.182053157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:56:26.29843649 +0000 UTC m=+348.306800927" watchObservedRunningTime="2026-09-18 14:56:26.299574401 +0000 UTC m=+348.307938791" Sep 18 14:56:27.666839 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:27.666809 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:27.725856 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:27.725824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:39.470369 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:39.470272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:39.522094 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:39.522062 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:42.290205 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:42.290165 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:56:54.965226 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:54.965192 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:55.020260 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:55.020234 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:57.290418 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:56:57.290377 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:57:12.289392 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:12.289353 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:57:20.685003 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:20.684971 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:20.815530 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:20.815500 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:21.425234 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:21.425201 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:27.288941 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:27.288898 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:57:31.152411 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:31.152379 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:31.252987 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:31.252942 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:31.310162 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:31.310127 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:42.290222 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:42.290184 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:57:57.289547 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:57.289503 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:57:57.602643 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:57:57.602567 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" podUID="dd68ebf4-72b1-4c9f-b24a-2f740661a43c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 14:58:12.607085 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:58:12.607010 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-64ff576dff-wskr5" Sep 18 14:59:01.473597 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:59:01.473560 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:01.564185 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:59:01.564154 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:01.622063 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:59:01.622029 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:38.627781 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:59:38.627705 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:38.732749 ip-10-0-136-56 kubenswrapper[2587]: I0918 14:59:38.732720 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:25.919572 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:25.919540 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:26.020819 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:26.020783 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:38.440796 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:38.440771 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:00:38.444345 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:38.444300 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:00:38.445586 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:38.445566 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:00:38.449085 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:38.449066 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:00:50.524497 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:50.524457 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:50.583954 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:00:50.583913 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:20.806326 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:02:20.806293 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:28.396563 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:02:28.396518 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:19.089527 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:19.089496 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:19.186772 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:19.186740 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:19.259045 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:19.259009 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:24.513107 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:24.513077 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:24.860938 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:24.860858 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:24.961475 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:24.961440 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:25.017921 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:03:25.017888 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:38.469644 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:38.469564 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:05:38.470767 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:38.470745 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:05:38.474722 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:38.474703 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:05:38.475684 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:38.475668 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:05:51.956930 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:51.956890 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:52.061062 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:52.061025 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:52.170527 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:52.170496 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:57.092719 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:57.092680 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:57.629890 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:57.629854 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:05:57.683552 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:05:57.683519 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:35.888449 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.888413 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:35.962343 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.962282 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:35.986597 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.986569 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm"] Sep 18 15:06:35.989959 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.989944 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:35.993194 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.993160 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-zbs7v\"/\"default-dockercfg-6pzgt\"" Sep 18 15:06:35.993194 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.993180 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-zbs7v\"/\"kube-root-ca.crt\"" Sep 18 15:06:35.993386 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.993180 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-zbs7v\"/\"e2e-test-flux-flux-entrypoint\"" Sep 18 15:06:35.993386 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.993160 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-zbs7v\"/\"openshift-service-ca.crt\"" Sep 18 15:06:35.993386 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.993197 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-zbs7v\"/\"e2e-test-flux-flux-curve\"" Sep 18 15:06:35.998448 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:35.998424 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm"] Sep 18 15:06:36.026380 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.026342 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:36.137992 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.137958 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.137992 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.137997 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.138188 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.138018 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7m52\" (UniqueName: \"kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.138188 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.138101 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.138188 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.138150 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.138188 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.138173 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239111 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239075 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239111 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239117 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239302 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239141 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7m52\" (UniqueName: \"kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239383 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239305 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239426 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239398 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239426 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239419 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239554 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239533 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.239721 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.239698 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.240045 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.240026 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.241505 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.241484 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.241593 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.241583 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.247460 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.247436 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7m52\" (UniqueName: \"kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52\") pod \"e2e-test-flux-node-0-1-xz2mm\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.300454 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.300413 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:06:36.569033 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.568952 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm"] Sep 18 15:06:36.572986 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:06:36.572959 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82ac4379_fb8f_4b4b_818f_d5afdb55896b.slice/crio-cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af WatchSource:0}: Error finding container cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af: Status 404 returned error can't find the container with id cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af Sep 18 15:06:36.575065 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.575044 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 15:06:36.782610 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:36.782575 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerStarted","Data":"cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af"} Sep 18 15:06:41.049647 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:41.049609 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:41.460705 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:41.460676 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:41.561872 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:41.561813 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:47.842609 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:47.842529 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerStarted","Data":"fb5cd2a8555976e095e431049b640f27f0ad38129cde9aab5d5860f2a5ba330c"} Sep 18 15:06:50.858196 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:50.858160 2587 generic.go:356] "Generic (PLEG): container finished" podID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerID="fb5cd2a8555976e095e431049b640f27f0ad38129cde9aab5d5860f2a5ba330c" exitCode=0 Sep 18 15:06:50.858626 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:50.858228 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerDied","Data":"fb5cd2a8555976e095e431049b640f27f0ad38129cde9aab5d5860f2a5ba330c"} Sep 18 15:06:52.878174 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:52.878085 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerStarted","Data":"817b788067838f2b04966176b2770a6da893f25ec482523e17d3f750e25c58ed"} Sep 18 15:06:52.895030 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:06:52.894980 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" podStartSLOduration=2.420554176 podStartE2EDuration="17.894963132s" totalImagesPullingTime="12.333036343s" totalInitContainerRuntime="3.141372613s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:06:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:06:52.893654801 +0000 UTC m=+974.902019203" watchObservedRunningTime="2026-09-18 15:06:52.894963132 +0000 UTC m=+974.903327522" Sep 18 15:07:03.931439 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:03.931402 2587 generic.go:356] "Generic (PLEG): container finished" podID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerID="817b788067838f2b04966176b2770a6da893f25ec482523e17d3f750e25c58ed" exitCode=0 Sep 18 15:07:03.931908 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:03.931452 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerDied","Data":"817b788067838f2b04966176b2770a6da893f25ec482523e17d3f750e25c58ed"} Sep 18 15:07:05.241055 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.240973 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:07:05.292400 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292372 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292590 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292412 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292590 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292430 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292590 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292450 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292590 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292515 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292590 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292533 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7m52\" (UniqueName: \"kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52\") pod \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\" (UID: \"82ac4379-fb8f-4b4b-818f-d5afdb55896b\") " Sep 18 15:07:05.292860 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.292781 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint" (OuterVolumeSpecName: "e2e-test-flux-flux-entrypoint") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 15:07:05.294820 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.294778 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve" (OuterVolumeSpecName: "flux-curve") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:07:05.294923 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.294830 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52" (OuterVolumeSpecName: "kube-api-access-h7m52") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "kube-api-access-h7m52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:07:05.295146 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.295123 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory" (OuterVolumeSpecName: "shared-memory") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 15:07:05.393989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.393953 2587 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/82ac4379-fb8f-4b4b-818f-d5afdb55896b-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:05.393989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.393987 2587 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-shared-memory\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:05.393989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.393997 2587 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-curve\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:05.394225 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.394006 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7m52\" (UniqueName: \"kubernetes.io/projected/82ac4379-fb8f-4b4b-818f-d5afdb55896b-kube-api-access-h7m52\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:05.905892 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.905858 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:05.942707 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.942679 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" Sep 18 15:07:05.942865 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.942679 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm" event={"ID":"82ac4379-fb8f-4b4b-818f-d5afdb55896b","Type":"ContainerDied","Data":"cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af"} Sep 18 15:07:05.942865 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.942786 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf70917cbaa826276c44f2cac914326fb37544b9f09d91c08ca8692fce7c32af" Sep 18 15:07:05.991690 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:05.991642 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:06.091523 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:06.091491 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:06.872585 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:06.872535 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install" (OuterVolumeSpecName: "flux-install") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 15:07:06.907938 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:06.907910 2587 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-flux-install\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:07.002771 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:07.002735 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:07.106592 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:07.106560 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:10.845238 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:10.845206 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm"] Sep 18 15:07:10.848370 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:10.848345 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-zbs7v/e2e-test-flux-node-0-1-xz2mm"] Sep 18 15:07:11.123882 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:11.123817 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:11.742612 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:11.742574 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:11.801427 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:11.801375 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:12.062335 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:12.062256 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:12.162500 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:12.162469 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:12.214150 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:12.214110 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:12.684641 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:12.684606 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:12.737856 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:12.737830 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:13.580136 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:13.580094 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install" (OuterVolumeSpecName: "spack-install") pod "82ac4379-fb8f-4b4b-818f-d5afdb55896b" (UID: "82ac4379-fb8f-4b4b-818f-d5afdb55896b"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 15:07:13.665907 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:13.665874 2587 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/82ac4379-fb8f-4b4b-818f-d5afdb55896b-spack-install\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:14.607832 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:14.607799 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" path="/var/lib/kubelet/pods/82ac4379-fb8f-4b4b-818f-d5afdb55896b/volumes" Sep 18 15:07:22.054179 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:22.054152 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:22.114396 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:22.114365 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:27.521851 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:27.521819 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:27.580336 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:27.580284 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:31.102400 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.102361 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:31.207214 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.207188 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:31.268707 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.268675 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz"] Sep 18 15:07:31.269126 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269108 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerName="flux-installer" Sep 18 15:07:31.269177 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269135 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerName="flux-installer" Sep 18 15:07:31.269177 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269144 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerName="node" Sep 18 15:07:31.269177 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269150 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerName="node" Sep 18 15:07:31.269274 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:31.269274 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.269215 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ac4379-fb8f-4b4b-818f-d5afdb55896b" containerName="node" Sep 18 15:07:31.281800 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.281776 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz"] Sep 18 15:07:31.281939 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.281849 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:31.284264 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.284246 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mxl7p\"/\"kube-root-ca.crt\"" Sep 18 15:07:31.284391 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.284291 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mxl7p\"/\"openshift-service-ca.crt\"" Sep 18 15:07:31.285264 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.285243 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-mxl7p\"/\"default-dockercfg-rzsk8\"" Sep 18 15:07:31.409219 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.409195 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdwd\" (UniqueName: \"kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd\") pod \"e2e-test-runtime-update-node-0-0-4hksz\" (UID: \"ef7affa2-b3ee-4d7e-88a3-36380376dc45\") " pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:31.509746 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.509713 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdwd\" (UniqueName: \"kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd\") pod \"e2e-test-runtime-update-node-0-0-4hksz\" (UID: \"ef7affa2-b3ee-4d7e-88a3-36380376dc45\") " pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:31.509974 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.509950 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz"] Sep 18 15:07:31.510186 ip-10-0-136-56 kubenswrapper[2587]: E0918 15:07:31.510164 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7bdwd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" podUID="ef7affa2-b3ee-4d7e-88a3-36380376dc45" Sep 18 15:07:31.520531 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:31.520513 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdwd\" (UniqueName: \"kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd\") pod \"e2e-test-runtime-update-node-0-0-4hksz\" (UID: \"ef7affa2-b3ee-4d7e-88a3-36380376dc45\") " pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:32.058994 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.058959 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:32.066646 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.066623 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:32.075738 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.075717 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:32.214670 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.214633 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdwd\" (UniqueName: \"kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd\") pod \"ef7affa2-b3ee-4d7e-88a3-36380376dc45\" (UID: \"ef7affa2-b3ee-4d7e-88a3-36380376dc45\") " Sep 18 15:07:32.216682 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.216651 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd" (OuterVolumeSpecName: "kube-api-access-7bdwd") pod "ef7affa2-b3ee-4d7e-88a3-36380376dc45" (UID: "ef7affa2-b3ee-4d7e-88a3-36380376dc45"). InnerVolumeSpecName "kube-api-access-7bdwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:07:32.316288 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.316194 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdwd\" (UniqueName: \"kubernetes.io/projected/ef7affa2-b3ee-4d7e-88a3-36380376dc45-kube-api-access-7bdwd\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:32.338547 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.338518 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:32.404274 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.404240 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:32.460425 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.460390 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:32.942559 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.942520 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:32.945993 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.945968 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:32.948361 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.948311 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-cbq2s\"/\"kube-root-ca.crt\"" Sep 18 15:07:32.948463 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.948393 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-cbq2s\"/\"openshift-service-ca.crt\"" Sep 18 15:07:32.949046 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.949026 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-cbq2s\"/\"default-dockercfg-f72t8\"" Sep 18 15:07:32.953258 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:32.953236 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:33.022615 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.022591 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m64j\" (UniqueName: \"kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j\") pod \"e2e-test-runtime-update-node-0-0-zbl8g\" (UID: \"81eae9bc-7b25-4a33-8bbf-0f6164247a41\") " pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:33.063130 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.063110 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz" Sep 18 15:07:33.088118 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.088085 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz"] Sep 18 15:07:33.092028 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.092000 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-mxl7p/e2e-test-runtime-update-node-0-0-4hksz"] Sep 18 15:07:33.123606 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.123584 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m64j\" (UniqueName: \"kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j\") pod \"e2e-test-runtime-update-node-0-0-zbl8g\" (UID: \"81eae9bc-7b25-4a33-8bbf-0f6164247a41\") " pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:33.133192 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.133172 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m64j\" (UniqueName: \"kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j\") pod \"e2e-test-runtime-update-node-0-0-zbl8g\" (UID: \"81eae9bc-7b25-4a33-8bbf-0f6164247a41\") " pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:33.173480 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.173455 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:33.173686 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.173674 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:33.195629 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.195578 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:33.442336 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.442290 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:33.449680 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.449647 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:33.536124 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.536093 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:33.606731 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.606697 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:33.610028 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.610000 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v"] Sep 18 15:07:33.614883 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.614860 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:07:33.617234 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.617213 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"openshift-service-ca.crt\"" Sep 18 15:07:33.617370 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.617307 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"kube-root-ca.crt\"" Sep 18 15:07:33.617370 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.617342 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"default-dockercfg-rsc62\"" Sep 18 15:07:33.624919 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.624894 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v"] Sep 18 15:07:33.729948 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.729873 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwss9\" (UniqueName: \"kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9\") pod \"progression-enabled-node-0-0-8b29v\" (UID: \"121eec40-f77b-487d-aad2-2de8184a84b4\") " pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:07:33.751302 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.751271 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:33.831169 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.831147 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwss9\" (UniqueName: \"kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9\") pod \"progression-enabled-node-0-0-8b29v\" (UID: \"121eec40-f77b-487d-aad2-2de8184a84b4\") " pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:07:33.839410 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.839390 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwss9\" (UniqueName: \"kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9\") pod \"progression-enabled-node-0-0-8b29v\" (UID: \"121eec40-f77b-487d-aad2-2de8184a84b4\") " pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:07:33.927533 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:33.927500 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:07:34.069989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.069896 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" event={"ID":"81eae9bc-7b25-4a33-8bbf-0f6164247a41","Type":"ContainerStarted","Data":"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2"} Sep 18 15:07:34.069989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.069945 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" event={"ID":"81eae9bc-7b25-4a33-8bbf-0f6164247a41","Type":"ContainerStarted","Data":"62e13b6b15e8ecffe3f216ede91ff543f9438ee9d136b89fe32383b12874b0fe"} Sep 18 15:07:34.069989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.069969 2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" podUID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" containerName="node" containerID="cri-o://f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2" gracePeriod=30 Sep 18 15:07:34.087254 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.087213 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" podStartSLOduration=1.734924394 podStartE2EDuration="2.087195845s" totalImagesPullingTime="352.271451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:07:34.085265071 +0000 UTC m=+1016.093629489" watchObservedRunningTime="2026-09-18 15:07:34.087195845 +0000 UTC m=+1016.095560235" Sep 18 15:07:34.198800 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.198710 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v"] Sep 18 15:07:34.201715 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:07:34.201690 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121eec40_f77b_487d_aad2_2de8184a84b4.slice/crio-4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a WatchSource:0}: Error finding container 4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a: Status 404 returned error can't find the container with id 4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a Sep 18 15:07:34.319557 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.319534 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:34.435516 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.435488 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m64j\" (UniqueName: \"kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j\") pod \"81eae9bc-7b25-4a33-8bbf-0f6164247a41\" (UID: \"81eae9bc-7b25-4a33-8bbf-0f6164247a41\") " Sep 18 15:07:34.437695 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.437667 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j" (OuterVolumeSpecName: "kube-api-access-4m64j") pod "81eae9bc-7b25-4a33-8bbf-0f6164247a41" (UID: "81eae9bc-7b25-4a33-8bbf-0f6164247a41"). InnerVolumeSpecName "kube-api-access-4m64j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:07:34.536779 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.536746 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m64j\" (UniqueName: \"kubernetes.io/projected/81eae9bc-7b25-4a33-8bbf-0f6164247a41-kube-api-access-4m64j\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:07:34.607824 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:34.607792 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7affa2-b3ee-4d7e-88a3-36380376dc45" path="/var/lib/kubelet/pods/ef7affa2-b3ee-4d7e-88a3-36380376dc45/volumes" Sep 18 15:07:35.081339 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.081238 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" event={"ID":"121eec40-f77b-487d-aad2-2de8184a84b4","Type":"ContainerStarted","Data":"4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a"} Sep 18 15:07:35.086178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.084678 2587 generic.go:356] "Generic (PLEG): container finished" podID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" containerID="f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2" exitCode=0 Sep 18 15:07:35.086178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.084720 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" event={"ID":"81eae9bc-7b25-4a33-8bbf-0f6164247a41","Type":"ContainerDied","Data":"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2"} Sep 18 15:07:35.086178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.084749 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" event={"ID":"81eae9bc-7b25-4a33-8bbf-0f6164247a41","Type":"ContainerDied","Data":"62e13b6b15e8ecffe3f216ede91ff543f9438ee9d136b89fe32383b12874b0fe"} Sep 18 15:07:35.086178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.084772 2587 scope.go:117] "RemoveContainer" containerID="f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2" Sep 18 15:07:35.086178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.084928 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g" Sep 18 15:07:35.102579 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.102524 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:35.107115 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.105964 2587 scope.go:117] "RemoveContainer" containerID="f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2" Sep 18 15:07:35.107115 ip-10-0-136-56 kubenswrapper[2587]: E0918 15:07:35.106351 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2\": container with ID starting with f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2 not found: ID does not exist" containerID="f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2" Sep 18 15:07:35.107115 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.106385 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2"} err="failed to get container status \"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2\": rpc error: code = NotFound desc = could not find container \"f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2\": container with ID starting with f015d929806611b162238089f153f553b1d702e63351d9a53060db3e756dbbe2 not found: ID does not exist" Sep 18 15:07:35.108155 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:35.108132 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-cbq2s/e2e-test-runtime-update-node-0-0-zbl8g"] Sep 18 15:07:36.267757 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:36.267709 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:36.611248 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:36.611167 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" path="/var/lib/kubelet/pods/81eae9bc-7b25-4a33-8bbf-0f6164247a41/volumes" Sep 18 15:07:37.810161 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:37.810092 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:37.910878 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:37.910796 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:39.025223 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:39.025188 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:39.124710 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:39.124677 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:47.034370 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:47.034338 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:47.134942 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:07:47.134902 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:08:13.784301 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:08:13.784268 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:08:38.447175 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:08:38.447135 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" event={"ID":"121eec40-f77b-487d-aad2-2de8184a84b4","Type":"ContainerStarted","Data":"0688ba9da0fbc29f2a35ad70110b3e5e8d9868db446cbddbcbd3cb7f8fa078c6"} Sep 18 15:08:38.462781 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:08:38.462724 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" podStartSLOduration=2.188082278 podStartE2EDuration="1m5.46270622s" totalImagesPullingTime="1m3.274623942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:08:38.461670576 +0000 UTC m=+1080.470034985" watchObservedRunningTime="2026-09-18 15:08:38.46270622 +0000 UTC m=+1080.471070611" Sep 18 15:08:59.542023 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:08:59.541991 2587 generic.go:356] "Generic (PLEG): container finished" podID="121eec40-f77b-487d-aad2-2de8184a84b4" containerID="0688ba9da0fbc29f2a35ad70110b3e5e8d9868db446cbddbcbd3cb7f8fa078c6" exitCode=0 Sep 18 15:08:59.542490 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:08:59.542042 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" event={"ID":"121eec40-f77b-487d-aad2-2de8184a84b4","Type":"ContainerDied","Data":"0688ba9da0fbc29f2a35ad70110b3e5e8d9868db446cbddbcbd3cb7f8fa078c6"} Sep 18 15:09:00.844474 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:00.844382 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:09:00.934645 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:00.934604 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwss9\" (UniqueName: \"kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9\") pod \"121eec40-f77b-487d-aad2-2de8184a84b4\" (UID: \"121eec40-f77b-487d-aad2-2de8184a84b4\") " Sep 18 15:09:00.936876 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:00.936849 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9" (OuterVolumeSpecName: "kube-api-access-kwss9") pod "121eec40-f77b-487d-aad2-2de8184a84b4" (UID: "121eec40-f77b-487d-aad2-2de8184a84b4"). InnerVolumeSpecName "kube-api-access-kwss9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:09:01.035550 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.035515 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwss9\" (UniqueName: \"kubernetes.io/projected/121eec40-f77b-487d-aad2-2de8184a84b4-kube-api-access-kwss9\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:09:01.551788 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.551756 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" event={"ID":"121eec40-f77b-487d-aad2-2de8184a84b4","Type":"ContainerDied","Data":"4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a"} Sep 18 15:09:01.551973 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.551836 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bd91e7bf9b503ab622a5fbbc56a26650692b2cea8b18914da4d77395c41572a" Sep 18 15:09:01.551973 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.551765 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v" Sep 18 15:09:01.895732 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.895695 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6"] Sep 18 15:09:01.896224 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896206 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" containerName="node" Sep 18 15:09:01.896311 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896227 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" containerName="node" Sep 18 15:09:01.896311 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896244 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121eec40-f77b-487d-aad2-2de8184a84b4" containerName="node" Sep 18 15:09:01.896311 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896251 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="121eec40-f77b-487d-aad2-2de8184a84b4" containerName="node" Sep 18 15:09:01.896494 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896356 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="121eec40-f77b-487d-aad2-2de8184a84b4" containerName="node" Sep 18 15:09:01.896494 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.896370 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="81eae9bc-7b25-4a33-8bbf-0f6164247a41" containerName="node" Sep 18 15:09:01.916309 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.916265 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:09:01.969857 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.969826 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6"] Sep 18 15:09:01.970013 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.969928 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:01.972485 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.972461 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"openshift-service-ca.crt\"" Sep 18 15:09:01.972485 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.972472 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"kube-root-ca.crt\"" Sep 18 15:09:01.972657 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:01.972474 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"default-dockercfg-rsc62\"" Sep 18 15:09:02.041975 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:02.041935 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qc9\" (UniqueName: \"kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9\") pod \"progression-disabled-node-0-0-gvtf6\" (UID: \"ef7a6768-85df-472a-9481-37240c20bf41\") " pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:02.143010 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:02.142972 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qc9\" (UniqueName: \"kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9\") pod \"progression-disabled-node-0-0-gvtf6\" (UID: \"ef7a6768-85df-472a-9481-37240c20bf41\") " pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:02.151160 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:02.151095 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qc9\" (UniqueName: \"kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9\") pod \"progression-disabled-node-0-0-gvtf6\" (UID: \"ef7a6768-85df-472a-9481-37240c20bf41\") " pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:02.279812 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:02.279774 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:02.560772 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:02.560748 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6"] Sep 18 15:09:02.563376 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:09:02.563349 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7a6768_85df_472a_9481_37240c20bf41.slice/crio-a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0 WatchSource:0}: Error finding container a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0: Status 404 returned error can't find the container with id a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0 Sep 18 15:09:03.564631 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:03.564595 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" event={"ID":"ef7a6768-85df-472a-9481-37240c20bf41","Type":"ContainerStarted","Data":"eef2c397457f0765a05c6a53f79f7856e9ecacd61eeb8ace715dc0df0053cccc"} Sep 18 15:09:03.565057 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:03.564653 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" event={"ID":"ef7a6768-85df-472a-9481-37240c20bf41","Type":"ContainerStarted","Data":"a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0"} Sep 18 15:09:03.581074 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:03.581014 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" podStartSLOduration=2.5809945770000002 podStartE2EDuration="2.580994577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:09:03.579711976 +0000 UTC m=+1105.588076377" watchObservedRunningTime="2026-09-18 15:09:03.580994577 +0000 UTC m=+1105.589358968" Sep 18 15:09:24.659848 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:24.659811 2587 generic.go:356] "Generic (PLEG): container finished" podID="ef7a6768-85df-472a-9481-37240c20bf41" containerID="eef2c397457f0765a05c6a53f79f7856e9ecacd61eeb8ace715dc0df0053cccc" exitCode=0 Sep 18 15:09:24.660271 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:24.659882 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" event={"ID":"ef7a6768-85df-472a-9481-37240c20bf41","Type":"ContainerDied","Data":"eef2c397457f0765a05c6a53f79f7856e9ecacd61eeb8ace715dc0df0053cccc"} Sep 18 15:09:25.794179 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:25.794157 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:25.832718 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:25.832691 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8qc9\" (UniqueName: \"kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9\") pod \"ef7a6768-85df-472a-9481-37240c20bf41\" (UID: \"ef7a6768-85df-472a-9481-37240c20bf41\") " Sep 18 15:09:25.834665 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:25.834640 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9" (OuterVolumeSpecName: "kube-api-access-k8qc9") pod "ef7a6768-85df-472a-9481-37240c20bf41" (UID: "ef7a6768-85df-472a-9481-37240c20bf41"). InnerVolumeSpecName "kube-api-access-k8qc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:09:25.933659 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:25.933577 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8qc9\" (UniqueName: \"kubernetes.io/projected/ef7a6768-85df-472a-9481-37240c20bf41-kube-api-access-k8qc9\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:09:26.670146 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:26.670120 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" Sep 18 15:09:26.670146 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:26.670131 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6" event={"ID":"ef7a6768-85df-472a-9481-37240c20bf41","Type":"ContainerDied","Data":"a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0"} Sep 18 15:09:26.670361 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:26.670179 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a78eed499964310b3b9adf7491fbf294ef5ac34c528307662eea791fd4f449d0" Sep 18 15:09:36.948899 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.948866 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg"] Sep 18 15:09:36.949278 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.949179 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7a6768-85df-472a-9481-37240c20bf41" containerName="node" Sep 18 15:09:36.949278 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.949189 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7a6768-85df-472a-9481-37240c20bf41" containerName="node" Sep 18 15:09:36.949278 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.949251 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7a6768-85df-472a-9481-37240c20bf41" containerName="node" Sep 18 15:09:36.951298 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.951283 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:09:36.953618 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.953592 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"openshift-service-ca.crt\"" Sep 18 15:09:36.953784 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.953638 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"kube-root-ca.crt\"" Sep 18 15:09:36.953784 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.953672 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"default-dockercfg-rsc62\"" Sep 18 15:09:36.962272 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:36.962249 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg"] Sep 18 15:09:37.020259 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.020226 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh89d\" (UniqueName: \"kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d\") pod \"progression-invalid-node-0-0-nb4rg\" (UID: \"93cb088c-76fb-41f3-a6f7-091a7b3c42a5\") " pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:09:37.041772 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.041749 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:09:37.121395 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.121362 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh89d\" (UniqueName: \"kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d\") pod \"progression-invalid-node-0-0-nb4rg\" (UID: \"93cb088c-76fb-41f3-a6f7-091a7b3c42a5\") " pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:09:37.129012 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.128986 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh89d\" (UniqueName: \"kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d\") pod \"progression-invalid-node-0-0-nb4rg\" (UID: \"93cb088c-76fb-41f3-a6f7-091a7b3c42a5\") " pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:09:37.260543 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.260486 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:09:37.525610 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.525583 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg"] Sep 18 15:09:37.527660 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:09:37.527628 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cb088c_76fb_41f3_a6f7_091a7b3c42a5.slice/crio-9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792 WatchSource:0}: Error finding container 9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792: Status 404 returned error can't find the container with id 9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792 Sep 18 15:09:37.721631 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.721596 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" event={"ID":"93cb088c-76fb-41f3-a6f7-091a7b3c42a5","Type":"ContainerStarted","Data":"7253e7267766a60f3d35613776534d6c2207de550cb9a8b5ea2a3405dbc4cd0e"} Sep 18 15:09:37.721790 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.721651 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" event={"ID":"93cb088c-76fb-41f3-a6f7-091a7b3c42a5","Type":"ContainerStarted","Data":"9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792"} Sep 18 15:09:37.741839 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:37.741786 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" podStartSLOduration=1.7417708859999999 podStartE2EDuration="1.741770886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:09:37.740198013 +0000 UTC m=+1139.748562438" watchObservedRunningTime="2026-09-18 15:09:37.741770886 +0000 UTC m=+1139.750135276" Sep 18 15:09:51.976155 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:51.976121 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6"] Sep 18 15:09:51.978807 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:51.978785 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:09:51.981280 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:51.981255 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:09:51.990626 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:51.990603 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6"] Sep 18 15:09:52.152553 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.152525 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm6xx\" (UniqueName: \"kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx\") pod \"progression-custom-config-node-0-0-2gvz6\" (UID: \"b9c01d28-70fd-4747-aaa6-84c3c2302cd1\") " pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:09:52.253002 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.252921 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm6xx\" (UniqueName: \"kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx\") pod \"progression-custom-config-node-0-0-2gvz6\" (UID: \"b9c01d28-70fd-4747-aaa6-84c3c2302cd1\") " pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:09:52.261090 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.261060 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm6xx\" (UniqueName: \"kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx\") pod \"progression-custom-config-node-0-0-2gvz6\" (UID: \"b9c01d28-70fd-4747-aaa6-84c3c2302cd1\") " pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:09:52.289072 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.289049 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:09:52.554722 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.554697 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6"] Sep 18 15:09:52.556970 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:09:52.556945 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c01d28_70fd_4747_aaa6_84c3c2302cd1.slice/crio-afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da WatchSource:0}: Error finding container afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da: Status 404 returned error can't find the container with id afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da Sep 18 15:09:52.796401 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.796366 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" event={"ID":"b9c01d28-70fd-4747-aaa6-84c3c2302cd1","Type":"ContainerStarted","Data":"b8e65f127b67fd237d45af66318bc9b5e4033c1827d2c1a645c099e348aa64f4"} Sep 18 15:09:52.796569 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.796417 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" event={"ID":"b9c01d28-70fd-4747-aaa6-84c3c2302cd1","Type":"ContainerStarted","Data":"afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da"} Sep 18 15:09:52.818820 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:52.815716 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" podStartSLOduration=1.815696745 podStartE2EDuration="1.815696745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:09:52.811841286 +0000 UTC m=+1154.820205677" watchObservedRunningTime="2026-09-18 15:09:52.815696745 +0000 UTC m=+1154.824061136" Sep 18 15:09:54.024350 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.024303 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g"] Sep 18 15:09:54.026715 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.026691 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:09:54.030089 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.030068 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:09:54.035943 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.035920 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g"] Sep 18 15:09:54.168715 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.168683 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4zp\" (UniqueName: \"kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp\") pod \"progression-min-interval-node-0-0-zht4g\" (UID: \"ae5bffba-514e-4215-b892-fa6cbcbde027\") " pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:09:54.269808 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.269773 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4zp\" (UniqueName: \"kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp\") pod \"progression-min-interval-node-0-0-zht4g\" (UID: \"ae5bffba-514e-4215-b892-fa6cbcbde027\") " pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:09:54.279941 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.279877 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4zp\" (UniqueName: \"kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp\") pod \"progression-min-interval-node-0-0-zht4g\" (UID: \"ae5bffba-514e-4215-b892-fa6cbcbde027\") " pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:09:54.336924 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.336898 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:09:54.490833 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.490794 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:09:54.605979 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:09:54.605953 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5bffba_514e_4215_b892_fa6cbcbde027.slice/crio-27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7 WatchSource:0}: Error finding container 27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7: Status 404 returned error can't find the container with id 27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7 Sep 18 15:09:54.608140 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.608119 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g"] Sep 18 15:09:54.807009 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.806972 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" event={"ID":"ae5bffba-514e-4215-b892-fa6cbcbde027","Type":"ContainerStarted","Data":"47343652ea895a65747059fee86618786011b416bd003d8bc1c087112ed02084"} Sep 18 15:09:54.807148 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.807028 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" event={"ID":"ae5bffba-514e-4215-b892-fa6cbcbde027","Type":"ContainerStarted","Data":"27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7"} Sep 18 15:09:54.822276 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:54.822229 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" podStartSLOduration=0.822210174 podStartE2EDuration="822.210174ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:09:54.821431462 +0000 UTC m=+1156.829795876" watchObservedRunningTime="2026-09-18 15:09:54.822210174 +0000 UTC m=+1156.830574563" Sep 18 15:09:59.831810 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:59.831775 2587 generic.go:356] "Generic (PLEG): container finished" podID="93cb088c-76fb-41f3-a6f7-091a7b3c42a5" containerID="7253e7267766a60f3d35613776534d6c2207de550cb9a8b5ea2a3405dbc4cd0e" exitCode=0 Sep 18 15:09:59.832250 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:09:59.831849 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" event={"ID":"93cb088c-76fb-41f3-a6f7-091a7b3c42a5","Type":"ContainerDied","Data":"7253e7267766a60f3d35613776534d6c2207de550cb9a8b5ea2a3405dbc4cd0e"} Sep 18 15:10:00.962716 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:00.962692 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:10:01.129790 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.129669 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh89d\" (UniqueName: \"kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d\") pod \"93cb088c-76fb-41f3-a6f7-091a7b3c42a5\" (UID: \"93cb088c-76fb-41f3-a6f7-091a7b3c42a5\") " Sep 18 15:10:01.131763 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.131739 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d" (OuterVolumeSpecName: "kube-api-access-lh89d") pod "93cb088c-76fb-41f3-a6f7-091a7b3c42a5" (UID: "93cb088c-76fb-41f3-a6f7-091a7b3c42a5"). InnerVolumeSpecName "kube-api-access-lh89d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:10:01.230969 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.230936 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh89d\" (UniqueName: \"kubernetes.io/projected/93cb088c-76fb-41f3-a6f7-091a7b3c42a5-kube-api-access-lh89d\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:10:01.843074 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.843042 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" Sep 18 15:10:01.843243 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.843083 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg" event={"ID":"93cb088c-76fb-41f3-a6f7-091a7b3c42a5","Type":"ContainerDied","Data":"9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792"} Sep 18 15:10:01.843243 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:01.843128 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d3ede7af79acfbd88545ec0a9c92fc1000501c721f84ab17d62382905602792" Sep 18 15:10:14.903717 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:14.903678 2587 generic.go:356] "Generic (PLEG): container finished" podID="b9c01d28-70fd-4747-aaa6-84c3c2302cd1" containerID="b8e65f127b67fd237d45af66318bc9b5e4033c1827d2c1a645c099e348aa64f4" exitCode=0 Sep 18 15:10:14.904105 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:14.903726 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" event={"ID":"b9c01d28-70fd-4747-aaa6-84c3c2302cd1","Type":"ContainerDied","Data":"b8e65f127b67fd237d45af66318bc9b5e4033c1827d2c1a645c099e348aa64f4"} Sep 18 15:10:16.031651 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.031624 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:10:16.042983 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.042954 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm6xx\" (UniqueName: \"kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx\") pod \"b9c01d28-70fd-4747-aaa6-84c3c2302cd1\" (UID: \"b9c01d28-70fd-4747-aaa6-84c3c2302cd1\") " Sep 18 15:10:16.045174 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.045145 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx" (OuterVolumeSpecName: "kube-api-access-lm6xx") pod "b9c01d28-70fd-4747-aaa6-84c3c2302cd1" (UID: "b9c01d28-70fd-4747-aaa6-84c3c2302cd1"). InnerVolumeSpecName "kube-api-access-lm6xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:10:16.144100 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.144064 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm6xx\" (UniqueName: \"kubernetes.io/projected/b9c01d28-70fd-4747-aaa6-84c3c2302cd1-kube-api-access-lm6xx\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:10:16.914856 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.914820 2587 generic.go:356] "Generic (PLEG): container finished" podID="ae5bffba-514e-4215-b892-fa6cbcbde027" containerID="47343652ea895a65747059fee86618786011b416bd003d8bc1c087112ed02084" exitCode=0 Sep 18 15:10:16.915015 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.914892 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" event={"ID":"ae5bffba-514e-4215-b892-fa6cbcbde027","Type":"ContainerDied","Data":"47343652ea895a65747059fee86618786011b416bd003d8bc1c087112ed02084"} Sep 18 15:10:16.916405 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.916387 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" event={"ID":"b9c01d28-70fd-4747-aaa6-84c3c2302cd1","Type":"ContainerDied","Data":"afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da"} Sep 18 15:10:16.916536 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.916409 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6" Sep 18 15:10:16.916536 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:16.916420 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afd570b6c3982e2ad6f8a3ba2a8f7ef87770041e10fe6da24a140ee7dbf280da" Sep 18 15:10:18.048475 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.048449 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:10:18.161362 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.161329 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l4zp\" (UniqueName: \"kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp\") pod \"ae5bffba-514e-4215-b892-fa6cbcbde027\" (UID: \"ae5bffba-514e-4215-b892-fa6cbcbde027\") " Sep 18 15:10:18.163291 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.163269 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp" (OuterVolumeSpecName: "kube-api-access-9l4zp") pod "ae5bffba-514e-4215-b892-fa6cbcbde027" (UID: "ae5bffba-514e-4215-b892-fa6cbcbde027"). InnerVolumeSpecName "kube-api-access-9l4zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:10:18.262550 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.262463 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l4zp\" (UniqueName: \"kubernetes.io/projected/ae5bffba-514e-4215-b892-fa6cbcbde027-kube-api-access-9l4zp\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:10:18.929151 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.929124 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" Sep 18 15:10:18.929349 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.929122 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g" event={"ID":"ae5bffba-514e-4215-b892-fa6cbcbde027","Type":"ContainerDied","Data":"27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7"} Sep 18 15:10:18.929349 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:18.929238 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27674d5b4bc27a58b45def13888157d8db794cf9aa61d5c7c5cf3d645eb2d3d7" Sep 18 15:10:38.499858 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:38.499828 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:10:38.500385 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:38.500105 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:10:38.504894 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:38.504869 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:10:38.505010 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:38.504992 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:10:57.404714 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:10:57.404664 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:06.410242 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.410195 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:06.413856 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.413832 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5"] Sep 18 15:11:06.414179 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414167 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c01d28-70fd-4747-aaa6-84c3c2302cd1" containerName="node" Sep 18 15:11:06.414232 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414181 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c01d28-70fd-4747-aaa6-84c3c2302cd1" containerName="node" Sep 18 15:11:06.414232 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414195 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5bffba-514e-4215-b892-fa6cbcbde027" containerName="node" Sep 18 15:11:06.414232 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414202 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5bffba-514e-4215-b892-fa6cbcbde027" containerName="node" Sep 18 15:11:06.414232 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414217 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cb088c-76fb-41f3-a6f7-091a7b3c42a5" containerName="node" Sep 18 15:11:06.414232 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414222 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cb088c-76fb-41f3-a6f7-091a7b3c42a5" containerName="node" Sep 18 15:11:06.414407 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414275 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c01d28-70fd-4747-aaa6-84c3c2302cd1" containerName="node" Sep 18 15:11:06.414407 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414283 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5bffba-514e-4215-b892-fa6cbcbde027" containerName="node" Sep 18 15:11:06.414407 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.414292 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cb088c-76fb-41f3-a6f7-091a7b3c42a5" containerName="node" Sep 18 15:11:06.416299 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.416284 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:06.418462 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.418440 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"kube-root-ca.crt\"" Sep 18 15:11:06.418586 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.418441 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"default-dockercfg-rsc62\"" Sep 18 15:11:06.419269 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.419250 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l2zzx\"/\"openshift-service-ca.crt\"" Sep 18 15:11:06.427451 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.427429 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5"] Sep 18 15:11:06.568855 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.568807 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkm6\" (UniqueName: \"kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6\") pod \"progression-no-metrics-node-0-0-pgxf5\" (UID: \"4a806d7e-48c0-43b9-ad75-59034990cb59\") " pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:06.669497 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.669402 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkm6\" (UniqueName: \"kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6\") pod \"progression-no-metrics-node-0-0-pgxf5\" (UID: \"4a806d7e-48c0-43b9-ad75-59034990cb59\") " pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:06.678047 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.678018 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkm6\" (UniqueName: \"kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6\") pod \"progression-no-metrics-node-0-0-pgxf5\" (UID: \"4a806d7e-48c0-43b9-ad75-59034990cb59\") " pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:06.725646 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.725617 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:06.994242 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:06.994218 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5"] Sep 18 15:11:06.996272 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:11:06.996240 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a806d7e_48c0_43b9_ad75_59034990cb59.slice/crio-3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec WatchSource:0}: Error finding container 3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec: Status 404 returned error can't find the container with id 3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec Sep 18 15:11:07.166200 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:07.166165 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" event={"ID":"4a806d7e-48c0-43b9-ad75-59034990cb59","Type":"ContainerStarted","Data":"50f81dbc9f04b8ac902a47aff7dd4e38a3797ab4c68a2e20d45f06bd1ad0f129"} Sep 18 15:11:07.166414 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:07.166217 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" event={"ID":"4a806d7e-48c0-43b9-ad75-59034990cb59","Type":"ContainerStarted","Data":"3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec"} Sep 18 15:11:07.181993 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:07.181951 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" podStartSLOduration=1.18193546 podStartE2EDuration="1.18193546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:11:07.180861921 +0000 UTC m=+1229.189226337" watchObservedRunningTime="2026-09-18 15:11:07.18193546 +0000 UTC m=+1229.190299911" Sep 18 15:11:12.192550 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:12.192517 2587 generic.go:356] "Generic (PLEG): container finished" podID="4a806d7e-48c0-43b9-ad75-59034990cb59" containerID="50f81dbc9f04b8ac902a47aff7dd4e38a3797ab4c68a2e20d45f06bd1ad0f129" exitCode=0 Sep 18 15:11:12.192945 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:12.192592 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" event={"ID":"4a806d7e-48c0-43b9-ad75-59034990cb59","Type":"ContainerDied","Data":"50f81dbc9f04b8ac902a47aff7dd4e38a3797ab4c68a2e20d45f06bd1ad0f129"} Sep 18 15:11:13.327413 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:13.327390 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:13.426372 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:13.426333 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbkm6\" (UniqueName: \"kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6\") pod \"4a806d7e-48c0-43b9-ad75-59034990cb59\" (UID: \"4a806d7e-48c0-43b9-ad75-59034990cb59\") " Sep 18 15:11:13.428370 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:13.428347 2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6" (OuterVolumeSpecName: "kube-api-access-cbkm6") pod "4a806d7e-48c0-43b9-ad75-59034990cb59" (UID: "4a806d7e-48c0-43b9-ad75-59034990cb59"). InnerVolumeSpecName "kube-api-access-cbkm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:11:13.527564 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:13.527484 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbkm6\" (UniqueName: \"kubernetes.io/projected/4a806d7e-48c0-43b9-ad75-59034990cb59-kube-api-access-cbkm6\") on node \"ip-10-0-136-56.ec2.internal\" DevicePath \"\"" Sep 18 15:11:14.204429 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.204393 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" event={"ID":"4a806d7e-48c0-43b9-ad75-59034990cb59","Type":"ContainerDied","Data":"3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec"} Sep 18 15:11:14.204429 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.204437 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3891317ce13511b4a7a678147b7087217b1247a5aaf5ced5e57a91b0d23917ec" Sep 18 15:11:14.204636 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.204408 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5" Sep 18 15:11:14.564632 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.564550 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:14.883895 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.883823 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:14.938856 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:14.938824 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:19.487989 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.487950 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6"] Sep 18 15:11:19.491286 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.491258 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-custom-config-node-0-0-2gvz6"] Sep 18 15:11:19.497876 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.497852 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6"] Sep 18 15:11:19.501440 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.501417 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-disabled-node-0-0-gvtf6"] Sep 18 15:11:19.507546 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.507526 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v"] Sep 18 15:11:19.511220 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.511198 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-enabled-node-0-0-8b29v"] Sep 18 15:11:19.518265 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.518239 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg"] Sep 18 15:11:19.525118 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.525098 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-invalid-node-0-0-nb4rg"] Sep 18 15:11:19.540111 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.540080 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g"] Sep 18 15:11:19.547010 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.546988 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-min-interval-node-0-0-zht4g"] Sep 18 15:11:19.551459 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.551439 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5"] Sep 18 15:11:19.557923 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.557898 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l2zzx/progression-no-metrics-node-0-0-pgxf5"] Sep 18 15:11:19.914015 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.913983 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:19.963368 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:19.963333 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:20.288367 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.288272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:20.337548 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.337517 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:11:20.606375 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.606271 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="121eec40-f77b-487d-aad2-2de8184a84b4" path="/var/lib/kubelet/pods/121eec40-f77b-487d-aad2-2de8184a84b4/volumes" Sep 18 15:11:20.606835 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.606758 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a806d7e-48c0-43b9-ad75-59034990cb59" path="/var/lib/kubelet/pods/4a806d7e-48c0-43b9-ad75-59034990cb59/volumes" Sep 18 15:11:20.607118 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.607099 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93cb088c-76fb-41f3-a6f7-091a7b3c42a5" path="/var/lib/kubelet/pods/93cb088c-76fb-41f3-a6f7-091a7b3c42a5/volumes" Sep 18 15:11:20.607468 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.607449 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5bffba-514e-4215-b892-fa6cbcbde027" path="/var/lib/kubelet/pods/ae5bffba-514e-4215-b892-fa6cbcbde027/volumes" Sep 18 15:11:20.608108 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.608087 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c01d28-70fd-4747-aaa6-84c3c2302cd1" path="/var/lib/kubelet/pods/b9c01d28-70fd-4747-aaa6-84c3c2302cd1/volumes" Sep 18 15:11:20.608461 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:20.608444 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7a6768-85df-472a-9481-37240c20bf41" path="/var/lib/kubelet/pods/ef7a6768-85df-472a-9481-37240c20bf41/volumes" Sep 18 15:11:51.893376 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:11:51.893290 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:07.711772 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.711737 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:07.845722 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.845690 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knc85/must-gather-qxccg"] Sep 18 15:12:07.846028 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.846016 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a806d7e-48c0-43b9-ad75-59034990cb59" containerName="node" Sep 18 15:12:07.846077 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.846030 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a806d7e-48c0-43b9-ad75-59034990cb59" containerName="node" Sep 18 15:12:07.846112 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.846095 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a806d7e-48c0-43b9-ad75-59034990cb59" containerName="node" Sep 18 15:12:07.848638 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.848621 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.850671 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.850652 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knc85\"/\"kube-root-ca.crt\"" Sep 18 15:12:07.850797 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.850756 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-knc85\"/\"default-dockercfg-gs625\"" Sep 18 15:12:07.851489 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.851472 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knc85\"/\"openshift-service-ca.crt\"" Sep 18 15:12:07.857802 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.857773 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knc85/must-gather-qxccg"] Sep 18 15:12:07.861813 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.861763 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:07.888916 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.888894 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tj5h\" (UniqueName: \"kubernetes.io/projected/7380fac1-8d86-4b8e-84e0-f4be720549b2-kube-api-access-9tj5h\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.889035 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.888931 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7380fac1-8d86-4b8e-84e0-f4be720549b2-must-gather-output\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.923762 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.923737 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:07.989561 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.989487 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7380fac1-8d86-4b8e-84e0-f4be720549b2-must-gather-output\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.989679 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.989573 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tj5h\" (UniqueName: \"kubernetes.io/projected/7380fac1-8d86-4b8e-84e0-f4be720549b2-kube-api-access-9tj5h\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.989827 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.989807 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7380fac1-8d86-4b8e-84e0-f4be720549b2-must-gather-output\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:07.997175 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:07.997150 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tj5h\" (UniqueName: \"kubernetes.io/projected/7380fac1-8d86-4b8e-84e0-f4be720549b2-kube-api-access-9tj5h\") pod \"must-gather-qxccg\" (UID: \"7380fac1-8d86-4b8e-84e0-f4be720549b2\") " pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:08.158465 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:08.158431 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knc85/must-gather-qxccg" Sep 18 15:12:08.424408 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:08.424380 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knc85/must-gather-qxccg"] Sep 18 15:12:08.426857 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:12:08.426829 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7380fac1_8d86_4b8e_84e0_f4be720549b2.slice/crio-b8c9f41e64d5abc813a1071a91919d7e65e0f339d895c8035afc59146fb90b1f WatchSource:0}: Error finding container b8c9f41e64d5abc813a1071a91919d7e65e0f339d895c8035afc59146fb90b1f: Status 404 returned error can't find the container with id b8c9f41e64d5abc813a1071a91919d7e65e0f339d895c8035afc59146fb90b1f Sep 18 15:12:08.428807 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:08.428785 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 15:12:08.478099 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:08.478067 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knc85/must-gather-qxccg" event={"ID":"7380fac1-8d86-4b8e-84e0-f4be720549b2","Type":"ContainerStarted","Data":"b8c9f41e64d5abc813a1071a91919d7e65e0f339d895c8035afc59146fb90b1f"} Sep 18 15:12:09.488593 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:09.488512 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knc85/must-gather-qxccg" event={"ID":"7380fac1-8d86-4b8e-84e0-f4be720549b2","Type":"ContainerStarted","Data":"0e22cbe28a0837f190e8701db1131d1ed48c7066a089fb57a08e24aacb6329c6"} Sep 18 15:12:09.488593 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:09.488572 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knc85/must-gather-qxccg" event={"ID":"7380fac1-8d86-4b8e-84e0-f4be720549b2","Type":"ContainerStarted","Data":"623de2129b87de1d28225b23859b2939a60d474f8eb63f922f51d42110782a49"} Sep 18 15:12:09.503731 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:09.503672 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-knc85/must-gather-qxccg" podStartSLOduration=1.6933569290000001 podStartE2EDuration="2.503657925s" totalImagesPullingTime="810.300996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:12:09.502367837 +0000 UTC m=+1291.510732228" watchObservedRunningTime="2026-09-18 15:12:09.503657925 +0000 UTC m=+1291.512022318" Sep 18 15:12:10.601721 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:10.601686 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-chcx5_eb2c9653-03f6-4892-b12f-1aedfee9cf93/global-pull-secret-syncer/0.log" Sep 18 15:12:10.700615 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:10.700584 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" Sep 18 15:12:10.825678 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:10.825648 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-56.ec2.internal_1bb35ee79734ff1cf6984dd2bb703b59/haproxy/0.log" Sep 18 15:12:13.314787 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:13.314736 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:13.372913 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:13.372866 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46j7z_3a5f9012-4406-4848-ac62-d64e3024d752/konnectivity-agent/0.log" limit=1024 Sep 18 15:12:14.490036 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.489996 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-zlcqv_1521c3f2-8211-4e48-961b-d89280ce07e7/cluster-monitoring-operator/0.log" Sep 18 15:12:14.542164 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.542138 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9mnpv_668cd2df-11a4-4096-a682-c77f03cf2321/kube-state-metrics/0.log" Sep 18 15:12:14.568544 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.568513 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9mnpv_668cd2df-11a4-4096-a682-c77f03cf2321/kube-rbac-proxy-main/0.log" Sep 18 15:12:14.590519 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.590490 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9mnpv_668cd2df-11a4-4096-a682-c77f03cf2321/kube-rbac-proxy-self/0.log" Sep 18 15:12:14.664267 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.664233 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-9htjb_6543725c-90b8-4fbd-9bf5-0c37eb6e6363/monitoring-plugin/0.log" Sep 18 15:12:14.787686 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.787604 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvdxh_50ab2591-bd22-4f2a-baeb-7a2d3589db1e/node-exporter/0.log" Sep 18 15:12:14.821441 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.821412 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvdxh_50ab2591-bd22-4f2a-baeb-7a2d3589db1e/kube-rbac-proxy/0.log" Sep 18 15:12:14.845688 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.845664 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvdxh_50ab2591-bd22-4f2a-baeb-7a2d3589db1e/init-textfile/0.log" Sep 18 15:12:14.958307 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.958268 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7shs5_e0022f62-a2d7-496f-91c2-f7e6811aed1a/kube-rbac-proxy-main/0.log" Sep 18 15:12:14.981980 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:14.981953 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7shs5_e0022f62-a2d7-496f-91c2-f7e6811aed1a/kube-rbac-proxy-self/0.log" Sep 18 15:12:15.005981 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.005950 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-7shs5_e0022f62-a2d7-496f-91c2-f7e6811aed1a/openshift-state-metrics/0.log" Sep 18 15:12:15.043865 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.043764 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/prometheus/0.log" Sep 18 15:12:15.073604 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.073578 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/config-reloader/0.log" Sep 18 15:12:15.097243 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.097204 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/thanos-sidecar/0.log" Sep 18 15:12:15.129514 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.129482 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/kube-rbac-proxy-web/0.log" Sep 18 15:12:15.150498 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.150467 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/kube-rbac-proxy/0.log" Sep 18 15:12:15.179997 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.179954 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/kube-rbac-proxy-thanos/0.log" Sep 18 15:12:15.202282 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.202250 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_356cd1b4-8bf5-47e2-8d60-a8a61a5f59e6/init-config-reloader/0.log" Sep 18 15:12:15.280481 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.280448 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-zp4zb_302a2798-5551-4bcf-8470-0d70b4fcaba7/prometheus-operator-admission-webhook/0.log" Sep 18 15:12:15.314890 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.314795 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c887bf746-xr78p_1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4/telemeter-client/0.log" Sep 18 15:12:15.338141 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.338073 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c887bf746-xr78p_1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4/reload/0.log" Sep 18 15:12:15.363335 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.363283 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c887bf746-xr78p_1d1cfe37-fa9f-4d19-9ca7-23d9e7b159b4/kube-rbac-proxy/0.log" Sep 18 15:12:15.399630 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.399593 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/thanos-query/0.log" Sep 18 15:12:15.422618 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.422585 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/kube-rbac-proxy-web/0.log" Sep 18 15:12:15.444494 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.444462 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/kube-rbac-proxy/0.log" Sep 18 15:12:15.472810 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.472784 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/prom-label-proxy/0.log" Sep 18 15:12:15.507077 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.507047 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/kube-rbac-proxy-rules/0.log" Sep 18 15:12:15.536278 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:15.534838 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc875bccc-mwkwk_b1338d1b-7d37-4ed5-b7e9-b2c94c7fa284/kube-rbac-proxy-metrics/0.log" Sep 18 15:12:17.358417 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:17.358304 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/1.log" Sep 18 15:12:17.365605 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:17.365579 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xbs7l_4a736611-4489-4a74-9e67-f589498ba4d1/console-operator/2.log" Sep 18 15:12:17.799902 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:17.799874 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-69ftf_1fd78b54-16be-45ce-93b5-3227e6dc494b/download-server/0.log" Sep 18 15:12:18.311449 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.311402 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf"] Sep 18 15:12:18.317369 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.317307 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.323198 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.323167 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf"] Sep 18 15:12:18.388936 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.388893 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-proc\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.388936 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.388948 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-sys\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.389542 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.388974 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-lib-modules\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.389542 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.389056 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-podres\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.389542 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.389119 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxsj\" (UniqueName: \"kubernetes.io/projected/593ea90a-abcc-477a-99e3-613df0257ec6-kube-api-access-drxsj\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.489858 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.489815 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-podres\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.490178 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.490157 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxsj\" (UniqueName: \"kubernetes.io/projected/593ea90a-abcc-477a-99e3-613df0257ec6-kube-api-access-drxsj\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.490393 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.490375 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-proc\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.490531 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.490515 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-sys\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.490627 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.490614 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-lib-modules\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.490877 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.490858 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-lib-modules\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.491344 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.491306 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-proc\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.491526 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.491510 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-sys\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.491713 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.491698 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/593ea90a-abcc-477a-99e3-613df0257ec6-podres\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.499814 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.499760 2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxsj\" (UniqueName: \"kubernetes.io/projected/593ea90a-abcc-477a-99e3-613df0257ec6-kube-api-access-drxsj\") pod \"perf-node-gather-daemonset-tzlqf\" (UID: \"593ea90a-abcc-477a-99e3-613df0257ec6\") " pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.632216 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.632115 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:18.919686 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:18.919655 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf"] Sep 18 15:12:18.921273 ip-10-0-136-56 kubenswrapper[2587]: W0918 15:12:18.921243 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod593ea90a_abcc_477a_99e3_613df0257ec6.slice/crio-9acb9240765394b52260e8da9b7dd7ff68a37b3a135748db0529fc2b642a2837 WatchSource:0}: Error finding container 9acb9240765394b52260e8da9b7dd7ff68a37b3a135748db0529fc2b642a2837: Status 404 returned error can't find the container with id 9acb9240765394b52260e8da9b7dd7ff68a37b3a135748db0529fc2b642a2837 Sep 18 15:12:19.236213 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.236140 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2pfw_2eb8a7be-4451-4622-82bb-949093645a72/dns/0.log" Sep 18 15:12:19.256540 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.256512 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2pfw_2eb8a7be-4451-4622-82bb-949093645a72/kube-rbac-proxy/0.log" Sep 18 15:12:19.321540 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.321508 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7zsk_5062fc02-6bd1-4530-b7e3-60c8f9e36e9d/dns-node-resolver/0.log" Sep 18 15:12:19.556424 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.556306 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" event={"ID":"593ea90a-abcc-477a-99e3-613df0257ec6","Type":"ContainerStarted","Data":"2a3cf57c909d8df26f0d3f50b6cb47c095d6e4780842b9777d439d0dbfc04c69"} Sep 18 15:12:19.556894 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.556454 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" event={"ID":"593ea90a-abcc-477a-99e3-613df0257ec6","Type":"ContainerStarted","Data":"9acb9240765394b52260e8da9b7dd7ff68a37b3a135748db0529fc2b642a2837"} Sep 18 15:12:19.556894 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.556814 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:19.572609 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.572542 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" podStartSLOduration=1.5725164729999999 podStartE2EDuration="1.572516473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 15:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:12:19.570120482 +0000 UTC m=+1301.578484895" watchObservedRunningTime="2026-09-18 15:12:19.572516473 +0000 UTC m=+1301.580880878" Sep 18 15:12:19.735612 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:19.735583 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4h5lv_1d91dd8e-f7f5-46fb-b2ad-f547eb4ffc05/node-ca/0.log" Sep 18 15:12:20.732183 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:20.732152 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44m2n_5b006f29-2007-4d88-b121-bbc4025cb633/serve-healthcheck-canary/0.log" Sep 18 15:12:21.277612 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:21.277584 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6m4p_56117f5b-ac63-41db-ac5b-f8a816237389/kube-rbac-proxy/0.log" Sep 18 15:12:21.296873 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:21.296853 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6m4p_56117f5b-ac63-41db-ac5b-f8a816237389/exporter/0.log" Sep 18 15:12:21.316002 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:21.315983 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6m4p_56117f5b-ac63-41db-ac5b-f8a816237389/extractor/0.log" Sep 18 15:12:22.901249 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:22.901224 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-m8md6_95de76e5-d8c3-4996-ab8d-3fe10cf8ffaf/jobset-operator/0.log" Sep 18 15:12:25.573783 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:25.573757 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-knc85/perf-node-gather-daemonset-tzlqf" Sep 18 15:12:27.200772 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.200740 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/kube-multus-additional-cni-plugins/0.log" Sep 18 15:12:27.222712 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.222672 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/egress-router-binary-copy/0.log" Sep 18 15:12:27.243943 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.243913 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/cni-plugins/0.log" Sep 18 15:12:27.265839 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.265813 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/bond-cni-plugin/0.log" Sep 18 15:12:27.286351 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.286331 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/routeoverride-cni/0.log" Sep 18 15:12:27.311356 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.311329 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/whereabouts-cni-bincopy/0.log" Sep 18 15:12:27.336164 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.336088 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2pdnx_7602a24b-4d95-45b9-95c7-0a5e53d1b067/whereabouts-cni/0.log" Sep 18 15:12:27.793327 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.793285 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x8fb6_822d3b6a-db13-4af3-8e57-b7bb7cc592ad/kube-multus/0.log" Sep 18 15:12:27.911973 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.911900 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fmggv_c0273bfa-cbb5-4bca-94c5-e3cc4cb87251/network-metrics-daemon/0.log" Sep 18 15:12:27.933041 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:27.933012 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fmggv_c0273bfa-cbb5-4bca-94c5-e3cc4cb87251/kube-rbac-proxy/0.log" Sep 18 15:12:28.805154 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.805127 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-controller/0.log" Sep 18 15:12:28.822413 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.822388 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/0.log" Sep 18 15:12:28.822413 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.822401 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovn-acl-logging/1.log" Sep 18 15:12:28.841513 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.841484 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/kube-rbac-proxy-node/0.log" Sep 18 15:12:28.863673 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.863641 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 15:12:28.882777 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.882749 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/northd/0.log" Sep 18 15:12:28.908713 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.908682 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/nbdb/0.log" Sep 18 15:12:28.936069 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.936032 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/sbdb/0.log" Sep 18 15:12:28.988341 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:28.988300 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhw4t_147b5ed9-531a-4f52-8080-92272c0acd32/ovnkube-controller/0.log" Sep 18 15:12:30.127068 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:30.127000 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mfpqc_a645d280-cd21-4f2f-8ae6-3a23068c4b8d/network-check-target-container/0.log" Sep 18 15:12:31.038205 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:31.038177 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wdt7x_7e19b7bd-848c-4be0-b6c3-913c4ce03ec2/iptables-alerter/0.log" Sep 18 15:12:31.696121 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:31.696095 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sjfvg_93296853-4fd6-4d4f-9e02-ee4ec7428545/tuned/0.log" Sep 18 15:12:34.475450 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:34.475415 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-55f6fc7b86-nf58q_c40ff0ed-e31a-49fd-bcf3-9e4fd056c8ff/service-ca-controller/0.log" Sep 18 15:12:34.841444 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:34.841415 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jmxk4_f637132f-bf90-426e-aa11-645802b79e26/csi-driver/0.log" Sep 18 15:12:34.867976 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:34.867945 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jmxk4_f637132f-bf90-426e-aa11-645802b79e26/csi-node-driver-registrar/0.log" Sep 18 15:12:34.889028 ip-10-0-136-56 kubenswrapper[2587]: I0918 15:12:34.889005 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jmxk4_f637132f-bf90-426e-aa11-645802b79e26/csi-liveness-probe/0.log"