Sep 10 12:40:24.479552 ip-10-0-140-44 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 12:40:24.479568 ip-10-0-140-44 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 12:40:24.479577 ip-10-0-140-44 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 12:40:24.479894 ip-10-0-140-44 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 12:40:34.576659 ip-10-0-140-44 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 12:40:34.576677 ip-10-0-140-44 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4532192b54ea45d886777fe02ee1fc8f -- Sep 10 12:42:09.237048 ip-10-0-140-44 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:42:09.645640 ip-10-0-140-44 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:42:09.645640 ip-10-0-140-44 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:42:09.645640 ip-10-0-140-44 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:42:09.645640 ip-10-0-140-44 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:42:09.645640 ip-10-0-140-44 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:42:09.646542 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.646472 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:42:09.649490 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649474 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.649490 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649490 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649495 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649498 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649501 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649504 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649507 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649510 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649512 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649515 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649517 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649520 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649523 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649525 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649528 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649530 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649533 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649535 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649540 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649543 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.649581 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649546 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649549 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649556 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649558 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649561 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649564 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649566 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649569 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649571 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649574 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649576 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649578 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649581 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649584 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649587 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649590 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649593 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649595 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649598 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.650038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649601 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649604 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649606 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649609 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649611 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649614 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649616 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649620 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649622 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649625 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649627 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649631 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649634 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649637 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649641 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649644 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649647 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649650 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649652 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.650485 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649655 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649658 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649660 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649663 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649665 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649668 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649670 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649673 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649676 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649679 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649681 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649684 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649686 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649689 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649691 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649694 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649696 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649699 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649701 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649703 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.650940 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649706 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649709 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649711 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649714 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649716 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649718 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649721 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649725 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649728 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649731 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649733 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649736 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649738 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649741 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649743 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649746 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649748 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649751 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649753 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.651410 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649768 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.649772 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650407 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650413 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650416 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650419 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650421 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650424 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650426 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650429 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650431 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650434 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650437 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650440 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650442 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650446 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650449 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650451 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650454 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650456 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.651881 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650458 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650461 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650464 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650467 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650469 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650472 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650474 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650478 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650482 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650485 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650488 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650491 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650495 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650498 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650500 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650503 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650505 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650508 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650510 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.652359 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650513 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650515 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650517 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650520 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650522 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650525 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650527 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650530 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650532 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650535 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650538 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650540 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650542 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650545 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650548 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650550 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650552 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650555 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650558 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650561 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.652822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650563 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650565 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650568 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650570 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650573 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650575 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650578 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650580 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650583 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650586 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650588 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650591 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650593 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650596 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650598 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650600 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650603 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650607 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650610 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650613 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.653289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650616 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650618 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650628 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650630 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650634 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650638 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650640 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650643 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650646 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650648 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650651 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650653 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650656 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650658 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650660 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650663 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650666 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650668 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650672 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.653803 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650675 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650677 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.650680 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651045 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651050 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651053 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651056 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651058 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651061 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651064 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651066 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651069 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651071 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651074 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651076 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651079 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651081 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651084 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651087 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651090 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.654257 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651092 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651095 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651098 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651100 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651103 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651105 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651108 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651110 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651113 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651115 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651118 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651120 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651123 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651125 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651127 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651130 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651132 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651135 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651137 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651139 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.654721 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651142 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651144 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651147 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651149 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651152 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651154 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651156 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651159 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651162 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651165 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651169 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651171 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651174 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651176 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651179 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651183 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651186 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651189 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651191 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.655252 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651194 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651196 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651199 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651201 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651204 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651206 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651209 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651212 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651215 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651218 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651221 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651224 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651226 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651229 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651231 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651234 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651237 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651239 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651241 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651243 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.655705 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651246 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651250 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651254 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651257 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651260 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651262 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651265 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651267 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651270 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651272 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651274 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651277 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651279 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651282 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651284 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651286 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651289 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651291 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651294 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651296 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.656230 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651299 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651301 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.651304 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651373 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651411 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651418 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651423 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651427 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651430 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651434 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651438 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651441 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651444 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651449 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651452 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651457 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651460 2579 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651463 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651466 2579 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651468 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651471 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651476 2579 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651478 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651481 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:42:09.656693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651484 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651487 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651491 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651494 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651497 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651500 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651503 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651505 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651508 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651511 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651514 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651518 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651528 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651532 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651535 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651537 2579 flags.go:64] FLAG: --enable-server="true" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651540 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651544 2579 flags.go:64] FLAG: --event-burst="100" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651547 2579 flags.go:64] FLAG: --event-qps="50" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651550 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651553 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651557 2579 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651560 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651563 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651567 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:42:09.657254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651570 2579 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651573 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651576 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651578 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651581 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651584 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651587 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651590 2579 flags.go:64] FLAG: --feature-gates="" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651593 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651596 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651599 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651602 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651605 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651608 2579 flags.go:64] FLAG: --help="false" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651610 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651613 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651616 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651619 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651622 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651625 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651628 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651631 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651633 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:42:09.657854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651637 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651640 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651643 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651646 2579 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651649 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651653 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651656 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651658 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651662 2579 flags.go:64] FLAG: --lock-file="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651665 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651668 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651670 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651676 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651679 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651682 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651684 2579 flags.go:64] FLAG: --logging-format="text" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651687 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651690 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651693 2579 flags.go:64] FLAG: --manifest-url="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651696 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651700 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651702 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651706 2579 flags.go:64] FLAG: --max-pods="110" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651709 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651712 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:42:09.658499 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651715 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651717 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651720 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651723 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651726 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651732 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651735 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651739 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651742 2579 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651745 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651749 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651752 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651755 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651772 2579 flags.go:64] FLAG: --port="10250" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651776 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651779 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0acff3e69b983a85f" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651782 2579 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651786 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651788 2579 flags.go:64] FLAG: --register-node="true" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651791 2579 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651795 2579 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651798 2579 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651801 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651803 2579 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651812 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:42:09.659096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651815 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651818 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651820 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651823 2579 flags.go:64] FLAG: --runonce="false" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651826 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651829 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651831 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651834 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651837 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651840 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651843 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651846 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651849 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651852 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651855 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651858 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651861 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651864 2579 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651866 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651871 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651875 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651878 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651882 2579 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651885 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651887 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:42:09.659755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651891 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651894 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651897 2579 flags.go:64] FLAG: --v="2" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651900 2579 flags.go:64] FLAG: --version="false" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651904 2579 flags.go:64] FLAG: --vmodule="" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651908 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.651911 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652022 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652025 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652028 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652031 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652034 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652037 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652039 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652042 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652044 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652047 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652049 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652053 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652055 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652057 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.660373 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652061 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652064 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652066 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652068 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652071 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652073 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652077 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652081 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652085 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652088 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652091 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652094 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652097 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652100 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652103 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652105 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652108 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652111 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652114 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652116 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.660875 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652119 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652122 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652124 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652127 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652130 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652134 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652136 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652139 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652142 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652144 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652147 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652150 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652154 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652156 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652159 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652162 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652164 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652167 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652171 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.661353 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652173 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652176 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652178 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652181 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652183 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652186 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652189 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652191 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652193 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652196 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652198 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652201 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652203 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652206 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652208 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652211 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652214 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652217 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652220 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652222 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.661822 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652225 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652227 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652230 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652232 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652235 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652239 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652241 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652244 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652246 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652248 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652251 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652254 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652257 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652259 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652262 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652264 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652267 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652269 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652272 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652275 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.662291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652277 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652280 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652282 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652285 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652287 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.652290 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.652295 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.659371 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.659388 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.660162 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.660173 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660236 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660242 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660245 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660248 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.662764 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660250 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660254 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660257 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660259 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660263 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660265 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660268 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660271 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660273 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660276 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660279 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660281 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660284 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660287 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660289 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660291 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660294 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660296 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660299 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.663169 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660301 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660304 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660306 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660308 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660311 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660313 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660322 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660325 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660328 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660331 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660333 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660336 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660339 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660341 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660344 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660346 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660349 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660352 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660354 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660357 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.663631 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660359 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660362 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660364 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660367 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660369 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660372 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660374 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660377 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660379 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660382 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660385 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660388 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660390 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660393 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660395 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660399 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660403 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660405 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660409 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660418 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.664120 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660420 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660423 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660426 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660429 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660432 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660436 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660439 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660441 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660444 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660446 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660449 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660452 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660454 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660458 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660462 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660465 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660468 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660470 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660473 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660475 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.664591 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660478 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660481 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660483 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660486 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660488 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660491 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660494 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660496 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660499 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660502 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660505 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660507 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660515 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660518 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660520 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.665124 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660523 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.660528 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660668 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660673 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660676 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660679 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660681 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660684 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660687 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660690 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660693 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660696 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660699 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660702 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660705 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:42:09.665470 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660708 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660710 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660713 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660715 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660718 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660720 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660722 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660726 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660730 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660733 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660735 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660739 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660743 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660745 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660748 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660770 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660774 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660776 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660779 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:42:09.665850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660781 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660784 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660786 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660789 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660791 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660794 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660796 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660799 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660801 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660804 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660807 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660809 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660812 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660814 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660816 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660819 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660821 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660824 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660826 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:42:09.666291 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660828 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660831 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660833 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660836 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660840 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660843 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660846 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660849 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660852 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660855 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660863 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660866 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660869 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660871 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660874 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660876 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660879 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660881 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660884 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:42:09.666736 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660886 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660889 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660891 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660894 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660896 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660899 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660901 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660903 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660906 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660908 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660911 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660913 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660915 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660918 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660920 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660922 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660925 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660927 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660930 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660933 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:42:09.667185 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660935 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660938 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660940 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660942 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660950 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660953 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660955 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660957 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:09.660960 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.660964 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.661078 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.663496 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.664414 2579 server.go:1019] "Starting client certificate rotation" Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.664518 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:42:09.667658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.664550 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:42:09.669006 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.668912 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:42:09.671608 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.671588 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:42:09.680871 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.680853 2579 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:42:09.684981 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.684965 2579 log.go:25] "Validated CRI v1 image API" Sep 10 12:42:09.685750 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.685734 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:42:09.691663 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.691645 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e59e7f21-7c76-4a67-a7c4-d0e06198c6d0:/dev/nvme0n1p4 ff41ef2b-5d87-492c-981c-b2762f756b9a:/dev/nvme0n1p3] Sep 10 12:42:09.691723 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.691663 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:42:09.696590 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.696571 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:42:09.697583 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.697475 2579 manager.go:216] Machine: {Timestamp:2026-09-10 12:42:09.695338426 +0000 UTC m=+0.346302169 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197105 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d88896a72b06460784f2d304e734f SystemUUID:ec2d8889-6a72-b064-6078-4f2d304e734f BootID:4532192b-54ea-45d8-8677-7fe02ee1fc8f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:31:ad:88:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:31:ad:88:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:3d:4e:cb:9f:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:42:09.697583 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.697575 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:42:09.697737 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.697653 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:42:09.700532 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.700506 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:42:09.700677 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.700536 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:42:09.701266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.701256 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:42:09.701303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.701267 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:42:09.701303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.701275 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:42:09.701902 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.701893 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:42:09.703051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.703042 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:42:09.705815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.705805 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:42:09.705936 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.705926 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:42:09.705974 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.705956 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:42:09.706481 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.706465 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:42:09.706557 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.706488 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:42:09.706557 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.706498 2579 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:42:09.706557 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.706530 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:42:09.707014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.706999 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:42:09.707057 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.707023 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:42:09.710325 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.710311 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:42:09.712457 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.712444 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:42:09.712520 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.712472 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:42:09.713105 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713093 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713110 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713116 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713121 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713131 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713136 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713149 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:42:09.713155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713155 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:42:09.713344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713161 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:42:09.713344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713167 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:42:09.713344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713179 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:42:09.713344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713190 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:42:09.713937 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713929 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:42:09.713937 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.713937 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:42:09.716589 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.716570 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:42:09.716718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.716701 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:42:09.716774 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.716708 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:42:09.717282 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.717265 2579 server.go:1268] "Started kubelet" Sep 10 12:42:09.717385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.717323 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:42:09.717438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.717383 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:42:09.721774 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.721727 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:42:09.722583 ip-10-0-140-44 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:42:09.723381 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.723360 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:42:09.725460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.724281 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:42:09.726858 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.726836 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:42:09.728042 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.728025 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:42:09.728633 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.728620 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:42:09.728720 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.728704 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:09.729177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729151 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:42:09.729177 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.728083 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-44.ec2.internal.18d3f6283f4b4016 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-44.ec2.internal,UID:ip-10-0-140-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-44.ec2.internal,},FirstTimestamp:2026-09-10 12:42:09.71723983 +0000 UTC m=+0.368203574,LastTimestamp:2026-09-10 12:42:09.71723983 +0000 UTC m=+0.368203574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-44.ec2.internal,}" Sep 10 12:42:09.729304 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729241 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:42:09.729304 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729257 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:42:09.729393 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729327 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:42:09.729393 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729336 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:42:09.729527 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729515 2579 factory.go:55] Registering systemd factory Sep 10 12:42:09.729562 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729530 2579 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:42:09.729710 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729699 2579 factory.go:153] Registering CRI-O factory Sep 10 12:42:09.729710 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729711 2579 factory.go:223] Registration of the crio container factory successfully Sep 10 12:42:09.729815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729771 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:42:09.729815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729788 2579 factory.go:103] Registering Raw factory Sep 10 12:42:09.729815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.729804 2579 manager.go:1196] Started watching for new ooms in manager Sep 10 12:42:09.730131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.730119 2579 manager.go:349] Starting recovery of all containers Sep 10 12:42:09.736810 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.736774 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 12:42:09.736948 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.736848 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 12:42:09.739021 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.738996 2579 manager.go:354] Recovery completed Sep 10 12:42:09.744105 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.743976 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.746122 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746103 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.746222 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746137 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.746222 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746152 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.746907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746892 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:42:09.746907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746905 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:42:09.747025 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746914 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.747025 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.746924 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:42:09.748253 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.748160 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-44.ec2.internal.18d3f6284103eef6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-44.ec2.internal,UID:ip-10-0-140-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-44.ec2.internal,},FirstTimestamp:2026-09-10 12:42:09.746120438 +0000 UTC m=+0.397084181,LastTimestamp:2026-09-10 12:42:09.746120438 +0000 UTC m=+0.397084181,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-44.ec2.internal,}" Sep 10 12:42:09.748514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.748486 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.748613 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.748520 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.748682 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.748629 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.748833 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.748563 2579 policy_none.go:49] "None policy: Start" Sep 10 12:42:09.748982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.748969 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:42:09.749079 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.749066 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:42:09.750371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.750355 2579 policy_none.go:47] "Start" Sep 10 12:42:09.751778 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.751744 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ztjl4" Sep 10 12:42:09.757524 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.757424 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-44.ec2.internal.18d3f62841044bcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-44.ec2.internal,UID:ip-10-0-140-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-44.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-44.ec2.internal,},FirstTimestamp:2026-09-10 12:42:09.746144203 +0000 UTC m=+0.397107946,LastTimestamp:2026-09-10 12:42:09.746144203 +0000 UTC m=+0.397107946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-44.ec2.internal,}" Sep 10 12:42:09.760978 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.760951 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ztjl4" Sep 10 12:42:09.763141 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.763004 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-44.ec2.internal.18d3f62841048117 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-44.ec2.internal,UID:ip-10-0-140-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-44.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-44.ec2.internal,},FirstTimestamp:2026-09-10 12:42:09.746157847 +0000 UTC m=+0.397121590,LastTimestamp:2026-09-10 12:42:09.746157847 +0000 UTC m=+0.397121590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-44.ec2.internal,}" Sep 10 12:42:09.776433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.776416 2579 manager.go:337] "Starting Device Plugin manager" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.776460 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.776475 2579 server.go:87] "Starting device plugin registration server" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.776850 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.776861 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.777014 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.777095 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.777109 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.777821 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:42:09.791907 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.777877 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:09.822024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.821981 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:42:09.823390 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.823369 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:42:09.823464 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.823416 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:42:09.823464 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.823443 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:42:09.823567 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.823546 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:42:09.826117 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.826101 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:09.877185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.877166 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.878059 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.878043 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.878131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.878072 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.878131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.878086 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.878131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.878110 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.887306 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.887286 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.887394 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.887309 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-44.ec2.internal\": node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:09.921137 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.921064 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:09.924602 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.924581 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal"] Sep 10 12:42:09.924698 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.924647 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.925646 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.925631 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.925726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.925656 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.925726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.925665 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.926839 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.926828 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.926949 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.926935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.926987 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.926963 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.927611 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927595 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.927701 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927624 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.927701 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927637 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.927701 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927595 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.927701 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927697 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.927859 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.927710 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.928805 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.928787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.928860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.928818 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:42:09.929510 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.929486 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:42:09.929569 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.929516 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:42:09.929569 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.929528 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:42:09.930579 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.930564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.930630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.930590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.930630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:09.930606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c85114910600898b0d381eadda58806-config\") pod \"kube-apiserver-proxy-ip-10-0-140-44.ec2.internal\" (UID: \"9c85114910600898b0d381eadda58806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.955379 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.955358 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-44.ec2.internal\" not found" node="ip-10-0-140-44.ec2.internal" Sep 10 12:42:09.959552 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:09.959539 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-44.ec2.internal\" not found" node="ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.022061 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.022040 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.030923 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.030901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.030992 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.030927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.030992 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.030943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c85114910600898b0d381eadda58806-config\") pod \"kube-apiserver-proxy-ip-10-0-140-44.ec2.internal\" (UID: \"9c85114910600898b0d381eadda58806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.031068 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.031006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.031068 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.031014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4da8392b4a78fe2d06fe53ba1b4f5e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal\" (UID: \"b4da8392b4a78fe2d06fe53ba1b4f5e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.031068 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.031014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c85114910600898b0d381eadda58806-config\") pod \"kube-apiserver-proxy-ip-10-0-140-44.ec2.internal\" (UID: \"9c85114910600898b0d381eadda58806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.122170 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.122139 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.222950 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.222868 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.258411 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.258389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.262227 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.262212 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.323701 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.323667 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.424206 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.424173 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.524745 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.524658 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.625391 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.625355 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.655771 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.655737 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:10.664492 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.664472 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:42:10.664623 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.664606 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:42:10.664667 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.664646 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:42:10.686154 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.686133 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:10.726193 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:10.726160 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-44.ec2.internal\" not found" Sep 10 12:42:10.747656 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.747632 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:10.763403 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.763366 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:37:10 +0000 UTC" deadline="2028-04-18 20:19:11.14567203 +0000 UTC" Sep 10 12:42:10.763519 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.763415 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14071h37m0.382276084s" Sep 10 12:42:10.829382 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.829298 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.847886 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.847863 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:42:10.849061 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.849047 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" Sep 10 12:42:10.866314 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.866287 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:42:10.985821 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:10.985780 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4da8392b4a78fe2d06fe53ba1b4f5e7.slice/crio-7ed994c5b7404c286366db74df177beb446d4cb9b85d9b84a9f8ba799465940b WatchSource:0}: Error finding container 7ed994c5b7404c286366db74df177beb446d4cb9b85d9b84a9f8ba799465940b: Status 404 returned error can't find the container with id 7ed994c5b7404c286366db74df177beb446d4cb9b85d9b84a9f8ba799465940b Sep 10 12:42:10.990140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:10.990118 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:42:11.004872 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:11.004809 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c85114910600898b0d381eadda58806.slice/crio-bff0bb47eb4f3e90e7901fb5e5079e74f46e19f02c737193e0796b7590e166e9 WatchSource:0}: Error finding container bff0bb47eb4f3e90e7901fb5e5079e74f46e19f02c737193e0796b7590e166e9: Status 404 returned error can't find the container with id bff0bb47eb4f3e90e7901fb5e5079e74f46e19f02c737193e0796b7590e166e9 Sep 10 12:42:11.708479 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.708432 2579 apiserver.go:52] "Watching apiserver" Sep 10 12:42:11.715649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.715623 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:42:11.717898 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.717873 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zblgg","openshift-network-diagnostics/network-check-target-ztjjj","kube-system/konnectivity-agent-d6hmr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal","openshift-multus/multus-additional-cni-plugins-95pwb","openshift-multus/multus-k2lb9","openshift-network-operator/iptables-alerter-bpd5r","openshift-ovn-kubernetes/ovnkube-node-jr9sq","kube-system/global-pull-secret-syncer-xts8q","kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846","openshift-cluster-node-tuning-operator/tuned-pmmwr","openshift-dns/node-resolver-z7ft7","openshift-image-registry/node-ca-64fmz"] Sep 10 12:42:11.719722 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.719694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.720855 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.720833 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:11.720949 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.720904 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:11.722323 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.722304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.722439 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.722307 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.722439 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.722371 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jwxqq\"" Sep 10 12:42:11.722649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.722633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.723941 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.723925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.724017 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.723980 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:11.724771 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.724751 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:42:11.724889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.724809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfq42\"" Sep 10 12:42:11.724978 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.724960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:42:11.725212 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.725196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.726236 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.726219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.727632 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.727236 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:42:11.727632 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.727340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.728618 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.728588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:42:11.728693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.728650 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:42:11.728801 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.728780 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:42:11.728999 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.728958 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xvv6d\"" Sep 10 12:42:11.729137 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.729118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:42:11.729293 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.729276 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.729388 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.729373 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8tzld\"" Sep 10 12:42:11.729532 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.729515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.731451 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.731426 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.731586 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.731570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s4sb8\"" Sep 10 12:42:11.731705 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.731685 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.731757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.731711 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:42:11.732076 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.732057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.733929 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.733910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.734017 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.733966 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:11.734484 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734469 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:42:11.734670 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734649 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.734762 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sz2fc\"" Sep 10 12:42:11.734977 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.735041 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:42:11.735041 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.734969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.735306 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.735289 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:42:11.735385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.735344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:42:11.736289 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.736273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.737293 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.737274 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.737398 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.737349 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:42:11.737649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.737511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zzktv\"" Sep 10 12:42:11.737649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.737560 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.737649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.737643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.738285 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.738270 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:42:11.738850 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.738833 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.738937 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.738887 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g84g8\"" Sep 10 12:42:11.739046 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.739031 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.739938 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.739923 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:42:11.740102 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w4whf\"" Sep 10 12:42:11.740389 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:42:11.740544 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-kubelet\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.740612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab3b3211-047a-430b-9f66-04387fc80940-iptables-alerter-script\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.740612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-var-lib-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-etc-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-netd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-config\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-kubelet\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-systemd-units\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-systemd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-log-socket\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.740934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-k8s-cni-cncf-io\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-etc-kubernetes\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.740987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-bin\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8xm\" (UniqueName: \"kubernetes.io/projected/c419e422-758a-4074-a324-9f0ce36bfe40-kube-api-access-ht8xm\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-netns\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2c6be37-ec79-4987-8aff-d33dc3c5e591-agent-certs\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-netns\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-system-cni-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.741163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-hostroot\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab3b3211-047a-430b-9f66-04387fc80940-host-slash\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2c6be37-ec79-4987-8aff-d33dc3c5e591-konnectivity-ca\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-system-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-multus-certs\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-slash\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/532efd3a-4395-4b80-914c-654988832fb5-hosts-file\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxtv\" (UniqueName: \"kubernetes.io/projected/b3ef9257-4689-460e-a6da-b9260ff46e84-kube-api-access-7bxtv\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7bl\" (UniqueName: \"kubernetes.io/projected/532efd3a-4395-4b80-914c-654988832fb5-kube-api-access-sg7bl\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cni-binary-copy\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-bin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-node-log\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-script-lib\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.741630 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-env-overrides\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c419e422-758a-4074-a324-9f0ce36bfe40-ovn-node-metrics-cert\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-socket-dir-parent\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-multus\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgt7\" (UniqueName: \"kubernetes.io/projected/4a17f100-ef6c-47c3-bdc6-771aeba8b608-kube-api-access-qdgt7\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5sv\" (UniqueName: \"kubernetes.io/projected/ab3b3211-047a-430b-9f66-04387fc80940-kube-api-access-zd5sv\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-conf-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-daemon-config\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cnibin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-ovn\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cnibin\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vw4w\" (UniqueName: \"kubernetes.io/projected/6795f2a4-e3c6-444e-bdb9-70aee7562da7-kube-api-access-8vw4w\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.742238 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.741917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532efd3a-4395-4b80-914c-654988832fb5-tmp-dir\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.749185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.749161 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:42:11.777509 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.777473 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pktzx" Sep 10 12:42:11.786286 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.786265 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pktzx" Sep 10 12:42:11.830164 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.830138 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:42:11.830671 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.830614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" event={"ID":"b4da8392b4a78fe2d06fe53ba1b4f5e7","Type":"ContainerStarted","Data":"7ed994c5b7404c286366db74df177beb446d4cb9b85d9b84a9f8ba799465940b"} Sep 10 12:42:11.832049 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.832021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" event={"ID":"9c85114910600898b0d381eadda58806","Type":"ContainerStarted","Data":"bff0bb47eb4f3e90e7901fb5e5079e74f46e19f02c737193e0796b7590e166e9"} Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxtv\" (UniqueName: \"kubernetes.io/projected/b3ef9257-4689-460e-a6da-b9260ff46e84-kube-api-access-7bxtv\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-dbus\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrv6\" (UniqueName: \"kubernetes.io/projected/8fba235e-96be-44a4-a7b9-c41f02aba92f-kube-api-access-pjrv6\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-registration-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7bl\" (UniqueName: \"kubernetes.io/projected/532efd3a-4395-4b80-914c-654988832fb5-kube-api-access-sg7bl\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cni-binary-copy\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-bin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-node-log\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-script-lib\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9nc\" (UniqueName: \"kubernetes.io/projected/edf08a7d-7299-4812-bce4-a01b714e21b0-kube-api-access-tm9nc\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-modprobe-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-lib-modules\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.843867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.842990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-env-overrides\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c419e422-758a-4074-a324-9f0ce36bfe40-ovn-node-metrics-cert\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-socket-dir-parent\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-multus\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgt7\" (UniqueName: \"kubernetes.io/projected/4a17f100-ef6c-47c3-bdc6-771aeba8b608-kube-api-access-qdgt7\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5sv\" (UniqueName: \"kubernetes.io/projected/ab3b3211-047a-430b-9f66-04387fc80940-kube-api-access-zd5sv\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-bin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-socket-dir-parent\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-conf-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-daemon-config\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-kubelet-config\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-cni-multus\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gml49\" (UniqueName: \"kubernetes.io/projected/58a3243b-c24b-411c-8abf-aa0a01bdce6b-kube-api-access-gml49\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.845355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cnibin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-kubernetes\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-conf\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-ovn\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cnibin\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vw4w\" (UniqueName: \"kubernetes.io/projected/6795f2a4-e3c6-444e-bdb9-70aee7562da7-kube-api-access-8vw4w\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532efd3a-4395-4b80-914c-654988832fb5-tmp-dir\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-kubelet\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab3b3211-047a-430b-9f66-04387fc80940-iptables-alerter-script\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-etc-selinux\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cni-binary-copy\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-var-lib-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-env-overrides\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-etc-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-netd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.846332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-config\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-run\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-kubelet\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844088 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-systemd-units\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-systemd\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-sys\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-systemd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-log-socket\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-node-log\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-k8s-cni-cncf-io\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-etc-kubernetes\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-device-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-script-lib\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-sys-fs\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-bin\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-cnibin\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8xm\" (UniqueName: \"kubernetes.io/projected/c419e422-758a-4074-a324-9f0ce36bfe40-kube-api-access-ht8xm\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-systemd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.843366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-conf-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-netns\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-kubelet\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edf08a7d-7299-4812-bce4-a01b714e21b0-host\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-cnibin\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844667 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-systemd-units\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysconfig\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.844762 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2c6be37-ec79-4987-8aff-d33dc3c5e591-agent-certs\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.847808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-netns\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.844875 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:12.344844798 +0000 UTC m=+2.995808554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-run-netns\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-system-cni-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c419e422-758a-4074-a324-9f0ce36bfe40-ovnkube-config\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-log-socket\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/532efd3a-4395-4b80-914c-654988832fb5-tmp-dir\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-k8s-cni-cncf-io\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845067 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-var-lib-kubelet\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845063 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-var-lib-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-bin\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-etc-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-etc-kubernetes\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab3b3211-047a-430b-9f66-04387fc80940-iptables-alerter-script\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-netns\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.848564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844579 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a17f100-ef6c-47c3-bdc6-771aeba8b608-multus-daemon-config\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.844942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-socket-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-var-lib-kubelet\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-hostroot\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-cni-netd\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-ovn\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-run-openvswitch\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab3b3211-047a-430b-9f66-04387fc80940-host-slash\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-tuned\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-hostroot\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-tmp\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab3b3211-047a-430b-9f66-04387fc80940-host-slash\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2c6be37-ec79-4987-8aff-d33dc3c5e591-konnectivity-ca\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-system-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6795f2a4-e3c6-444e-bdb9-70aee7562da7-system-cni-dir\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-multus-certs\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.849606 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845869 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-host-run-multus-certs\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/edf08a7d-7299-4812-bce4-a01b714e21b0-serviceca\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-host\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-slash\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/532efd3a-4395-4b80-914c-654988832fb5-hosts-file\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a17f100-ef6c-47c3-bdc6-771aeba8b608-system-cni-dir\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.845968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c419e422-758a-4074-a324-9f0ce36bfe40-host-slash\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.846038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/532efd3a-4395-4b80-914c-654988832fb5-hosts-file\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.846089 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6795f2a4-e3c6-444e-bdb9-70aee7562da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.846249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2c6be37-ec79-4987-8aff-d33dc3c5e591-konnectivity-ca\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.849781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2c6be37-ec79-4987-8aff-d33dc3c5e591-agent-certs\") pod \"konnectivity-agent-d6hmr\" (UID: \"a2c6be37-ec79-4987-8aff-d33dc3c5e591\") " pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:11.850367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.849862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c419e422-758a-4074-a324-9f0ce36bfe40-ovn-node-metrics-cert\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.862418 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.862388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7bl\" (UniqueName: \"kubernetes.io/projected/532efd3a-4395-4b80-914c-654988832fb5-kube-api-access-sg7bl\") pod \"node-resolver-z7ft7\" (UID: \"532efd3a-4395-4b80-914c-654988832fb5\") " pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:11.863667 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.863635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxtv\" (UniqueName: \"kubernetes.io/projected/b3ef9257-4689-460e-a6da-b9260ff46e84-kube-api-access-7bxtv\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:11.865594 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.865570 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:11.865698 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.865598 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:11.865698 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.865611 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:11.865698 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.865675 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:12.365655 +0000 UTC m=+3.016618732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:11.869038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.868987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5sv\" (UniqueName: \"kubernetes.io/projected/ab3b3211-047a-430b-9f66-04387fc80940-kube-api-access-zd5sv\") pod \"iptables-alerter-bpd5r\" (UID: \"ab3b3211-047a-430b-9f66-04387fc80940\") " pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:11.869759 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.869732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgt7\" (UniqueName: \"kubernetes.io/projected/4a17f100-ef6c-47c3-bdc6-771aeba8b608-kube-api-access-qdgt7\") pod \"multus-k2lb9\" (UID: \"4a17f100-ef6c-47c3-bdc6-771aeba8b608\") " pod="openshift-multus/multus-k2lb9" Sep 10 12:42:11.870193 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.870172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vw4w\" (UniqueName: \"kubernetes.io/projected/6795f2a4-e3c6-444e-bdb9-70aee7562da7-kube-api-access-8vw4w\") pod \"multus-additional-cni-plugins-95pwb\" (UID: \"6795f2a4-e3c6-444e-bdb9-70aee7562da7\") " pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:11.871043 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.871018 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8xm\" (UniqueName: \"kubernetes.io/projected/c419e422-758a-4074-a324-9f0ce36bfe40-kube-api-access-ht8xm\") pod \"ovnkube-node-jr9sq\" (UID: \"c419e422-758a-4074-a324-9f0ce36bfe40\") " pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:11.946494 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edf08a7d-7299-4812-bce4-a01b714e21b0-host\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.946494 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysconfig\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-socket-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edf08a7d-7299-4812-bce4-a01b714e21b0-host\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysconfig\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-var-lib-kubelet\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-tuned\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-tmp\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.946757 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-socket-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/edf08a7d-7299-4812-bce4-a01b714e21b0-serviceca\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-host\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-dbus\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrv6\" (UniqueName: \"kubernetes.io/projected/8fba235e-96be-44a4-a7b9-c41f02aba92f-kube-api-access-pjrv6\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-registration-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9nc\" (UniqueName: \"kubernetes.io/projected/edf08a7d-7299-4812-bce4-a01b714e21b0-kube-api-access-tm9nc\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-dbus\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-modprobe-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-lib-modules\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-host\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-kubelet-config\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.946827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-var-lib-kubelet\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gml49\" (UniqueName: \"kubernetes.io/projected/58a3243b-c24b-411c-8abf-aa0a01bdce6b-kube-api-access-gml49\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947139 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-kubernetes\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-conf\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-etc-selinux\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-lib-modules\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-run\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/edf08a7d-7299-4812-bce4-a01b714e21b0-serviceca\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-systemd\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947281 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-run\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-sys\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/963e74f7-61fd-44ba-865d-4b84000799b7-kubelet-config\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-device-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-sys-fs\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-sys-fs\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-modprobe-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-systemd\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.947616 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:11.947972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-sys\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:11.947684 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:12.447666351 +0000 UTC m=+3.098630098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-registration-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-etc-selinux\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-conf\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fba235e-96be-44a4-a7b9-c41f02aba92f-device-dir\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-kubernetes\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.948806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.947892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-sysctl-d\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.950907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.950827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-etc-tuned\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.951024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.950944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a3243b-c24b-411c-8abf-aa0a01bdce6b-tmp\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.957703 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.957676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrv6\" (UniqueName: \"kubernetes.io/projected/8fba235e-96be-44a4-a7b9-c41f02aba92f-kube-api-access-pjrv6\") pod \"aws-ebs-csi-driver-node-nw846\" (UID: \"8fba235e-96be-44a4-a7b9-c41f02aba92f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:11.958128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.958100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gml49\" (UniqueName: \"kubernetes.io/projected/58a3243b-c24b-411c-8abf-aa0a01bdce6b-kube-api-access-gml49\") pod \"tuned-pmmwr\" (UID: \"58a3243b-c24b-411c-8abf-aa0a01bdce6b\") " pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:11.958708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.958473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9nc\" (UniqueName: \"kubernetes.io/projected/edf08a7d-7299-4812-bce4-a01b714e21b0-kube-api-access-tm9nc\") pod \"node-ca-64fmz\" (UID: \"edf08a7d-7299-4812-bce4-a01b714e21b0\") " pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:11.963055 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:11.963032 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:12.033968 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.033924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7ft7" Sep 10 12:42:12.041781 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.041711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:12.048207 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.048178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95pwb" Sep 10 12:42:12.048944 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.048914 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532efd3a_4395_4b80_914c_654988832fb5.slice/crio-1d7ed45082fb46bf4a293102a891fd81c62ebec9c11a641ce6d5430c2db98216 WatchSource:0}: Error finding container 1d7ed45082fb46bf4a293102a891fd81c62ebec9c11a641ce6d5430c2db98216: Status 404 returned error can't find the container with id 1d7ed45082fb46bf4a293102a891fd81c62ebec9c11a641ce6d5430c2db98216 Sep 10 12:42:12.052450 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.052430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k2lb9" Sep 10 12:42:12.052522 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.052487 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c6be37_ec79_4987_8aff_d33dc3c5e591.slice/crio-a02646f4832ce63489872a35f3a121028f72605dd78fa2bd537e3d20ab38b2e7 WatchSource:0}: Error finding container a02646f4832ce63489872a35f3a121028f72605dd78fa2bd537e3d20ab38b2e7: Status 404 returned error can't find the container with id a02646f4832ce63489872a35f3a121028f72605dd78fa2bd537e3d20ab38b2e7 Sep 10 12:42:12.058757 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.058735 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6795f2a4_e3c6_444e_bdb9_70aee7562da7.slice/crio-65be040106d3e5d4f6b03c06ce97b3028bc668c391ec84295c30fcd7d65036bd WatchSource:0}: Error finding container 65be040106d3e5d4f6b03c06ce97b3028bc668c391ec84295c30fcd7d65036bd: Status 404 returned error can't find the container with id 65be040106d3e5d4f6b03c06ce97b3028bc668c391ec84295c30fcd7d65036bd Sep 10 12:42:12.060096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.059913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpd5r" Sep 10 12:42:12.065101 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.065010 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a17f100_ef6c_47c3_bdc6_771aeba8b608.slice/crio-7104cb7b2b2c6defe8a9335903eaa78da27ecec4de9d5bccab9eaf0ac1c941d3 WatchSource:0}: Error finding container 7104cb7b2b2c6defe8a9335903eaa78da27ecec4de9d5bccab9eaf0ac1c941d3: Status 404 returned error can't find the container with id 7104cb7b2b2c6defe8a9335903eaa78da27ecec4de9d5bccab9eaf0ac1c941d3 Sep 10 12:42:12.066208 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.066189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:12.071778 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.071749 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3b3211_047a_430b_9f66_04387fc80940.slice/crio-d586b0e2de0eb7213efd05cf82814feaadc43278e6288ab66813f55204669a3b WatchSource:0}: Error finding container d586b0e2de0eb7213efd05cf82814feaadc43278e6288ab66813f55204669a3b: Status 404 returned error can't find the container with id d586b0e2de0eb7213efd05cf82814feaadc43278e6288ab66813f55204669a3b Sep 10 12:42:12.072469 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.072448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64fmz" Sep 10 12:42:12.078850 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.078813 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc419e422_758a_4074_a324_9f0ce36bfe40.slice/crio-713ead2ef080deb7b3630e077b925ab0b2c4ad6ac82e0fe66bc8339bf6f170c0 WatchSource:0}: Error finding container 713ead2ef080deb7b3630e077b925ab0b2c4ad6ac82e0fe66bc8339bf6f170c0: Status 404 returned error can't find the container with id 713ead2ef080deb7b3630e077b925ab0b2c4ad6ac82e0fe66bc8339bf6f170c0 Sep 10 12:42:12.079136 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.079119 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" Sep 10 12:42:12.082690 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.082659 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf08a7d_7299_4812_bce4_a01b714e21b0.slice/crio-d58a4a3281474f9b78ff292baf0e4e54a2f40c64f6db56db5c154e8edae1a33d WatchSource:0}: Error finding container d58a4a3281474f9b78ff292baf0e4e54a2f40c64f6db56db5c154e8edae1a33d: Status 404 returned error can't find the container with id d58a4a3281474f9b78ff292baf0e4e54a2f40c64f6db56db5c154e8edae1a33d Sep 10 12:42:12.085283 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.085131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" Sep 10 12:42:12.092869 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.092622 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fba235e_96be_44a4_a7b9_c41f02aba92f.slice/crio-12101763e9093f88ba95d7b24820e990a50d65c2c311679a458146087543d10c WatchSource:0}: Error finding container 12101763e9093f88ba95d7b24820e990a50d65c2c311679a458146087543d10c: Status 404 returned error can't find the container with id 12101763e9093f88ba95d7b24820e990a50d65c2c311679a458146087543d10c Sep 10 12:42:12.096095 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:12.096078 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a3243b_c24b_411c_8abf_aa0a01bdce6b.slice/crio-2f0049ad14f221ee2e4f890019864cc12fa35ee641616fa9079e1565aaad30a1 WatchSource:0}: Error finding container 2f0049ad14f221ee2e4f890019864cc12fa35ee641616fa9079e1565aaad30a1: Status 404 returned error can't find the container with id 2f0049ad14f221ee2e4f890019864cc12fa35ee641616fa9079e1565aaad30a1 Sep 10 12:42:12.351203 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.351125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:12.351357 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.351262 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:12.351357 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.351326 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:13.351307959 +0000 UTC m=+4.002271692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:12.452135 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.452091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:12.452354 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.452175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:12.452354 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452241 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:12.452354 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:13.452313928 +0000 UTC m=+4.103277743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:12.452515 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452373 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:12.452515 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452398 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:12.452515 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452412 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:12.452515 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:12.452470 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:13.452455132 +0000 UTC m=+4.103418867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:12.788276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.788157 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:37:12 +0000 UTC" deadline="2028-02-09 04:52:09.849898903 +0000 UTC" Sep 10 12:42:12.788276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.788218 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12400h9m57.06168572s" Sep 10 12:42:12.835780 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.835722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerStarted","Data":"65be040106d3e5d4f6b03c06ce97b3028bc668c391ec84295c30fcd7d65036bd"} Sep 10 12:42:12.837390 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.837353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6hmr" event={"ID":"a2c6be37-ec79-4987-8aff-d33dc3c5e591","Type":"ContainerStarted","Data":"a02646f4832ce63489872a35f3a121028f72605dd78fa2bd537e3d20ab38b2e7"} Sep 10 12:42:12.838828 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.838793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" event={"ID":"58a3243b-c24b-411c-8abf-aa0a01bdce6b","Type":"ContainerStarted","Data":"2f0049ad14f221ee2e4f890019864cc12fa35ee641616fa9079e1565aaad30a1"} Sep 10 12:42:12.840427 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.840383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpd5r" event={"ID":"ab3b3211-047a-430b-9f66-04387fc80940","Type":"ContainerStarted","Data":"d586b0e2de0eb7213efd05cf82814feaadc43278e6288ab66813f55204669a3b"} Sep 10 12:42:12.842094 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.842065 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7ft7" event={"ID":"532efd3a-4395-4b80-914c-654988832fb5","Type":"ContainerStarted","Data":"1d7ed45082fb46bf4a293102a891fd81c62ebec9c11a641ce6d5430c2db98216"} Sep 10 12:42:12.843464 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.843437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" event={"ID":"8fba235e-96be-44a4-a7b9-c41f02aba92f","Type":"ContainerStarted","Data":"12101763e9093f88ba95d7b24820e990a50d65c2c311679a458146087543d10c"} Sep 10 12:42:12.844798 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.844752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64fmz" event={"ID":"edf08a7d-7299-4812-bce4-a01b714e21b0","Type":"ContainerStarted","Data":"d58a4a3281474f9b78ff292baf0e4e54a2f40c64f6db56db5c154e8edae1a33d"} Sep 10 12:42:12.846494 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.846469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"713ead2ef080deb7b3630e077b925ab0b2c4ad6ac82e0fe66bc8339bf6f170c0"} Sep 10 12:42:12.847908 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:12.847885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2lb9" event={"ID":"4a17f100-ef6c-47c3-bdc6-771aeba8b608","Type":"ContainerStarted","Data":"7104cb7b2b2c6defe8a9335903eaa78da27ecec4de9d5bccab9eaf0ac1c941d3"} Sep 10 12:42:13.359198 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.359060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:13.359406 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.359208 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:13.359406 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.359289 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:15.359272037 +0000 UTC m=+6.010235798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:13.460925 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.460893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:13.461120 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.460965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:13.461238 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461124 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:13.461238 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461147 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:13.461238 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461161 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:13.461238 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461123 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:13.461531 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461221 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:15.461200551 +0000 UTC m=+6.112164285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:13.461531 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.461298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:15.461280106 +0000 UTC m=+6.112243853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:13.735511 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.735473 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:42:13.788758 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.788708 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:37:12 +0000 UTC" deadline="2028-06-22 23:29:04.40110045 +0000 UTC" Sep 10 12:42:13.788758 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.788756 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15634h46m50.612350904s" Sep 10 12:42:13.824526 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.823829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:13.824526 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.823967 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:13.824526 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.824381 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:13.824526 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.824474 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:13.825173 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.825008 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:13.825173 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:13.825124 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:13.870897 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:13.869979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" event={"ID":"9c85114910600898b0d381eadda58806","Type":"ContainerStarted","Data":"1bdecaebc6effb7ef355ca8a31d3888db9dc45f54148556d51e1aa55362915bb"} Sep 10 12:42:14.888818 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:14.888713 2579 generic.go:356] "Generic (PLEG): container finished" podID="b4da8392b4a78fe2d06fe53ba1b4f5e7" containerID="d4dff39b06369139d2e9da586d104ee71994980964c57224ef6843215aad93c3" exitCode=0 Sep 10 12:42:14.889403 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:14.889299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" event={"ID":"b4da8392b4a78fe2d06fe53ba1b4f5e7","Type":"ContainerDied","Data":"d4dff39b06369139d2e9da586d104ee71994980964c57224ef6843215aad93c3"} Sep 10 12:42:14.917642 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:14.917565 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-44.ec2.internal" podStartSLOduration=3.9175416419999998 podStartE2EDuration="3.917541642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:13.902001397 +0000 UTC m=+4.552965150" watchObservedRunningTime="2026-09-10 12:42:14.917541642 +0000 UTC m=+5.568505398" Sep 10 12:42:15.379460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.378843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:15.379460 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.379022 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:15.379460 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.379097 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:19.379077257 +0000 UTC m=+10.030041003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:15.480116 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.480069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:15.480328 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.480156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:15.480531 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.480439 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:15.480531 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.480471 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:15.480531 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.480486 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:15.480718 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.480552 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:19.480530802 +0000 UTC m=+10.131494558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:15.481164 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.481071 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:15.481164 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.481125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:19.481110156 +0000 UTC m=+10.132073891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:15.824695 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.823919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:15.824695 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.824055 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:15.824695 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.824466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:15.824695 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.824574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:15.826758 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.825132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:15.826758 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:15.825238 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:15.898650 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:15.898600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" event={"ID":"b4da8392b4a78fe2d06fe53ba1b4f5e7","Type":"ContainerStarted","Data":"2e0bcf2e4142a84a6c5cb042b5135977fe21c03d6dccf157d7b246b1c067d6b1"} Sep 10 12:42:17.824961 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:17.824923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:17.825423 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:17.825071 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:17.825498 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:17.825488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:17.825632 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:17.825588 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:17.825734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:17.825719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:17.825832 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:17.825813 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:19.418298 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.418265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:19.418688 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.418419 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:19.418688 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.418497 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:27.418476486 +0000 UTC m=+18.069440238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:19.519625 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.519577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:19.519838 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.519652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:19.519838 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519786 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:19.519838 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519813 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:19.519838 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519837 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:19.520062 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519848 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:19.520062 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:27.519839162 +0000 UTC m=+18.170802895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:19.520062 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.519899 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:27.519883146 +0000 UTC m=+18.170846900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:19.825861 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.825794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:19.827330 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.826934 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:19.827330 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.826985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:19.827330 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.827105 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:19.827330 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:19.827200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:19.827330 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:19.827269 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:21.824458 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:21.824416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:21.824926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:21.824416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:21.824926 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:21.824540 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:21.824926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:21.824425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:21.824926 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:21.824662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:21.825356 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:21.825266 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:23.824542 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:23.824460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:23.825019 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:23.824465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:23.825019 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:23.824599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:23.825019 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:23.824591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:23.825019 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:23.824725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:23.825019 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:23.824847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:25.824509 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:25.824472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:25.825037 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:25.824472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:25.825037 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:25.824619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:25.825037 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:25.824472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:25.825037 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:25.824724 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:25.825037 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:25.824807 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:27.481281 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.481240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:27.481717 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.481397 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:27.481717 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.481463 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:43.481444183 +0000 UTC m=+34.132407930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:27.581695 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.581659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:27.581892 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.581727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:27.581892 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581841 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:27.581892 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581873 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:27.581892 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581887 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:27.581892 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581896 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:27.582138 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581916 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:43.581899904 +0000 UTC m=+34.232863634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:27.582138 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.581939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:43.581926428 +0000 UTC m=+34.232890160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:27.824165 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.824077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:27.824328 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.824086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:27.824328 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:27.824209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:27.824328 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.824206 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:27.824474 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.824324 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:27.824474 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:27.824415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:29.824416 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:29.824382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:29.824860 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:29.824474 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:29.824860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:29.824519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:29.824860 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:29.824595 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:29.824860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:29.824635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:29.824860 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:29.824711 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:30.933072 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.932848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" event={"ID":"8fba235e-96be-44a4-a7b9-c41f02aba92f","Type":"ContainerStarted","Data":"ede80322a515a6eda9af3716d61e6f5f82a75d9b0f895430fe1468557a38011d"} Sep 10 12:42:30.934475 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.934445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64fmz" event={"ID":"edf08a7d-7299-4812-bce4-a01b714e21b0","Type":"ContainerStarted","Data":"b77d4bce4dc5ca5c2274e2de12d9e21f8226ef89d4a1f9026c882999fe25273d"} Sep 10 12:42:30.937246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.937223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"c9af793b059204dde4e895e839487e259abf860581c879fd42932698b8f5674e"} Sep 10 12:42:30.937339 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.937279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"d6bb801eb51e442d8c77bc83c25e1feabe4f5995ce24ed52b74ae644bec26f8e"} Sep 10 12:42:30.937339 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.937323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"59bf33b76a1035226cd04ec6ab4771bc630ae981fc58b781610c8b5c1e2600d0"} Sep 10 12:42:30.937419 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.937367 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"b1397596052685941aa71b0927f5c610133b77ebc1eaaf0cce75870833322354"} Sep 10 12:42:30.937419 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.937399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"e68e3821f54abde20e1966871775b9eddd53910492ade72f5153e1f6b321874b"} Sep 10 12:42:30.938792 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.938710 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k2lb9" event={"ID":"4a17f100-ef6c-47c3-bdc6-771aeba8b608","Type":"ContainerStarted","Data":"b4bd019d62ca0fa39f8978756a840d628b533441b03d2fbfb89782fcc8ae960a"} Sep 10 12:42:30.940338 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.940315 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="76d2a8dad9bdce4442ab0b8e5488cc372dd2806609f18fa5dc22cb091c9f7900" exitCode=0 Sep 10 12:42:30.940430 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.940395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"76d2a8dad9bdce4442ab0b8e5488cc372dd2806609f18fa5dc22cb091c9f7900"} Sep 10 12:42:30.941920 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.941899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6hmr" event={"ID":"a2c6be37-ec79-4987-8aff-d33dc3c5e591","Type":"ContainerStarted","Data":"66b46b67b7a6ad2eeaa475a5da24f00c22b37feb336d3995eb7915d7b0e2e784"} Sep 10 12:42:30.943668 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.943643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" event={"ID":"58a3243b-c24b-411c-8abf-aa0a01bdce6b","Type":"ContainerStarted","Data":"68eed19cb067dfea54391e1980f40c101dc825f802284aca3bcd1a3378d1a826"} Sep 10 12:42:30.944943 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.944923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7ft7" event={"ID":"532efd3a-4395-4b80-914c-654988832fb5","Type":"ContainerStarted","Data":"04ae44c5948c77a6459c621bb578082f1655a964dd57eac54197cbed5c7b3114"} Sep 10 12:42:30.956653 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.956617 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-64fmz" podStartSLOduration=2.609648674 podStartE2EDuration="20.956605651s" totalImagesPullingTime="18.346956977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:30.956311371 +0000 UTC m=+21.607275125" watchObservedRunningTime="2026-09-10 12:42:30.956605651 +0000 UTC m=+21.607569403" Sep 10 12:42:30.956804 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:30.956784 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-44.ec2.internal" podStartSLOduration=19.956778816 podStartE2EDuration="19.956778816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:15.919060778 +0000 UTC m=+6.570024534" watchObservedRunningTime="2026-09-10 12:42:30.956778816 +0000 UTC m=+21.607742569" Sep 10 12:42:31.011683 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.011640 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d6hmr" podStartSLOduration=2.635016301 podStartE2EDuration="21.011626051s" totalImagesPullingTime="18.37660975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:31.011494107 +0000 UTC m=+21.662457863" watchObservedRunningTime="2026-09-10 12:42:31.011626051 +0000 UTC m=+21.662589803" Sep 10 12:42:31.039192 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.039134 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k2lb9" podStartSLOduration=2.614253193 podStartE2EDuration="21.039113446s" totalImagesPullingTime="18.424860253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:31.038999725 +0000 UTC m=+21.689963478" watchObservedRunningTime="2026-09-10 12:42:31.039113446 +0000 UTC m=+21.690077200" Sep 10 12:42:31.059412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.059353 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pmmwr" podStartSLOduration=2.726213349 podStartE2EDuration="21.059337088s" totalImagesPullingTime="18.333123739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:31.059038562 +0000 UTC m=+21.710002314" watchObservedRunningTime="2026-09-10 12:42:31.059337088 +0000 UTC m=+21.710300841" Sep 10 12:42:31.078215 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.078160 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z7ft7" podStartSLOduration=2.699154825 podStartE2EDuration="21.078146625s" totalImagesPullingTime="18.3789918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:31.078014731 +0000 UTC m=+21.728978484" watchObservedRunningTime="2026-09-10 12:42:31.078146625 +0000 UTC m=+21.729110377" Sep 10 12:42:31.823814 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.823785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:31.823959 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.823795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:31.823959 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:31.823893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:31.823959 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.823905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:31.824060 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:31.823986 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:31.824060 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:31.824038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:31.949974 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.949937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"de3178abcc3be5bd5704017c346cd9df3a5d46b854708047845fc1c0cb8d1190"} Sep 10 12:42:31.951294 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.951262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpd5r" event={"ID":"ab3b3211-047a-430b-9f66-04387fc80940","Type":"ContainerStarted","Data":"d6df22ea3191ba392da21f09b1aa2d7860eadf213842aacb957125b653aceb87"} Sep 10 12:42:31.972413 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:31.972369 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bpd5r" podStartSLOduration=3.612611288 podStartE2EDuration="21.972354501s" totalImagesPullingTime="18.359743213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:31.972180357 +0000 UTC m=+22.623144109" watchObservedRunningTime="2026-09-10 12:42:31.972354501 +0000 UTC m=+22.623318254" Sep 10 12:42:32.268295 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.268270 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:42:32.448982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.448951 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:32.449651 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.449625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:32.788285 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.787953 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:42:32.268287702Z","UUID":"ea508a86-5f9d-4715-a095-117d5031afe9","Handler":null,"Name":"","Endpoint":""} Sep 10 12:42:32.789829 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.789802 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:42:32.789962 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.789847 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:42:32.955092 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.955048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" event={"ID":"8fba235e-96be-44a4-a7b9-c41f02aba92f","Type":"ContainerStarted","Data":"c0a477e03a5b82c11e9291972abcc405b60dba5bde0394717fe09c1e18c3ce11"} Sep 10 12:42:32.955492 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.955335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:32.955851 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:32.955827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d6hmr" Sep 10 12:42:33.824119 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.824071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:33.824287 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:33.824199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:33.824287 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.824071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:33.824408 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:33.824296 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:33.824408 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.824071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:33.824408 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:33.824383 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:33.960331 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.960295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" event={"ID":"8fba235e-96be-44a4-a7b9-c41f02aba92f","Type":"ContainerStarted","Data":"1486483a32a211b5d93eb985be4e7cb33016c2a35f741e173d45f44e7084cf54"} Sep 10 12:42:33.966443 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.966404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"f2d1afde6602b334473561e26f617f2510cb31fbc50d0e31b817bc8e422eea83"} Sep 10 12:42:33.985222 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:33.985152 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nw846" podStartSLOduration=2.70101329 podStartE2EDuration="23.985130063s" totalImagesPullingTime="21.284116773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:33.984991478 +0000 UTC m=+24.635955233" watchObservedRunningTime="2026-09-10 12:42:33.985130063 +0000 UTC m=+24.636093816" Sep 10 12:42:35.824066 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.823839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:35.824536 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.823845 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:35.824536 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:35.824171 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:35.824536 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.823850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:35.824536 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:35.824238 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:35.824536 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:35.824334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:35.976351 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.976314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" event={"ID":"c419e422-758a-4074-a324-9f0ce36bfe40","Type":"ContainerStarted","Data":"f2102784ac1d72012ae1fed4475a947898ec5e0874213062d9df6251800c1a46"} Sep 10 12:42:35.976635 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.976613 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:35.976728 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.976675 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:35.993174 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:35.993146 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:36.082321 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:36.082212 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" podStartSLOduration=7.665210132 podStartE2EDuration="26.082187446s" totalImagesPullingTime="18.416977314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:36.0406702 +0000 UTC m=+26.691633954" watchObservedRunningTime="2026-09-10 12:42:36.082187446 +0000 UTC m=+26.733151204" Sep 10 12:42:36.979844 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:36.979223 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:36.997970 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:36.997941 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:42:37.722440 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.722409 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zblgg"] Sep 10 12:42:37.722622 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.722596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:37.723258 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:37.723207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:37.726958 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.726563 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xts8q"] Sep 10 12:42:37.726958 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.726701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztjjj"] Sep 10 12:42:37.726958 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.726847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:37.727364 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:37.727334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:37.727461 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.727368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:37.727510 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:37.727481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:37.983147 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.983066 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="211ff68c8cd88d318a3bb927db56aebf9bb7cb205e5a346aae38865345fe2cd0" exitCode=0 Sep 10 12:42:37.983731 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:37.983151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"211ff68c8cd88d318a3bb927db56aebf9bb7cb205e5a346aae38865345fe2cd0"} Sep 10 12:42:39.824480 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:39.824449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:39.825108 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:39.824539 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:39.825108 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:39.824602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:39.825108 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:39.824678 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:39.825108 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:39.824705 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:39.825108 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:39.824823 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:39.989263 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:39.989065 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="01cae15d7781f2a50d8d0ca34e50343d36825d9991b1bfbf09dfdd08fcd116bf" exitCode=0 Sep 10 12:42:39.989397 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:39.989144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"01cae15d7781f2a50d8d0ca34e50343d36825d9991b1bfbf09dfdd08fcd116bf"} Sep 10 12:42:41.823711 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:41.823678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:41.824203 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:41.823789 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xts8q" podUID="963e74f7-61fd-44ba-865d-4b84000799b7" Sep 10 12:42:41.824203 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:41.823679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:41.824203 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:41.823685 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:41.824203 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:41.823856 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztjjj" podUID="c08dc381-73fe-47b4-a561-0d22ff44daa6" Sep 10 12:42:41.824203 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:41.823964 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zblgg" podUID="b3ef9257-4689-460e-a6da-b9260ff46e84" Sep 10 12:42:41.996599 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:41.996566 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="8e65c7d32a1792adc16159651a33b9e44d312514ecafb618a56ed382f74de1ae" exitCode=0 Sep 10 12:42:41.996795 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:41.996649 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"8e65c7d32a1792adc16159651a33b9e44d312514ecafb618a56ed382f74de1ae"} Sep 10 12:42:43.123514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.123483 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-44.ec2.internal" event="NodeReady" Sep 10 12:42:43.124009 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.123656 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:42:43.165856 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.165411 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:42:43.181639 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.181601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.184700 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.184677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 12:42:43.184972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.184957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 12:42:43.185411 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.185396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 12:42:43.185666 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.185652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v9rjn\"" Sep 10 12:42:43.188813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.188673 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:42:43.189805 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.189785 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dr6f"] Sep 10 12:42:43.193143 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.193120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 12:42:43.211232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.211167 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pklwq"] Sep 10 12:42:43.211338 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.211307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.213567 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.213541 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:42:43.213815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.213801 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5cmb\"" Sep 10 12:42:43.213992 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.213977 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:42:43.237241 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.237203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pklwq"] Sep 10 12:42:43.237241 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.237236 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dr6f"] Sep 10 12:42:43.237461 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.237377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.240800 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.240743 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:42:43.240947 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.240830 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:42:43.240947 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.240886 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlntd\"" Sep 10 12:42:43.240947 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.240926 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:42:43.297097 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5f8\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwf28\" (UniqueName: \"kubernetes.io/projected/4770560d-99aa-41a2-bc7f-29534b80ed65-kube-api-access-zwf28\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.297270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4770560d-99aa-41a2-bc7f-29534b80ed65-tmp-dir\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.297270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297465 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297465 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297465 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297465 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.297465 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.297666 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4770560d-99aa-41a2-bc7f-29534b80ed65-config-volume\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.297666 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.297537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.306958 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.306928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:43.398674 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fc2p\" (UniqueName: \"kubernetes.io/projected/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-kube-api-access-4fc2p\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5f8\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwf28\" (UniqueName: \"kubernetes.io/projected/4770560d-99aa-41a2-bc7f-29534b80ed65-kube-api-access-zwf28\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4770560d-99aa-41a2-bc7f-29534b80ed65-tmp-dir\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.398889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4770560d-99aa-41a2-bc7f-29534b80ed65-config-volume\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-cert\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.398989 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.398999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.399006 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.399036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.399056 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.399062 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:43.8990426 +0000 UTC m=+34.550006351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.399135 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4770560d-99aa-41a2-bc7f-29534b80ed65-tmp-dir\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.399433 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.399160 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:43.899141976 +0000 UTC m=+34.550105711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:42:43.399964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.399544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4770560d-99aa-41a2-bc7f-29534b80ed65-config-volume\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.399964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.399604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.399964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.399851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.400177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.400143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.403942 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.403917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.404064 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.404030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.409623 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.409599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwf28\" (UniqueName: \"kubernetes.io/projected/4770560d-99aa-41a2-bc7f-29534b80ed65-kube-api-access-zwf28\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.410069 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.410048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.410940 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.410918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5f8\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.424177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.424142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:43.500275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.500169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-cert\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.500275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.500210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:43.500275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.500241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fc2p\" (UniqueName: \"kubernetes.io/projected/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-kube-api-access-4fc2p\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.500561 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.500339 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:43.500561 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.500405 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.500387287 +0000 UTC m=+66.151351017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:42:43.502729 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.502699 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-cert\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.512109 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.512077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fc2p\" (UniqueName: \"kubernetes.io/projected/8bdfb7d0-5c86-4ac1-b9a6-1c7697474991-kube-api-access-4fc2p\") pod \"ingress-canary-pklwq\" (UID: \"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991\") " pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.548144 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.548107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pklwq" Sep 10 12:42:43.600986 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.600948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:43.601168 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.601019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:43.601229 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601169 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:43.601229 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601185 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:42:43.601229 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601207 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:42:43.601229 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601216 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r78h5 for pod openshift-network-diagnostics/network-check-target-ztjjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:43.601401 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601237 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret podName:963e74f7-61fd-44ba-865d-4b84000799b7 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.601219424 +0000 UTC m=+66.252183169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret") pod "global-pull-secret-syncer-xts8q" (UID: "963e74f7-61fd-44ba-865d-4b84000799b7") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:42:43.601401 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.601299 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5 podName:c08dc381-73fe-47b4-a561-0d22ff44daa6 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.601289339 +0000 UTC m=+66.252253070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r78h5" (UniqueName: "kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5") pod "network-check-target-ztjjj" (UID: "c08dc381-73fe-47b4-a561-0d22ff44daa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:42:43.824612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.824530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:42:43.824807 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.824530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:42:43.824807 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.824530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:42:43.827318 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.827293 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:42:43.827442 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.827395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nmnkz\"" Sep 10 12:42:43.827504 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.827435 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:42:43.827504 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.827397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:42:43.828169 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.828153 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:42:43.838338 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.838316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27vkb\"" Sep 10 12:42:43.875863 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.875821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pklwq"] Sep 10 12:42:43.882266 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:42:43.882239 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdfb7d0_5c86_4ac1_b9a6_1c7697474991.slice/crio-ff6441518368180e2159fd4dc11c4d13725dc7ef3c12c0c34e44da9a9a069394 WatchSource:0}: Error finding container ff6441518368180e2159fd4dc11c4d13725dc7ef3c12c0c34e44da9a9a069394: Status 404 returned error can't find the container with id ff6441518368180e2159fd4dc11c4d13725dc7ef3c12c0c34e44da9a9a069394 Sep 10 12:42:43.903342 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.903312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:43.903489 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:43.903357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:43.903489 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.903464 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:43.903587 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.903525 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:44.90351128 +0000 UTC m=+35.554475010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:42:43.903587 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.903464 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:43.903587 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.903565 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:43.903719 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:43.903642 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:44.903623512 +0000 UTC m=+35.554587266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:44.002412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:44.002374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pklwq" event={"ID":"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991","Type":"ContainerStarted","Data":"ff6441518368180e2159fd4dc11c4d13725dc7ef3c12c0c34e44da9a9a069394"} Sep 10 12:42:44.383859 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:44.383802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:44.511032 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:44.510996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:44.910333 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:44.910139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:44.910512 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:44.910364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:44.910512 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:44.910316 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:44.910512 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:44.910412 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:44.910512 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:44.910478 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:46.910457181 +0000 UTC m=+37.561420914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:44.910705 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:44.910522 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:44.910705 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:44.910585 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:46.910567906 +0000 UTC m=+37.561531654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:42:45.379926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:45.379879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:45.574425 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:45.574394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:45.717438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:45.717397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:46.217707 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:46.217671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:46.927913 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:46.927871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:46.927943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:46.928059 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:46.928092 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:46.928150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:50.928134328 +0000 UTC m=+41.579098058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:46.928061 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:46.928359 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:46.928245 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:50.928223087 +0000 UTC m=+41.579186832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:42:47.863121 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:47.863082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:48.244944 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:48.244908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:48.343462 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:48.343426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:48.915963 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:48.915889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:49.016503 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.016471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:49.018538 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.018511 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="fa865d8f0239da17cdfcb4cb3822cb1c5059382165a0ff14013f7dcf730d5cd2" exitCode=0 Sep 10 12:42:49.018678 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.018604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"fa865d8f0239da17cdfcb4cb3822cb1c5059382165a0ff14013f7dcf730d5cd2"} Sep 10 12:42:49.020083 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.020061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pklwq" event={"ID":"8bdfb7d0-5c86-4ac1-b9a6-1c7697474991","Type":"ContainerStarted","Data":"bdb935b61932a7a0fd3d2e3583f149235d1a9995cdab667e5dc619147b38724c"} Sep 10 12:42:49.069696 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.069648 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pklwq" podStartSLOduration=1.529020435 podStartE2EDuration="6.069630553s" totalImagesPullingTime="4.540610118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:49.068586446 +0000 UTC m=+39.719550200" watchObservedRunningTime="2026-09-10 12:42:49.069630553 +0000 UTC m=+39.720594308" Sep 10 12:42:49.882658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.882622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:49.998112 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:49.998079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:50.026105 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:50.026071 2579 generic.go:356] "Generic (PLEG): container finished" podID="6795f2a4-e3c6-444e-bdb9-70aee7562da7" containerID="36c223a9ec8550a9c799fb4757d173cc1f909fbcabed46d967a0f3e289785d30" exitCode=0 Sep 10 12:42:50.026270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:50.026148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerDied","Data":"36c223a9ec8550a9c799fb4757d173cc1f909fbcabed46d967a0f3e289785d30"} Sep 10 12:42:50.963366 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:50.963332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:50.963378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:50.963484 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:50.963496 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:50.963505 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:50.963548 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:58.963534609 +0000 UTC m=+49.614498352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:42:50.963790 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:50.963561 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:42:58.963554787 +0000 UTC m=+49.614518517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:51.031820 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:51.031784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95pwb" event={"ID":"6795f2a4-e3c6-444e-bdb9-70aee7562da7","Type":"ContainerStarted","Data":"fa001062f3e160679777a53fad37ffef82cbf9d6875947d455613c1bf0e3cfab"} Sep 10 12:42:51.079857 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:51.079805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-95pwb" podStartSLOduration=10.840032708 podStartE2EDuration="41.079786913s" totalImagesPullingTime="30.239754205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:42:51.079187681 +0000 UTC m=+41.730151434" watchObservedRunningTime="2026-09-10 12:42:51.079786913 +0000 UTC m=+41.730750668" Sep 10 12:42:51.314445 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:51.314364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:51.468598 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:51.468559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:53.329503 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:53.329469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:53.471176 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:53.471147 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:57.749312 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:57.749274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:57.821384 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:57.821347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:42:59.020935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:59.020879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:42:59.020935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:42:59.020943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:42:59.021486 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:59.021039 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:42:59.021486 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:59.021059 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:42:59.021486 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:59.021085 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:42:59.021486 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:59.021119 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.021103497 +0000 UTC m=+65.672067240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:42:59.021486 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:42:59.021139 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.021125734 +0000 UTC m=+65.672089464 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:43:00.502957 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:00.502919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:00.725246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:00.725217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:00.924346 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:00.924263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:01.377638 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:01.377604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:01.495818 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:01.495790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:09.004571 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:09.004536 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jr9sq" Sep 10 12:43:09.263601 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:09.263512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:09.371720 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:09.371682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:10.096232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.096201 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht"] Sep 10 12:43:10.125298 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.125270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.128004 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.127978 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht"] Sep 10 12:43:10.130794 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.130735 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:43:10.132345 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.132131 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 12:43:10.132345 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.132306 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:43:10.132604 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.132421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 12:43:10.132908 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.132884 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-czmpr\"" Sep 10 12:43:10.200302 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.200267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.200302 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.200308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.200505 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.200357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vxxc\" (UniqueName: \"kubernetes.io/projected/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-kube-api-access-9vxxc\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.271717 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.271680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk"] Sep 10 12:43:10.273581 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.273565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.279929 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.279908 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 12:43:10.280053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.279909 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:43:10.280053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.279912 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 12:43:10.294358 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.294335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk"] Sep 10 12:43:10.300944 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.300922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vxxc\" (UniqueName: \"kubernetes.io/projected/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-kube-api-access-9vxxc\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.301040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.300971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.301040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.300997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.301040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.301012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lffl\" (UniqueName: \"kubernetes.io/projected/3fa3e33f-f657-49e8-b85a-0237981b0eac-kube-api-access-6lffl\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.301040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.301033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.301195 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.301121 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:10.301195 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.301181 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:10.801163365 +0000 UTC m=+61.452127109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:10.301582 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.301563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.307730 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.307711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n2c4n\"" Sep 10 12:43:10.314975 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.314955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vxxc\" (UniqueName: \"kubernetes.io/projected/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-kube-api-access-9vxxc\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.401573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.401485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.401573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.401521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lffl\" (UniqueName: \"kubernetes.io/projected/3fa3e33f-f657-49e8-b85a-0237981b0eac-kube-api-access-6lffl\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.401821 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.401634 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:10.401821 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.401707 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:10.901691432 +0000 UTC m=+61.552655175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:10.417877 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.417849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lffl\" (UniqueName: \"kubernetes.io/projected/3fa3e33f-f657-49e8-b85a-0237981b0eac-kube-api-access-6lffl\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.638126 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.638086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:10.804031 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.803997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:10.804208 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.804119 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:10.804208 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.804178 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:11.804160904 +0000 UTC m=+62.455124653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:10.904852 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.904813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:10.905021 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.904939 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:10.905021 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:10.904995 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:11.904981169 +0000 UTC m=+62.555944912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:10.912686 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:10.912646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:11.812046 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:11.812006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:11.812417 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:11.812168 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:11.812417 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:11.812237 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:13.812219651 +0000 UTC m=+64.463183393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:11.912775 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:11.912725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:11.913016 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:11.912949 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:11.913090 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:11.913026 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:13.913005504 +0000 UTC m=+64.563969236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:12.977714 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:12.977683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:13.072166 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:13.072132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:13.826930 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:13.826892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:13.827116 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:13.827050 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:13.827172 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:13.827121 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:17.827097209 +0000 UTC m=+68.478060941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:13.927736 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:13.927686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:13.927934 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:13.927878 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:13.927978 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:13.927950 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:17.927934162 +0000 UTC m=+68.578897892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:14.008047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.007994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:14.113300 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.113197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:14.803027 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.802990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:14.808331 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.808308 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5pd6c"] Sep 10 12:43:14.810646 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.810632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.834904 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.834872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.835014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.834911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.835014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.834993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-crio-socket\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.835105 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.835026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnj9\" (UniqueName: \"kubernetes.io/projected/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-api-access-pnnj9\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.835145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.835104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-data-volume\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.835586 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.835564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:43:14.836000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.835983 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:43:14.836495 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.836481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:43:14.837594 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.837578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:43:14.837800 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.837786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2srfc\"" Sep 10 12:43:14.854665 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.854634 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5pd6c"] Sep 10 12:43:14.935939 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.935903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-crio-socket\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.935948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnj9\" (UniqueName: \"kubernetes.io/projected/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-api-access-pnnj9\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.936003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-data-volume\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.936021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.936041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.936039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-crio-socket\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.936377 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:14.936130 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:43:14.936377 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:14.936192 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.436177705 +0000 UTC m=+66.087141438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : configmap "kube-rbac-proxy" not found Sep 10 12:43:14.936377 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:14.936132 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:14.936377 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:14.936272 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:15.436259374 +0000 UTC m=+66.087223106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:14.936532 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.936386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-data-volume\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:14.956131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:14.956095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnj9\" (UniqueName: \"kubernetes.io/projected/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-api-access-pnnj9\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:15.005246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.005189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:15.036710 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.036677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.036729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.036837 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.036856 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68fb5b7467-jdt4l: secret "image-registry-tls" not found Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.036884 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.036936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls podName:4770560d-99aa-41a2-bc7f-29534b80ed65 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:47.036920249 +0000 UTC m=+97.687883993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls") pod "dns-default-4dr6f" (UID: "4770560d-99aa-41a2-bc7f-29534b80ed65") : secret "dns-default-metrics-tls" not found Sep 10 12:43:15.037119 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.036955 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls podName:c35a5b3f-c675-47bc-af85-7c93582505c6 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:47.036948743 +0000 UTC m=+97.687912473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls") pod "image-registry-68fb5b7467-jdt4l" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6") : secret "image-registry-tls" not found Sep 10 12:43:15.439935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.439880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:15.439935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.439938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:15.440219 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.440004 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:43:15.440219 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.440070 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:16.440054508 +0000 UTC m=+67.091018238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : configmap "kube-rbac-proxy" not found Sep 10 12:43:15.440219 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.440114 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:15.440219 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.440180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:16.440163398 +0000 UTC m=+67.091127143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:15.540515 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.540480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:43:15.543275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.543257 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:43:15.550816 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.550792 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 12:43:15.550878 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:15.550857 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs podName:b3ef9257-4689-460e-a6da-b9260ff46e84 nodeName:}" failed. No retries permitted until 2026-09-10 12:44:19.550842631 +0000 UTC m=+130.201806375 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs") pod "network-metrics-daemon-zblgg" (UID: "b3ef9257-4689-460e-a6da-b9260ff46e84") : secret "metrics-daemon-secret" not found Sep 10 12:43:15.641919 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.641876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:43:15.642091 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.642017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:43:15.644616 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.644593 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:43:15.644737 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.644646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:43:15.655183 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.655161 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:43:15.655377 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.655358 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/963e74f7-61fd-44ba-865d-4b84000799b7-original-pull-secret\") pod \"global-pull-secret-syncer-xts8q\" (UID: \"963e74f7-61fd-44ba-865d-4b84000799b7\") " pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:43:15.665473 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.665453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78h5\" (UniqueName: \"kubernetes.io/projected/c08dc381-73fe-47b4-a561-0d22ff44daa6-kube-api-access-r78h5\") pod \"network-check-target-ztjjj\" (UID: \"c08dc381-73fe-47b4-a561-0d22ff44daa6\") " pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:43:15.939330 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.939295 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27vkb\"" Sep 10 12:43:15.946834 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.946808 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:43:15.948985 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:15.948968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xts8q" Sep 10 12:43:16.225183 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.225143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xts8q"] Sep 10 12:43:16.225872 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.225851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztjjj"] Sep 10 12:43:16.227352 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:16.227322 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08dc381_73fe_47b4_a561_0d22ff44daa6.slice/crio-c8a1f8ae9e90d08bc5d0275254ab58642a73a2fe2467d164b0ddb2f4a608bed3 WatchSource:0}: Error finding container c8a1f8ae9e90d08bc5d0275254ab58642a73a2fe2467d164b0ddb2f4a608bed3: Status 404 returned error can't find the container with id c8a1f8ae9e90d08bc5d0275254ab58642a73a2fe2467d164b0ddb2f4a608bed3 Sep 10 12:43:16.227805 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:16.227778 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963e74f7_61fd_44ba_865d_4b84000799b7.slice/crio-39243c0bf57cf92b7ae549870ef5a2639a0287e0c2c3c073fab07440d3d2fee1 WatchSource:0}: Error finding container 39243c0bf57cf92b7ae549870ef5a2639a0287e0c2c3c073fab07440d3d2fee1: Status 404 returned error can't find the container with id 39243c0bf57cf92b7ae549870ef5a2639a0287e0c2c3c073fab07440d3d2fee1 Sep 10 12:43:16.395678 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.395649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:16.448034 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.447982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:16.448034 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.448037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:16.448261 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:16.448117 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:43:16.448261 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:16.448144 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:16.448261 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:16.448193 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:18.448172923 +0000 UTC m=+69.099136679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : configmap "kube-rbac-proxy" not found Sep 10 12:43:16.448261 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:16.448214 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:18.44820336 +0000 UTC m=+69.099167097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:16.489361 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.489274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:16.654283 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.654247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:16.680884 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.680850 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp"] Sep 10 12:43:16.683366 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.683350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" Sep 10 12:43:16.686000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.685970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 12:43:16.686096 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.686022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vlgc4\"" Sep 10 12:43:16.686844 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.686826 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 12:43:16.703514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.701460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp"] Sep 10 12:43:16.749926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.749829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nn7\" (UniqueName: \"kubernetes.io/projected/f63198a3-6fec-47f9-b0f6-06693c2b436c-kube-api-access-k6nn7\") pod \"migrator-fdbb8fdff-nmgkp\" (UID: \"f63198a3-6fec-47f9-b0f6-06693c2b436c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" Sep 10 12:43:16.749926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.749867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:16.758050 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.758027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7ft7_532efd3a-4395-4b80-914c-654988832fb5/dns-node-resolver/0.log" Sep 10 12:43:16.851352 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.851314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nn7\" (UniqueName: \"kubernetes.io/projected/f63198a3-6fec-47f9-b0f6-06693c2b436c-kube-api-access-k6nn7\") pod \"migrator-fdbb8fdff-nmgkp\" (UID: \"f63198a3-6fec-47f9-b0f6-06693c2b436c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" Sep 10 12:43:16.854549 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.854515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:16.862053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.862023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nn7\" (UniqueName: \"kubernetes.io/projected/f63198a3-6fec-47f9-b0f6-06693c2b436c-kube-api-access-k6nn7\") pod \"migrator-fdbb8fdff-nmgkp\" (UID: \"f63198a3-6fec-47f9-b0f6-06693c2b436c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" Sep 10 12:43:16.992494 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:16.992219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" Sep 10 12:43:17.095110 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.095073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztjjj" event={"ID":"c08dc381-73fe-47b4-a561-0d22ff44daa6","Type":"ContainerStarted","Data":"c8a1f8ae9e90d08bc5d0275254ab58642a73a2fe2467d164b0ddb2f4a608bed3"} Sep 10 12:43:17.096403 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.096367 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xts8q" event={"ID":"963e74f7-61fd-44ba-865d-4b84000799b7","Type":"ContainerStarted","Data":"39243c0bf57cf92b7ae549870ef5a2639a0287e0c2c3c073fab07440d3d2fee1"} Sep 10 12:43:17.097196 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.097168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:17.281099 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.281011 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:17.291185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.291158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp"] Sep 10 12:43:17.294289 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:17.294265 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63198a3_6fec_47f9_b0f6_06693c2b436c.slice/crio-05c6b8008b393a64dc2712d2e1434ec8433fee77ad9fed4ac8d2d44d32c73923 WatchSource:0}: Error finding container 05c6b8008b393a64dc2712d2e1434ec8433fee77ad9fed4ac8d2d44d32c73923: Status 404 returned error can't find the container with id 05c6b8008b393a64dc2712d2e1434ec8433fee77ad9fed4ac8d2d44d32c73923 Sep 10 12:43:17.369401 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.369364 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64fmz_edf08a7d-7299-4812-bce4-a01b714e21b0/node-ca/0.log" Sep 10 12:43:17.859346 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.859303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:17.859539 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:17.859504 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:17.859603 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:17.859594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:25.859570089 +0000 UTC m=+76.510533843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:17.960772 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:17.960719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:17.960945 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:17.960878 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:17.960991 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:17.960949 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:25.960933039 +0000 UTC m=+76.611896783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:18.100631 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.100589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" event={"ID":"f63198a3-6fec-47f9-b0f6-06693c2b436c","Type":"ContainerStarted","Data":"05c6b8008b393a64dc2712d2e1434ec8433fee77ad9fed4ac8d2d44d32c73923"} Sep 10 12:43:18.466445 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.466408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:18.466973 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.466462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:18.466973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:18.466523 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:43:18.466973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:18.466618 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:22.466594545 +0000 UTC m=+73.117558277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : configmap "kube-rbac-proxy" not found Sep 10 12:43:18.466973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:18.466634 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:18.466973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:18.466703 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:22.466690348 +0000 UTC m=+73.117654079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:18.570429 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.570395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pklwq_8bdfb7d0-5c86-4ac1-b9a6-1c7697474991/serve-healthcheck-canary/0.log" Sep 10 12:43:18.763506 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.763419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:18.953842 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:18.953799 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:20.107810 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:20.107748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztjjj" event={"ID":"c08dc381-73fe-47b4-a561-0d22ff44daa6","Type":"ContainerStarted","Data":"f13f7667fd93133c25e7920f30336def84b0dec4e2ea4939fba0765ebea31b79"} Sep 10 12:43:20.108276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:20.107859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:43:20.134708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:20.134648 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztjjj" podStartSLOduration=67.017426507 podStartE2EDuration="1m10.134623736s" totalImagesPullingTime="3.117197229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:20.134410671 +0000 UTC m=+70.785374424" watchObservedRunningTime="2026-09-10 12:43:20.134623736 +0000 UTC m=+70.785587490" Sep 10 12:43:20.276062 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:20.276031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:22.115115 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.115070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xts8q" event={"ID":"963e74f7-61fd-44ba-865d-4b84000799b7","Type":"ContainerStarted","Data":"cdc10fcf0d0c761a3962950b4119204a64d89b2d08acffca257f4ccdb17815ab"} Sep 10 12:43:22.116990 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.116967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" event={"ID":"f63198a3-6fec-47f9-b0f6-06693c2b436c","Type":"ContainerStarted","Data":"a148fff4e9f42f8ab0c6aad42138ffecb48a417480e0b66acc7dd9f53c5d4cc2"} Sep 10 12:43:22.117099 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.117007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" event={"ID":"f63198a3-6fec-47f9-b0f6-06693c2b436c","Type":"ContainerStarted","Data":"38ed23d58afbe6263b53a96f181c5d476b7ced044a0df1a98fc4717b780afc7d"} Sep 10 12:43:22.180007 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.179954 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xts8q" podStartSLOduration=66.840039271 podStartE2EDuration="1m12.179938116s" totalImagesPullingTime="5.339898845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:22.143307196 +0000 UTC m=+72.794270948" watchObservedRunningTime="2026-09-10 12:43:22.179938116 +0000 UTC m=+72.830901865" Sep 10 12:43:22.500230 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.500187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:22.500394 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:22.500280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:22.500394 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:22.500308 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:43:22.500394 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:22.500378 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:30.500358037 +0000 UTC m=+81.151321773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : configmap "kube-rbac-proxy" not found Sep 10 12:43:22.500498 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:22.500415 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:22.500498 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:22.500469 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:30.500456247 +0000 UTC m=+81.151419978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:24.304409 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:24.304372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:24.628090 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:24.628001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:24.799072 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:24.799036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:25.090335 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:25.090302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:25.926738 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:25.926703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:25.927159 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:25.926867 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:25.927159 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:25.926932 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls podName:ac68bd65-a2fd-44d9-95a8-c5b0f8417735 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:41.926916524 +0000 UTC m=+92.577880255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-wtvht" (UID: "ac68bd65-a2fd-44d9-95a8-c5b0f8417735") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:43:25.959103 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:25.959071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:26.027438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:26.027385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:26.027606 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:26.027531 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:43:26.027606 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:26.027594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls podName:3fa3e33f-f657-49e8-b85a-0237981b0eac nodeName:}" failed. No retries permitted until 2026-09-10 12:43:42.027577266 +0000 UTC m=+92.678541005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5hktk" (UID: "3fa3e33f-f657-49e8-b85a-0237981b0eac") : secret "samples-operator-tls" not found Sep 10 12:43:26.197359 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:26.197329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:26.697753 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:26.697723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:26.975288 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:26.975194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:27.353145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:27.353054 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:27.735324 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:27.735294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:27.898199 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:27.898168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:28.065569 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:28.065489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:28.343290 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:28.343200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:28.454312 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:28.454277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:28.733367 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:28.733333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:29.561936 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:29.561897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:30.079185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.079153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:30.309844 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.309813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:30.505443 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.505407 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:30.566461 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.566430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:30.566807 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.566468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:30.566807 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:30.566628 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:43:30.566807 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:30.566687 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls podName:b3cd3d55-cdda-48ff-bec5-44d8e84a3a53 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:46.566670374 +0000 UTC m=+97.217634106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pd6c" (UID: "b3cd3d55-cdda-48ff-bec5-44d8e84a3a53") : secret "insights-runtime-extractor-tls" not found Sep 10 12:43:30.567027 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.567007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:30.702476 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:30.702440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:31.363975 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:31.363939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:31.861401 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:31.861362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:32.122189 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:32.122046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:32.362651 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:32.362615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:32.990195 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:32.990160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:33.366194 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:33.366105 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:33.730500 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:33.730471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:33.993787 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:33.993675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:34.559704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:34.559669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:34.731371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:34.731335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:34.936908 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:34.936864 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:36.535153 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:36.535112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:36.697989 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:36.697953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:36.800581 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:36.800500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:36.945322 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:36.945290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:37.120666 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:37.120582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:37.386906 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:37.386814 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:37.498341 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:37.498308 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:38.153970 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:38.153943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:38.355507 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:38.355472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:38.535111 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:38.535074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:39.214748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:39.214710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:41.954699 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:41.954647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:41.956990 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:41.956969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac68bd65-a2fd-44d9-95a8-c5b0f8417735-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wtvht\" (UID: \"ac68bd65-a2fd-44d9-95a8-c5b0f8417735\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:42.055588 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.055534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:42.057845 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.057823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fa3e33f-f657-49e8-b85a-0237981b0eac-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5hktk\" (UID: \"3fa3e33f-f657-49e8-b85a-0237981b0eac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:42.081727 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.081688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" Sep 10 12:43:42.234926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.234834 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" Sep 10 12:43:42.361110 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.361054 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nmgkp" podStartSLOduration=22.085063614 podStartE2EDuration="26.361037328s" totalImagesPullingTime="4.275973714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:22.181529906 +0000 UTC m=+72.832493659" watchObservedRunningTime="2026-09-10 12:43:42.361037328 +0000 UTC m=+93.012001109" Sep 10 12:43:42.361877 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.361855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk"] Sep 10 12:43:42.516067 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.515978 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht"] Sep 10 12:43:42.518799 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:42.518753 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac68bd65_a2fd_44d9_95a8_c5b0f8417735.slice/crio-68cc46d001946edbecebeeaf49e2ce8d079c815718b8ffe8550491c457f64752 WatchSource:0}: Error finding container 68cc46d001946edbecebeeaf49e2ce8d079c815718b8ffe8550491c457f64752: Status 404 returned error can't find the container with id 68cc46d001946edbecebeeaf49e2ce8d079c815718b8ffe8550491c457f64752 Sep 10 12:43:42.835441 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.835347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:42.969950 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:42.969922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:43.169953 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:43.169859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" event={"ID":"3fa3e33f-f657-49e8-b85a-0237981b0eac","Type":"ContainerStarted","Data":"cea76280dfae4ec8f11923a709226996009e83caa769d46fba282924933fce20"} Sep 10 12:43:43.171552 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:43.171490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" event={"ID":"ac68bd65-a2fd-44d9-95a8-c5b0f8417735","Type":"ContainerStarted","Data":"68cc46d001946edbecebeeaf49e2ce8d079c815718b8ffe8550491c457f64752"} Sep 10 12:43:44.261794 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.261744 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d"] Sep 10 12:43:44.267810 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.267783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.274309 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.273563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 12:43:44.274794 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.274609 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 12:43:44.276519 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.274609 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 12:43:44.280298 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.280279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 12:43:44.293007 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.292966 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d"] Sep 10 12:43:44.378452 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.378412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261ebc12-f1a0-4931-b002-762e0219d00d-tmp\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.378452 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.378457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5th\" (UniqueName: \"kubernetes.io/projected/261ebc12-f1a0-4931-b002-762e0219d00d-kube-api-access-jz5th\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.378691 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.378601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261ebc12-f1a0-4931-b002-762e0219d00d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.428581 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.428542 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:44.479259 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.479226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261ebc12-f1a0-4931-b002-762e0219d00d-tmp\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.479453 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.479268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5th\" (UniqueName: \"kubernetes.io/projected/261ebc12-f1a0-4931-b002-762e0219d00d-kube-api-access-jz5th\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.479453 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.479352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261ebc12-f1a0-4931-b002-762e0219d00d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.479718 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.479685 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261ebc12-f1a0-4931-b002-762e0219d00d-tmp\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.482287 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.482264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261ebc12-f1a0-4931-b002-762e0219d00d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.501920 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.501895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5th\" (UniqueName: \"kubernetes.io/projected/261ebc12-f1a0-4931-b002-762e0219d00d-kube-api-access-jz5th\") pod \"klusterlet-addon-workmgr-5689d689d7-7n66d\" (UID: \"261ebc12-f1a0-4931-b002-762e0219d00d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.568648 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.568576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:44.580145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.580118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:44.898573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:44.898481 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d"] Sep 10 12:43:44.901295 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:44.901264 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261ebc12_f1a0_4931_b002_762e0219d00d.slice/crio-3eaecce1eb2ca69c02379c64c2cdc6bc01151ce7a9013ca7c4218ccf1c09bf9a WatchSource:0}: Error finding container 3eaecce1eb2ca69c02379c64c2cdc6bc01151ce7a9013ca7c4218ccf1c09bf9a: Status 404 returned error can't find the container with id 3eaecce1eb2ca69c02379c64c2cdc6bc01151ce7a9013ca7c4218ccf1c09bf9a Sep 10 12:43:45.022213 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.022182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:45.108333 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.108304 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:45.179991 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.179958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" event={"ID":"3fa3e33f-f657-49e8-b85a-0237981b0eac","Type":"ContainerStarted","Data":"9e193bb6e3a506763efe2fb962e5810d17a3c3e8d34e2cd76fecfcf994ce7781"} Sep 10 12:43:45.180140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.180022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" event={"ID":"3fa3e33f-f657-49e8-b85a-0237981b0eac","Type":"ContainerStarted","Data":"77efae77c09e4a0a74b23523f207cba2dacaaf4ecb28ca54014b7ffa5980d9fb"} Sep 10 12:43:45.181276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.181244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" event={"ID":"261ebc12-f1a0-4931-b002-762e0219d00d","Type":"ContainerStarted","Data":"3eaecce1eb2ca69c02379c64c2cdc6bc01151ce7a9013ca7c4218ccf1c09bf9a"} Sep 10 12:43:45.182638 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.182611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" event={"ID":"ac68bd65-a2fd-44d9-95a8-c5b0f8417735","Type":"ContainerStarted","Data":"52c4aabee337493b4d714de152bf52662f079e078de0166aaeb0d725e7bdaa19"} Sep 10 12:43:45.228382 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.228352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:45.247871 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.247809 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5hktk" podStartSLOduration=33.012941227 podStartE2EDuration="35.247789442s" totalImagesPullingTime="2.234848215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:45.217505317 +0000 UTC m=+95.868469069" watchObservedRunningTime="2026-09-10 12:43:45.247789442 +0000 UTC m=+95.898753196" Sep 10 12:43:45.248191 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.248168 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wtvht" podStartSLOduration=33.137720059 podStartE2EDuration="35.248161244s" totalImagesPullingTime="2.110441185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:45.247639894 +0000 UTC m=+95.898603645" watchObservedRunningTime="2026-09-10 12:43:45.248161244 +0000 UTC m=+95.899124997" Sep 10 12:43:45.262424 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.262395 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk"] Sep 10 12:43:45.265605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.265590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:45.269232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.269212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 12:43:45.270034 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.270019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ttppn\"" Sep 10 12:43:45.350545 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.350514 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk"] Sep 10 12:43:45.387321 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.387280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nv6zk\" (UID: \"be1f8529-19fd-4704-89aa-712af17da834\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:45.488846 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.488774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nv6zk\" (UID: \"be1f8529-19fd-4704-89aa-712af17da834\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:45.488973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:45.488870 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:43:45.488973 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:45.488938 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates podName:be1f8529-19fd-4704-89aa-712af17da834 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:45.988920978 +0000 UTC m=+96.639884712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-nv6zk" (UID: "be1f8529-19fd-4704-89aa-712af17da834") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:43:45.659623 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.659589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:45.991565 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.991530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nv6zk\" (UID: \"be1f8529-19fd-4704-89aa-712af17da834\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:45.993720 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:45.993693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be1f8529-19fd-4704-89aa-712af17da834-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nv6zk\" (UID: \"be1f8529-19fd-4704-89aa-712af17da834\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:46.174319 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.174287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:46.392577 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.392494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:46.473093 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.473056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk"] Sep 10 12:43:46.479786 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:46.479750 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1f8529_19fd_4704_89aa_712af17da834.slice/crio-1a49848c9a8ff6ea27c172d80a6668be4a3cb01f70d70d85882717474f2a989d WatchSource:0}: Error finding container 1a49848c9a8ff6ea27c172d80a6668be4a3cb01f70d70d85882717474f2a989d: Status 404 returned error can't find the container with id 1a49848c9a8ff6ea27c172d80a6668be4a3cb01f70d70d85882717474f2a989d Sep 10 12:43:46.517616 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.517589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:46.596596 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.596574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:46.598822 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.598794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd3d55-cdda-48ff-bec5-44d8e84a3a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pd6c\" (UID: \"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53\") " pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:46.618768 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.618725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5pd6c" Sep 10 12:43:46.896590 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:46.896555 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5pd6c"] Sep 10 12:43:46.900094 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:46.900061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cd3d55_cdda_48ff_bec5_44d8e84a3a53.slice/crio-34f3247070cc12a4f887b65bf14a59d891cb7707f29c0124c10793133bfc2b78 WatchSource:0}: Error finding container 34f3247070cc12a4f887b65bf14a59d891cb7707f29c0124c10793133bfc2b78: Status 404 returned error can't find the container with id 34f3247070cc12a4f887b65bf14a59d891cb7707f29c0124c10793133bfc2b78 Sep 10 12:43:47.100929 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.100893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:43:47.101091 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.100944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:43:47.103468 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.103443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4770560d-99aa-41a2-bc7f-29534b80ed65-metrics-tls\") pod \"dns-default-4dr6f\" (UID: \"4770560d-99aa-41a2-bc7f-29534b80ed65\") " pod="openshift-dns/dns-default-4dr6f" Sep 10 12:43:47.103675 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.103654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"image-registry-68fb5b7467-jdt4l\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:43:47.122671 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.122650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5cmb\"" Sep 10 12:43:47.130182 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.130155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dr6f" Sep 10 12:43:47.191329 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.191255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" event={"ID":"be1f8529-19fd-4704-89aa-712af17da834","Type":"ContainerStarted","Data":"1a49848c9a8ff6ea27c172d80a6668be4a3cb01f70d70d85882717474f2a989d"} Sep 10 12:43:47.192929 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.192898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pd6c" event={"ID":"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53","Type":"ContainerStarted","Data":"cd4a16d2cebb363f9fe558ebebb48da4aa65f726a9431c468b0f411c9b8f1fee"} Sep 10 12:43:47.193045 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.192956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pd6c" event={"ID":"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53","Type":"ContainerStarted","Data":"34f3247070cc12a4f887b65bf14a59d891cb7707f29c0124c10793133bfc2b78"} Sep 10 12:43:47.395654 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.395620 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v9rjn\"" Sep 10 12:43:47.403053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.403026 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:43:47.407324 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.407298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dr6f"] Sep 10 12:43:47.547928 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.547858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:47.558905 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:47.558873 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4770560d_99aa_41a2_bc7f_29534b80ed65.slice/crio-9ded513870200f58e285fe584532e841f7ed17739beeff67038054ce22aaa211 WatchSource:0}: Error finding container 9ded513870200f58e285fe584532e841f7ed17739beeff67038054ce22aaa211: Status 404 returned error can't find the container with id 9ded513870200f58e285fe584532e841f7ed17739beeff67038054ce22aaa211 Sep 10 12:43:47.646288 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.646262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:47.835137 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:47.835070 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:43:47.840492 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:47.840465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35a5b3f_c675_47bc_af85_7c93582505c6.slice/crio-798aa86ebb43274155f99ea3836e00130f65760e9fa91b21d66aff75e2dab815 WatchSource:0}: Error finding container 798aa86ebb43274155f99ea3836e00130f65760e9fa91b21d66aff75e2dab815: Status 404 returned error can't find the container with id 798aa86ebb43274155f99ea3836e00130f65760e9fa91b21d66aff75e2dab815 Sep 10 12:43:48.076316 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.076276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:48.198502 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.198470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" event={"ID":"be1f8529-19fd-4704-89aa-712af17da834","Type":"ContainerStarted","Data":"07769b0c6222da306123852d1a9f47dfd9953a557b45792862a1e0cd6a98db6b"} Sep 10 12:43:48.198742 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.198610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:48.200376 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.200347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" event={"ID":"c35a5b3f-c675-47bc-af85-7c93582505c6","Type":"ContainerStarted","Data":"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d"} Sep 10 12:43:48.200491 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.200403 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:43:48.200491 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.200419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" event={"ID":"c35a5b3f-c675-47bc-af85-7c93582505c6","Type":"ContainerStarted","Data":"798aa86ebb43274155f99ea3836e00130f65760e9fa91b21d66aff75e2dab815"} Sep 10 12:43:48.201656 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.201630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr6f" event={"ID":"4770560d-99aa-41a2-bc7f-29534b80ed65","Type":"ContainerStarted","Data":"9ded513870200f58e285fe584532e841f7ed17739beeff67038054ce22aaa211"} Sep 10 12:43:48.203648 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.203625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pd6c" event={"ID":"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53","Type":"ContainerStarted","Data":"72cf577459b094d414e39c1ee248fd4e2f2826fc11be36b8aad9505f26fbdaf4"} Sep 10 12:43:48.203913 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.203891 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" Sep 10 12:43:48.206092 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.206072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:48.226449 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.226407 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nv6zk" podStartSLOduration=2.103055212 podStartE2EDuration="3.226391055s" totalImagesPullingTime="1.123335843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:48.226182295 +0000 UTC m=+98.877146048" watchObservedRunningTime="2026-09-10 12:43:48.226391055 +0000 UTC m=+98.877354807" Sep 10 12:43:48.266487 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:48.266416 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" podStartSLOduration=98.266393254 podStartE2EDuration="1m38.266393254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:48.265334398 +0000 UTC m=+98.916298151" watchObservedRunningTime="2026-09-10 12:43:48.266393254 +0000 UTC m=+98.917357010" Sep 10 12:43:49.273644 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.273600 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:49.351691 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.351657 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sdchx"] Sep 10 12:43:49.354662 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.354641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.359802 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.359741 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 12:43:49.360029 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.360002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f66zs\"" Sep 10 12:43:49.360160 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.360098 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 12:43:49.361250 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.361005 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:43:49.371245 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.371210 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sdchx"] Sep 10 12:43:49.380726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.380692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:49.520627 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.520595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.520849 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.520657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.520849 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.520779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.520849 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.520813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfq8\" (UniqueName: \"kubernetes.io/projected/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-kube-api-access-rnfq8\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.621605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.621513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.621605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.621587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.621860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.621612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfq8\" (UniqueName: \"kubernetes.io/projected/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-kube-api-access-rnfq8\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.621860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.621641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.621860 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:49.621702 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 12:43:49.621860 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:49.621801 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls podName:3791d1fb-9a23-4f4c-b8d2-733d94f905a4 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:50.121778336 +0000 UTC m=+100.772742088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-sdchx" (UID: "3791d1fb-9a23-4f4c-b8d2-733d94f905a4") : secret "prometheus-operator-tls" not found Sep 10 12:43:49.622351 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.622327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.624329 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.624309 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.637299 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.637274 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfq8\" (UniqueName: \"kubernetes.io/projected/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-kube-api-access-rnfq8\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:49.883285 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:49.883189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:50.125460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.125424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:50.127830 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.127794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3791d1fb-9a23-4f4c-b8d2-733d94f905a4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sdchx\" (UID: \"3791d1fb-9a23-4f4c-b8d2-733d94f905a4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:50.212885 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.212848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr6f" event={"ID":"4770560d-99aa-41a2-bc7f-29534b80ed65","Type":"ContainerStarted","Data":"0d69850b379b27554bbc244316d38d63c139d4e9e376463acd9155c0e943bf05"} Sep 10 12:43:50.213049 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.212912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr6f" event={"ID":"4770560d-99aa-41a2-bc7f-29534b80ed65","Type":"ContainerStarted","Data":"7408cc973f7c8106062139d07de6cf88fd0ffd7bfa2ee75ea25852ee3948017f"} Sep 10 12:43:50.213049 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.212973 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dr6f" Sep 10 12:43:50.214946 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.214919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pd6c" event={"ID":"b3cd3d55-cdda-48ff-bec5-44d8e84a3a53","Type":"ContainerStarted","Data":"2b8b64ac7716cf8e0dc24a56f77b9807ae742ed1dd16f2cf34d57309c664ab0f"} Sep 10 12:43:50.234839 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.234787 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4dr6f" podStartSLOduration=65.02856723 podStartE2EDuration="1m7.234751804s" totalImagesPullingTime="2.206184574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:50.233455827 +0000 UTC m=+100.884419574" watchObservedRunningTime="2026-09-10 12:43:50.234751804 +0000 UTC m=+100.885715556" Sep 10 12:43:50.257512 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.257458 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5pd6c" podStartSLOduration=33.497768109 podStartE2EDuration="36.257440951s" totalImagesPullingTime="2.759672842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:43:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:50.256713012 +0000 UTC m=+100.907676765" watchObservedRunningTime="2026-09-10 12:43:50.257440951 +0000 UTC m=+100.908404704" Sep 10 12:43:50.264259 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.264231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" Sep 10 12:43:50.557753 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:50.557675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sdchx"] Sep 10 12:43:50.561232 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:50.561194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3791d1fb_9a23_4f4c_b8d2_733d94f905a4.slice/crio-30597209154d70f15921f58c5fcabfe16106b187e9a21b37b48bdc22f75135e4 WatchSource:0}: Error finding container 30597209154d70f15921f58c5fcabfe16106b187e9a21b37b48bdc22f75135e4: Status 404 returned error can't find the container with id 30597209154d70f15921f58c5fcabfe16106b187e9a21b37b48bdc22f75135e4 Sep 10 12:43:51.113612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:51.113582 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztjjj" Sep 10 12:43:51.220032 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:51.219990 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" event={"ID":"3791d1fb-9a23-4f4c-b8d2-733d94f905a4","Type":"ContainerStarted","Data":"30597209154d70f15921f58c5fcabfe16106b187e9a21b37b48bdc22f75135e4"} Sep 10 12:43:51.595357 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:51.595321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:51.792799 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:51.792743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:51.921543 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:51.921461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:52.834471 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:52.834375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:52.934120 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:52.934085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:53.230170 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:53.230133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" event={"ID":"3791d1fb-9a23-4f4c-b8d2-733d94f905a4","Type":"ContainerStarted","Data":"23dca895678086ff7ee90d3b72b7f0e8ef1c7ca12406cdf2fc6b527f92041340"} Sep 10 12:43:53.230329 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:53.230207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" event={"ID":"3791d1fb-9a23-4f4c-b8d2-733d94f905a4","Type":"ContainerStarted","Data":"027c8cd55f9c8937f1d6a3c8dff49fb4b9841659bafe18b7107d6194fe0c5b8d"} Sep 10 12:43:53.255047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:53.254962 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-sdchx" podStartSLOduration=2.548398647 podStartE2EDuration="4.25494062s" totalImagesPullingTime="1.706541973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:53.254068187 +0000 UTC m=+103.905031940" watchObservedRunningTime="2026-09-10 12:43:53.25494062 +0000 UTC m=+103.905904373" Sep 10 12:43:54.592071 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.592034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:54.737161 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.737121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:54.889554 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.889468 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl"] Sep 10 12:43:54.891922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.891902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:54.897522 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.897493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2f26r\"" Sep 10 12:43:54.897707 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.897686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 12:43:54.898315 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.898291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:43:54.912725 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.912025 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl"] Sep 10 12:43:54.970452 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.970417 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq"] Sep 10 12:43:54.972653 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.972636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:54.976559 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.976539 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 12:43:54.977083 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.977060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:43:54.977335 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.977318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 12:43:54.989255 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:54.989230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mfk75\"" Sep 10 12:43:55.000262 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.000234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq"] Sep 10 12:43:55.015101 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.015067 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tqppg"] Sep 10 12:43:55.017353 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.017334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.019936 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.019913 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:43:55.020907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.020889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:43:55.021053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.021034 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:43:55.021151 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.021107 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m8sxk\"" Sep 10 12:43:55.069250 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.069435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvft\" (UniqueName: \"kubernetes.io/projected/bd0390d5-f399-4fd5-baa6-fcd81680ee24-kube-api-access-whvft\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.069435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.069435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0390d5-f399-4fd5-baa6-fcd81680ee24-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.069564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.069564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.069564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d52d8a-da63-405e-88b2-a440f12b6b28-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.069699 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.069699 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.069699 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.069629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7gk\" (UniqueName: \"kubernetes.io/projected/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-api-access-6s7gk\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.170852 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.170741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d52d8a-da63-405e-88b2-a440f12b6b28-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.170852 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.170812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-sys\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.170861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.170983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-tls\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171123 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171156 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7gk\" (UniqueName: \"kubernetes.io/projected/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-api-access-6s7gk\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171197 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/14d52d8a-da63-405e-88b2-a440f12b6b28-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-textfile\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171337 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.171428 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171428 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvft\" (UniqueName: \"kubernetes.io/projected/bd0390d5-f399-4fd5-baa6-fcd81680ee24-kube-api-access-whvft\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.171526 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171631 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-wtmp\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171631 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171615 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171738 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0390d5-f399-4fd5-baa6-fcd81680ee24-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.171738 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.171866 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.171866 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-root\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171866 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.171866 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vp7\" (UniqueName: \"kubernetes.io/projected/7b6b092f-06bc-411e-8299-507eed9aaff6-kube-api-access-44vp7\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.172057 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:55.171865 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 12:43:55.172057 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.171901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-metrics-client-ca\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.172057 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:55.171971 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls podName:bd0390d5-f399-4fd5-baa6-fcd81680ee24 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:55.671952526 +0000 UTC m=+106.322916271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-k6ljl" (UID: "bd0390d5-f399-4fd5-baa6-fcd81680ee24") : secret "openshift-state-metrics-tls" not found Sep 10 12:43:55.172225 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.172099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14d52d8a-da63-405e-88b2-a440f12b6b28-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.172453 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.172417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0390d5-f399-4fd5-baa6-fcd81680ee24-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.174150 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.174127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.174255 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.174195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.174590 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.174566 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.193210 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.193177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7gk\" (UniqueName: \"kubernetes.io/projected/14d52d8a-da63-405e-88b2-a440f12b6b28-kube-api-access-6s7gk\") pod \"kube-state-metrics-74cb57df7-t7lvq\" (UID: \"14d52d8a-da63-405e-88b2-a440f12b6b28\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.193869 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.193843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvft\" (UniqueName: \"kubernetes.io/projected/bd0390d5-f399-4fd5-baa6-fcd81680ee24-kube-api-access-whvft\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.272555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-tls\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-textfile\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-wtmp\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-root\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vp7\" (UniqueName: \"kubernetes.io/projected/7b6b092f-06bc-411e-8299-507eed9aaff6-kube-api-access-44vp7\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-wtmp\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-metrics-client-ca\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-root\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.272916 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-sys\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.273243 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.272984 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6b092f-06bc-411e-8299-507eed9aaff6-sys\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.273301 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.273263 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-textfile\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.273794 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.273713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.273922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.273830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6b092f-06bc-411e-8299-507eed9aaff6-metrics-client-ca\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.275403 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.275384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.275556 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.275534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6b092f-06bc-411e-8299-507eed9aaff6-node-exporter-tls\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.284383 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.284361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" Sep 10 12:43:55.287805 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.287783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vp7\" (UniqueName: \"kubernetes.io/projected/7b6b092f-06bc-411e-8299-507eed9aaff6-kube-api-access-44vp7\") pod \"node-exporter-tqppg\" (UID: \"7b6b092f-06bc-411e-8299-507eed9aaff6\") " pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.328775 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.328732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqppg" Sep 10 12:43:55.411711 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:55.411675 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6b092f_06bc_411e_8299_507eed9aaff6.slice/crio-17cd3582ab51ddffa12e99ce39cd1d807542a6bdc90543ac33814847ce78251e WatchSource:0}: Error finding container 17cd3582ab51ddffa12e99ce39cd1d807542a6bdc90543ac33814847ce78251e: Status 404 returned error can't find the container with id 17cd3582ab51ddffa12e99ce39cd1d807542a6bdc90543ac33814847ce78251e Sep 10 12:43:55.433601 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.433570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:55.606394 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.606357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:55.676818 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.676781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.679267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.679249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0390d5-f399-4fd5-baa6-fcd81680ee24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-k6ljl\" (UID: \"bd0390d5-f399-4fd5-baa6-fcd81680ee24\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:55.698324 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.698163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq"] Sep 10 12:43:55.700665 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:55.700637 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d52d8a_da63_405e_88b2_a440f12b6b28.slice/crio-dfe802f624e395070e72c8a99be3e4e655cb08826ef60801be9c4a3aaf2f94bc WatchSource:0}: Error finding container dfe802f624e395070e72c8a99be3e4e655cb08826ef60801be9c4a3aaf2f94bc: Status 404 returned error can't find the container with id dfe802f624e395070e72c8a99be3e4e655cb08826ef60801be9c4a3aaf2f94bc Sep 10 12:43:55.742051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.742018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:55.803209 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:55.803176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" Sep 10 12:43:56.051456 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.051361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:56.132092 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.132048 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl"] Sep 10 12:43:56.135542 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:56.135509 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0390d5_f399_4fd5_baa6_fcd81680ee24.slice/crio-4be58a56dac016b68fca089a6b753f8ed81cbccac9d66c006ab973f0886d7188 WatchSource:0}: Error finding container 4be58a56dac016b68fca089a6b753f8ed81cbccac9d66c006ab973f0886d7188: Status 404 returned error can't find the container with id 4be58a56dac016b68fca089a6b753f8ed81cbccac9d66c006ab973f0886d7188 Sep 10 12:43:56.229259 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.229230 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:43:56.232258 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.232237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.243489 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.243459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" event={"ID":"261ebc12-f1a0-4931-b002-762e0219d00d","Type":"ContainerStarted","Data":"68e07627b1cf809a04f5b8b3940abd64b0639a2127fe70b4a5b0722e31afd83a"} Sep 10 12:43:56.243849 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.243798 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:56.245587 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.245510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqppg" event={"ID":"7b6b092f-06bc-411e-8299-507eed9aaff6","Type":"ContainerStarted","Data":"17cd3582ab51ddffa12e99ce39cd1d807542a6bdc90543ac33814847ce78251e"} Sep 10 12:43:56.247743 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.247668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" Sep 10 12:43:56.249261 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.249049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:43:56.249261 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.249072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:43:56.249261 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.249212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" event={"ID":"bd0390d5-f399-4fd5-baa6-fcd81680ee24","Type":"ContainerStarted","Data":"bd50741ce958714ca5973817a2d27745af59f98d3d18e8c754b9c656e7806ac1"} Sep 10 12:43:56.249458 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.249287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" event={"ID":"bd0390d5-f399-4fd5-baa6-fcd81680ee24","Type":"ContainerStarted","Data":"4be58a56dac016b68fca089a6b753f8ed81cbccac9d66c006ab973f0886d7188"} Sep 10 12:43:56.253211 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.251546 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stm8d\"" Sep 10 12:43:56.253211 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.251785 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:43:56.253211 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.252560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" event={"ID":"14d52d8a-da63-405e-88b2-a440f12b6b28","Type":"ContainerStarted","Data":"dfe802f624e395070e72c8a99be3e4e655cb08826ef60801be9c4a3aaf2f94bc"} Sep 10 12:43:56.260737 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.260553 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:43:56.262605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.262565 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:43:56.262605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.262570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:43:56.264121 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.264055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:43:56.264217 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.264055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:43:56.283076 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-config-out\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283339 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrvc\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-kube-api-access-4xrvc\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283443 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283511 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283568 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283626 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283689 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283742 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.283829 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.283811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.284024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.284007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.284142 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.284130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-web-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.284269 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.284253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.284409 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.284396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.309379 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.309353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:43:56.311552 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.311528 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:43:56.312701 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.312677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:56.386717 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386717 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:43:56.386935 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle podName:2e131375-3637-40a3-a507-7138502e0640 nodeName:}" failed. No retries permitted until 2026-09-10 12:43:56.88691511 +0000 UTC m=+107.537878845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2e131375-3637-40a3-a507-7138502e0640") : configmap references non-existent config key: ca-bundle.crt Sep 10 12:43:56.386982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.386987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-web-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.387013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.387059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.387100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-config-out\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.387123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrvc\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-kube-api-access-4xrvc\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.387267 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.387151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.388204 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.388145 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.388872 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.388402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.390241 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.390194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e131375-3637-40a3-a507-7138502e0640-config-out\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.390423 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.390396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.391668 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.391643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-web-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.392207 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.392181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.392401 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.392379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.392637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.392591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.392806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.392782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.393198 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.393175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.394697 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.394678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e131375-3637-40a3-a507-7138502e0640-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.430708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.430679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrvc\" (UniqueName: \"kubernetes.io/projected/2e131375-3637-40a3-a507-7138502e0640-kube-api-access-4xrvc\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.514839 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.514300 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5689d689d7-7n66d" podStartSLOduration=1.969622077 podStartE2EDuration="12.514277754s" totalImagesPullingTime="10.544655677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:56.511369954 +0000 UTC m=+107.162333708" watchObservedRunningTime="2026-09-10 12:43:56.514277754 +0000 UTC m=+107.165241508" Sep 10 12:43:56.581254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.581181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:56.892524 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.892396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:56.893945 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:56.893918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e131375-3637-40a3-a507-7138502e0640-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e131375-3637-40a3-a507-7138502e0640\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:57.169489 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.169399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:43:57.259051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.259012 2579 generic.go:356] "Generic (PLEG): container finished" podID="7b6b092f-06bc-411e-8299-507eed9aaff6" containerID="49c84e65065af8d76518b36dd4b6fb0f3849dfdc150193c58b6bb87e74e8599f" exitCode=0 Sep 10 12:43:57.259225 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.259100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqppg" event={"ID":"7b6b092f-06bc-411e-8299-507eed9aaff6","Type":"ContainerDied","Data":"49c84e65065af8d76518b36dd4b6fb0f3849dfdc150193c58b6bb87e74e8599f"} Sep 10 12:43:57.261608 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.261573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" event={"ID":"bd0390d5-f399-4fd5-baa6-fcd81680ee24","Type":"ContainerStarted","Data":"a868686f051d42bc8171e8bd80434f904bf08df41b2ccf427d5e4a29f88d5608"} Sep 10 12:43:57.611383 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.611347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:57.771145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:57.770999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:58.073845 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.073818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:43:58.075441 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:43:58.075412 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e131375_3637_40a3_a507_7138502e0640.slice/crio-40aeb1f70953203d3b19d743cb477b7744c490675937142b10cd4411c29d50ca WatchSource:0}: Error finding container 40aeb1f70953203d3b19d743cb477b7744c490675937142b10cd4411c29d50ca: Status 404 returned error can't find the container with id 40aeb1f70953203d3b19d743cb477b7744c490675937142b10cd4411c29d50ca Sep 10 12:43:58.267801 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.267748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"40aeb1f70953203d3b19d743cb477b7744c490675937142b10cd4411c29d50ca"} Sep 10 12:43:58.270041 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.270009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqppg" event={"ID":"7b6b092f-06bc-411e-8299-507eed9aaff6","Type":"ContainerStarted","Data":"312883ccdda8ef816d2803c6ceec3a42750fdd17f3b838cd35191ae0c4ea8f38"} Sep 10 12:43:58.270196 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.270069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqppg" event={"ID":"7b6b092f-06bc-411e-8299-507eed9aaff6","Type":"ContainerStarted","Data":"cae50a4af0e8b8ea466063f4a5f031b83b5d0188836adf9f262be763826d42db"} Sep 10 12:43:58.272795 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.272746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" event={"ID":"bd0390d5-f399-4fd5-baa6-fcd81680ee24","Type":"ContainerStarted","Data":"3d2a2c3bc2f9e2f28e08d17614084ee48b0ac7024e8a05bdaedd3466c98d6e69"} Sep 10 12:43:58.275020 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.274997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" event={"ID":"14d52d8a-da63-405e-88b2-a440f12b6b28","Type":"ContainerStarted","Data":"533c4ccf2396167f3f4d282cf6543cef32167175f097dd6444c56ae8ee853612"} Sep 10 12:43:58.275144 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.275038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" event={"ID":"14d52d8a-da63-405e-88b2-a440f12b6b28","Type":"ContainerStarted","Data":"877052c72f0f2ffc8b703344beb212180f75ec6103015139fe8a544fcd0c5cfd"} Sep 10 12:43:58.275144 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.275060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" event={"ID":"14d52d8a-da63-405e-88b2-a440f12b6b28","Type":"ContainerStarted","Data":"c1a532899c994aeb5e476986837496c7517e9b1c7c305a315343b31cbdb30036"} Sep 10 12:43:58.310654 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.310606 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tqppg" podStartSLOduration=3.061008136 podStartE2EDuration="4.310590014s" totalImagesPullingTime="1.171641768s" totalInitContainerRuntime="77.94011ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:58.310548934 +0000 UTC m=+108.961512687" watchObservedRunningTime="2026-09-10 12:43:58.310590014 +0000 UTC m=+108.961553765" Sep 10 12:43:58.456112 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.456049 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-k6ljl" podStartSLOduration=3.054067965 podStartE2EDuration="4.456026679s" totalImagesPullingTime="1.401958714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:58.352915456 +0000 UTC m=+109.003879211" watchObservedRunningTime="2026-09-10 12:43:58.456026679 +0000 UTC m=+109.106990432" Sep 10 12:43:58.458755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.458725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:58.683946 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.683911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:58.928035 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:58.928004 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:59.280713 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.280676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"42fc6cd03df56373cd9cb2b12590715b5dd8a87a091e78daf4d53021d13925b8"} Sep 10 12:43:59.317424 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.317371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t7lvq" podStartSLOduration=3.302748626 podStartE2EDuration="5.317354385s" totalImagesPullingTime="2.014605759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:58.456257593 +0000 UTC m=+109.107221345" watchObservedRunningTime="2026-09-10 12:43:59.317354385 +0000 UTC m=+109.968318138" Sep 10 12:43:59.551099 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.551011 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5554dc4478-hfd85"] Sep 10 12:43:59.554351 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.554333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.559385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.558979 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 12:43:59.559385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.559268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 12:43:59.559385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.559316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 12:43:59.559385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.559316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rkh6f\"" Sep 10 12:43:59.559385 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.559379 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eusmq3ack631q\"" Sep 10 12:43:59.559713 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.559317 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 12:43:59.568049 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.568027 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5554dc4478-hfd85"] Sep 10 12:43:59.617526 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-metrics-server-audit-profiles\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617526 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-client-certs\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdbr\" (UniqueName: \"kubernetes.io/projected/c0d4bea4-f813-4323-a897-114be5c2ef88-kube-api-access-crdbr\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0d4bea4-f813-4323-a897-114be5c2ef88-audit-log\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-client-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.617971 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.617824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-tls\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.663312 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.663275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:59.719105 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0d4bea4-f813-4323-a897-114be5c2ef88-audit-log\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-client-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-tls\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-metrics-server-audit-profiles\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-client-certs\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdbr\" (UniqueName: \"kubernetes.io/projected/c0d4bea4-f813-4323-a897-114be5c2ef88-kube-api-access-crdbr\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.719662 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.719611 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0d4bea4-f813-4323-a897-114be5c2ef88-audit-log\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.720393 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.720369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-metrics-server-audit-profiles\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.720490 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.720479 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d4bea4-f813-4323-a897-114be5c2ef88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.721899 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.721874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-client-ca-bundle\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.722306 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.722287 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-client-certs\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.722351 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.722308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0d4bea4-f813-4323-a897-114be5c2ef88-secret-metrics-server-tls\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.733436 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.733414 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdbr\" (UniqueName: \"kubernetes.io/projected/c0d4bea4-f813-4323-a897-114be5c2ef88-kube-api-access-crdbr\") pod \"metrics-server-5554dc4478-hfd85\" (UID: \"c0d4bea4-f813-4323-a897-114be5c2ef88\") " pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.844864 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.844787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:43:59.865001 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.864973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:43:59.993837 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:43:59.993800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:00.165407 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.165321 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5554dc4478-hfd85"] Sep 10 12:44:00.174462 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:44:00.174435 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d4bea4_f813_4323_a897_114be5c2ef88.slice/crio-eb1fac786edd91af885dfc6497ac72b02cf9a90939dbb9c127c3282b8f1577f1 WatchSource:0}: Error finding container eb1fac786edd91af885dfc6497ac72b02cf9a90939dbb9c127c3282b8f1577f1: Status 404 returned error can't find the container with id eb1fac786edd91af885dfc6497ac72b02cf9a90939dbb9c127c3282b8f1577f1 Sep 10 12:44:00.222981 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.222953 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dr6f" Sep 10 12:44:00.287404 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.287372 2579 generic.go:356] "Generic (PLEG): container finished" podID="2e131375-3637-40a3-a507-7138502e0640" containerID="42fc6cd03df56373cd9cb2b12590715b5dd8a87a091e78daf4d53021d13925b8" exitCode=0 Sep 10 12:44:00.287844 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.287457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerDied","Data":"42fc6cd03df56373cd9cb2b12590715b5dd8a87a091e78daf4d53021d13925b8"} Sep 10 12:44:00.289449 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.289384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" event={"ID":"c0d4bea4-f813-4323-a897-114be5c2ef88","Type":"ContainerStarted","Data":"eb1fac786edd91af885dfc6497ac72b02cf9a90939dbb9c127c3282b8f1577f1"} Sep 10 12:44:00.415194 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.415164 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76748f497c-q7qg8"] Sep 10 12:44:00.420015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.419957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.423712 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.423690 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 12:44:00.423924 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.423883 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 12:44:00.424147 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.424129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9bsmj\"" Sep 10 12:44:00.424847 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.424832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 12:44:00.425040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.425027 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 12:44:00.431516 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.431496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 12:44:00.432001 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.431985 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 12:44:00.441372 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.441352 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76748f497c-q7qg8"] Sep 10 12:44:00.525229 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-serving-certs-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-metrics-client-ca\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wqv\" (UniqueName: \"kubernetes.io/projected/35b64669-fe37-4668-b162-d5dd7034c8ec-kube-api-access-84wqv\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-federate-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.525595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.525519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-metrics-client-ca\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wqv\" (UniqueName: \"kubernetes.io/projected/35b64669-fe37-4668-b162-d5dd7034c8ec-kube-api-access-84wqv\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-federate-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626796 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.626796 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.626609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-serving-certs-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.627322 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.627204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-metrics-client-ca\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.627322 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.627225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-serving-certs-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.627540 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.627514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.630084 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.630057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.630175 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.630060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.630175 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.630160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-telemeter-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.630268 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.630170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35b64669-fe37-4668-b162-d5dd7034c8ec-federate-client-tls\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.644124 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.644091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wqv\" (UniqueName: \"kubernetes.io/projected/35b64669-fe37-4668-b162-d5dd7034c8ec-kube-api-access-84wqv\") pod \"telemeter-client-76748f497c-q7qg8\" (UID: \"35b64669-fe37-4668-b162-d5dd7034c8ec\") " pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:00.730329 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:00.730295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" Sep 10 12:44:01.030033 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:01.029991 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76748f497c-q7qg8"] Sep 10 12:44:01.032153 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:44:01.032126 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b64669_fe37_4668_b162_d5dd7034c8ec.slice/crio-019a0958c3b3d5664df94f0a58793e1aba264153f58e0ff66646efa51ecf61cb WatchSource:0}: Error finding container 019a0958c3b3d5664df94f0a58793e1aba264153f58e0ff66646efa51ecf61cb: Status 404 returned error can't find the container with id 019a0958c3b3d5664df94f0a58793e1aba264153f58e0ff66646efa51ecf61cb Sep 10 12:44:01.297119 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:01.297017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" event={"ID":"35b64669-fe37-4668-b162-d5dd7034c8ec","Type":"ContainerStarted","Data":"019a0958c3b3d5664df94f0a58793e1aba264153f58e0ff66646efa51ecf61cb"} Sep 10 12:44:01.905724 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:01.905661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:02.129024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.128985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:02.311327 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.311294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"8e5c05f24863ffd7551e50375ef972cdb660a9c573a9730d6906f671959087f3"} Sep 10 12:44:02.311781 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.311412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"b5919da606911dc0568d03f0508bdaf749fcb7fb2bdbc8a0e80f634d48d9454a"} Sep 10 12:44:02.311781 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.311459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"88bbedf29cfdef42cc27ac72279f377c4e7b071abdbaf201ee25dac82fb47996"} Sep 10 12:44:02.311781 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.311503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"0b670db6cb8bc628f4950424eb8f0fad9639c0b8c8f7d0749f510e3507af47d5"} Sep 10 12:44:02.311781 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.311541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"5333a0d2277fc95539c0cb468263d799108be2a009eaa6a0dbabba182a7c6ae6"} Sep 10 12:44:02.314017 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.313959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" event={"ID":"c0d4bea4-f813-4323-a897-114be5c2ef88","Type":"ContainerStarted","Data":"9e89c98f0483d8e35db18bfdd1fd9bb50e4ebd5c5af2756b2bcfbfa02a39d16c"} Sep 10 12:44:02.358914 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:02.358834 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" podStartSLOduration=1.619820792 podStartE2EDuration="3.358810754s" totalImagesPullingTime="1.738989962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:02.358002855 +0000 UTC m=+113.008966608" watchObservedRunningTime="2026-09-10 12:44:02.358810754 +0000 UTC m=+113.009774507" Sep 10 12:44:04.325063 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.325024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" event={"ID":"35b64669-fe37-4668-b162-d5dd7034c8ec","Type":"ContainerStarted","Data":"d980489e157cec276fa8d60601a7144731f67351ddb66239de8bb35e937c09e1"} Sep 10 12:44:04.325555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.325092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" event={"ID":"35b64669-fe37-4668-b162-d5dd7034c8ec","Type":"ContainerStarted","Data":"10172afd3eb6ac52a91ed30ba500194542e044d73f0db5a2f9d57744e3e213d7"} Sep 10 12:44:04.325555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.325118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" event={"ID":"35b64669-fe37-4668-b162-d5dd7034c8ec","Type":"ContainerStarted","Data":"8ceb25584e1a4855b6b5de09f8d5c44c051c0ec6c7c1871283ddfd5c1a5e4130"} Sep 10 12:44:04.328246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.328219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e131375-3637-40a3-a507-7138502e0640","Type":"ContainerStarted","Data":"998f3dd446268d5ea2678bcfe26b0acdcba045d887e61550f524687b7dae2e5e"} Sep 10 12:44:04.369580 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.369513 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76748f497c-q7qg8" podStartSLOduration=1.997533549 podStartE2EDuration="4.369496065s" totalImagesPullingTime="2.371962516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:04.367785683 +0000 UTC m=+115.018749429" watchObservedRunningTime="2026-09-10 12:44:04.369496065 +0000 UTC m=+115.020459818" Sep 10 12:44:04.426490 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:04.426431 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.041513549 podStartE2EDuration="8.426412546s" totalImagesPullingTime="4.368513644s" totalInitContainerRuntime="16.385353ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:04.426081995 +0000 UTC m=+115.077045748" watchObservedRunningTime="2026-09-10 12:44:04.426412546 +0000 UTC m=+115.077376299" Sep 10 12:44:06.504334 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:06.504296 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:44:06.508827 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:06.508802 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:44:06.735076 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:06.735043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:06.976314 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:06.976282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:07.179370 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:07.179337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:07.841949 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:07.841910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:09.764215 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:09.764183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:09.957751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:09.957716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:12.589240 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:12.589204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:12.781399 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:12.781358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:13.562463 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:13.562414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:13.868444 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:13.868341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:15.958006 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:15.957968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:16.832789 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:16.832741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:18.935644 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:18.935594 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:19.183137 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.183106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:19.596286 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.596234 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:44:19.598687 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.598660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3ef9257-4689-460e-a6da-b9260ff46e84-metrics-certs\") pod \"network-metrics-daemon-zblgg\" (UID: \"b3ef9257-4689-460e-a6da-b9260ff46e84\") " pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:44:19.848852 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.848748 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nmnkz\"" Sep 10 12:44:19.852818 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.852801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zblgg" Sep 10 12:44:19.866028 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.866009 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:44:19.866331 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:19.866307 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:44:20.157552 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:20.157476 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zblgg"] Sep 10 12:44:20.160877 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:44:20.160842 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ef9257_4689_460e_a6da_b9260ff46e84.slice/crio-3edd161c3bc43a9234d5577bd64054958f72ba54f61fd4d6f5d48915c92cef81 WatchSource:0}: Error finding container 3edd161c3bc43a9234d5577bd64054958f72ba54f61fd4d6f5d48915c92cef81: Status 404 returned error can't find the container with id 3edd161c3bc43a9234d5577bd64054958f72ba54f61fd4d6f5d48915c92cef81 Sep 10 12:44:20.395485 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:20.395449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zblgg" event={"ID":"b3ef9257-4689-460e-a6da-b9260ff46e84","Type":"ContainerStarted","Data":"3edd161c3bc43a9234d5577bd64054958f72ba54f61fd4d6f5d48915c92cef81"} Sep 10 12:44:21.401998 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:21.401967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zblgg" event={"ID":"b3ef9257-4689-460e-a6da-b9260ff46e84","Type":"ContainerStarted","Data":"9d7b29d35b12590b29658c0ae237b27648094e8b6ba986088e9a4afdb4165616"} Sep 10 12:44:22.325082 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:22.325047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:22.407147 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:22.407116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zblgg" event={"ID":"b3ef9257-4689-460e-a6da-b9260ff46e84","Type":"ContainerStarted","Data":"00a2212e2ae2b0b78c1caa3eeff2e0bac0f024289f3135e513013b86451f9304"} Sep 10 12:44:22.449433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:22.449385 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zblgg" podStartSLOduration=131.314845441 podStartE2EDuration="2m12.44936903s" totalImagesPullingTime="1.134523589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:22.446802678 +0000 UTC m=+133.097766422" watchObservedRunningTime="2026-09-10 12:44:22.44936903 +0000 UTC m=+133.100332782" Sep 10 12:44:22.591177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:22.591087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:22.986890 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:22.986859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:23.217001 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:23.216966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:26.324052 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:26.324020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:26.518548 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:26.518511 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:27.613444 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:27.613414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:27.805677 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:27.805646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:31.524280 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.524217 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" podUID="c35a5b3f-c675-47bc-af85-7c93582505c6" containerName="registry" containerID="cri-o://78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d" gracePeriod=30 Sep 10 12:44:31.761232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.761210 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:44:31.903171 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903079 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903179 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903204 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp5f8\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903253 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903280 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903314 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903583 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903350 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903583 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903374 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token\") pod \"c35a5b3f-c675-47bc-af85-7c93582505c6\" (UID: \"c35a5b3f-c675-47bc-af85-7c93582505c6\") " Sep 10 12:44:31.903751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.903690 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:44:31.904163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.904093 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:44:31.905831 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.905779 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:44:31.905831 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.905805 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8" (OuterVolumeSpecName: "kube-api-access-kp5f8") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "kube-api-access-kp5f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:44:31.906009 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.905975 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:44:31.906102 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.906082 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:44:31.906102 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.906090 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:44:31.911545 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:31.911518 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c35a5b3f-c675-47bc-af85-7c93582505c6" (UID: "c35a5b3f-c675-47bc-af85-7c93582505c6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:44:32.004657 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004620 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-trusted-ca\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004657 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004651 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp5f8\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-kube-api-access-kp5f8\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004657 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004664 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-image-registry-private-configuration\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004675 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c35a5b3f-c675-47bc-af85-7c93582505c6-ca-trust-extracted\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004684 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-tls\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004691 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c35a5b3f-c675-47bc-af85-7c93582505c6-registry-certificates\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004699 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c35a5b3f-c675-47bc-af85-7c93582505c6-bound-sa-token\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.004907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.004706 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c35a5b3f-c675-47bc-af85-7c93582505c6-installation-pull-secrets\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:44:32.446518 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.446482 2579 generic.go:356] "Generic (PLEG): container finished" podID="c35a5b3f-c675-47bc-af85-7c93582505c6" containerID="78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d" exitCode=0 Sep 10 12:44:32.446703 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.446530 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" Sep 10 12:44:32.446703 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.446533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" event={"ID":"c35a5b3f-c675-47bc-af85-7c93582505c6","Type":"ContainerDied","Data":"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d"} Sep 10 12:44:32.446703 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.446633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68fb5b7467-jdt4l" event={"ID":"c35a5b3f-c675-47bc-af85-7c93582505c6","Type":"ContainerDied","Data":"798aa86ebb43274155f99ea3836e00130f65760e9fa91b21d66aff75e2dab815"} Sep 10 12:44:32.446703 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.446654 2579 scope.go:117] "RemoveContainer" containerID="78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d" Sep 10 12:44:32.455413 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.455392 2579 scope.go:117] "RemoveContainer" containerID="78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d" Sep 10 12:44:32.455661 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:44:32.455643 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d\": container with ID starting with 78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d not found: ID does not exist" containerID="78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d" Sep 10 12:44:32.455706 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.455668 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d"} err="failed to get container status \"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d\": rpc error: code = NotFound desc = could not find container \"78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d\": container with ID starting with 78e2e01eab58831711c157f9b2d1c5c22e90b902575c1d36bafb00cc7a84101d not found: ID does not exist" Sep 10 12:44:32.478255 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.478224 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:44:32.481253 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.481229 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68fb5b7467-jdt4l"] Sep 10 12:44:32.969398 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:32.969372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:33.196177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:33.196137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:33.829615 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:33.829569 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35a5b3f-c675-47bc-af85-7c93582505c6" path="/var/lib/kubelet/pods/c35a5b3f-c675-47bc-af85-7c93582505c6/volumes" Sep 10 12:44:39.870969 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:39.870930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:44:39.874715 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:39.874692 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5554dc4478-hfd85" Sep 10 12:44:42.588487 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:42.588451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:42.720303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:42.720269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:44:45.740347 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:44:45.740311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:11.822881 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:11.822845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:11.987925 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:11.987887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:23.736451 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:23.736413 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:23.817658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:23.817619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:27.827562 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:27.827533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:27.938696 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:27.938660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:36.715070 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:36.715025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:36.800508 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:36.800460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:48.192019 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:48.191962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:48.295611 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:48.295568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:45:49.568303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:45:49.568267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:15.816911 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:15.816878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:25.625245 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:25.625210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:25.727690 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:25.727661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:26.574412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.574375 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx"] Sep 10 12:46:26.574735 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.574720 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35a5b3f-c675-47bc-af85-7c93582505c6" containerName="registry" Sep 10 12:46:26.574806 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.574737 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35a5b3f-c675-47bc-af85-7c93582505c6" containerName="registry" Sep 10 12:46:26.574845 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.574815 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35a5b3f-c675-47bc-af85-7c93582505c6" containerName="registry" Sep 10 12:46:26.577790 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.577753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.581144 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.581089 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvbs9\"" Sep 10 12:46:26.581335 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.581317 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:46:26.582271 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.582251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:46:26.589505 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.589485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx"] Sep 10 12:46:26.719264 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.719232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.719610 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.719273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.719610 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.719329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8k85\" (UniqueName: \"kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.820578 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.820545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.820729 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.820600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8k85\" (UniqueName: \"kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.820729 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.820656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.821043 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.821022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.821111 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.821020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.830573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.830518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8k85\" (UniqueName: \"kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:26.886477 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:26.886447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:27.165915 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:27.165887 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx"] Sep 10 12:46:27.168670 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:46:27.168644 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838a65f2_6052_463e_9203_2a43b807a12d.slice/crio-ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc WatchSource:0}: Error finding container ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc: Status 404 returned error can't find the container with id ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc Sep 10 12:46:27.899000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:27.898964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerStarted","Data":"ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc"} Sep 10 12:46:34.928823 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:34.928788 2579 generic.go:356] "Generic (PLEG): container finished" podID="838a65f2-6052-463e-9203-2a43b807a12d" containerID="93948682d81c0537081ff7d9a24d8641d402f05dd62a45da15b5bec28c8d2ec9" exitCode=0 Sep 10 12:46:34.928823 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:34.928827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerDied","Data":"93948682d81c0537081ff7d9a24d8641d402f05dd62a45da15b5bec28c8d2ec9"} Sep 10 12:46:37.943138 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:37.943109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerStarted","Data":"0066c474fcd4c84c1d3c1701fb0944261ea1dacc4a5b26ae5cb7bf917f652f11"} Sep 10 12:46:38.950481 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:38.950441 2579 generic.go:356] "Generic (PLEG): container finished" podID="838a65f2-6052-463e-9203-2a43b807a12d" containerID="0066c474fcd4c84c1d3c1701fb0944261ea1dacc4a5b26ae5cb7bf917f652f11" exitCode=0 Sep 10 12:46:38.950898 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:38.950513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerDied","Data":"0066c474fcd4c84c1d3c1701fb0944261ea1dacc4a5b26ae5cb7bf917f652f11"} Sep 10 12:46:43.975663 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:43.975635 2579 generic.go:356] "Generic (PLEG): container finished" podID="838a65f2-6052-463e-9203-2a43b807a12d" containerID="50dbffae811f2adf588782182653e3363ec8e222eb0bc648e20cfcfa77ae89e0" exitCode=0 Sep 10 12:46:43.976015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:43.975688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerDied","Data":"50dbffae811f2adf588782182653e3363ec8e222eb0bc648e20cfcfa77ae89e0"} Sep 10 12:46:45.100199 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.100174 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:45.173719 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.173687 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8k85\" (UniqueName: \"kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85\") pod \"838a65f2-6052-463e-9203-2a43b807a12d\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " Sep 10 12:46:45.173913 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.173727 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util\") pod \"838a65f2-6052-463e-9203-2a43b807a12d\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " Sep 10 12:46:45.173913 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.173805 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle\") pod \"838a65f2-6052-463e-9203-2a43b807a12d\" (UID: \"838a65f2-6052-463e-9203-2a43b807a12d\") " Sep 10 12:46:45.174505 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.174477 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle" (OuterVolumeSpecName: "bundle") pod "838a65f2-6052-463e-9203-2a43b807a12d" (UID: "838a65f2-6052-463e-9203-2a43b807a12d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:46:45.176027 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.176004 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85" (OuterVolumeSpecName: "kube-api-access-m8k85") pod "838a65f2-6052-463e-9203-2a43b807a12d" (UID: "838a65f2-6052-463e-9203-2a43b807a12d"). InnerVolumeSpecName "kube-api-access-m8k85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:46:45.177932 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.177909 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util" (OuterVolumeSpecName: "util") pod "838a65f2-6052-463e-9203-2a43b807a12d" (UID: "838a65f2-6052-463e-9203-2a43b807a12d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:46:45.275257 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.275178 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:46:45.275257 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.275205 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8k85\" (UniqueName: \"kubernetes.io/projected/838a65f2-6052-463e-9203-2a43b807a12d-kube-api-access-m8k85\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:46:45.275257 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.275219 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/838a65f2-6052-463e-9203-2a43b807a12d-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:46:45.985361 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.985330 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" Sep 10 12:46:45.985506 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.985329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402fxmx" event={"ID":"838a65f2-6052-463e-9203-2a43b807a12d","Type":"ContainerDied","Data":"ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc"} Sep 10 12:46:45.985506 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:45.985477 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccef2b24f74406bacedaa7dd49a26fcdf2d8d3e37141c555c045fce3807a73fc" Sep 10 12:46:48.210932 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:48.210863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:48.310614 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:48.310573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:50.670576 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.670528 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz"] Sep 10 12:46:50.671234 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671211 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="extract" Sep 10 12:46:50.671234 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671235 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="extract" Sep 10 12:46:50.671371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671257 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="pull" Sep 10 12:46:50.671371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671266 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="pull" Sep 10 12:46:50.671371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671292 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="util" Sep 10 12:46:50.671371 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671302 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="util" Sep 10 12:46:50.671549 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.671459 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="838a65f2-6052-463e-9203-2a43b807a12d" containerName="extract" Sep 10 12:46:50.713883 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.713851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz"] Sep 10 12:46:50.714015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.713941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.716911 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.716889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 12:46:50.717482 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.717466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rkklm\"" Sep 10 12:46:50.717556 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.717501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:46:50.820904 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.820869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.821085 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.820933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7px9z\" (UniqueName: \"kubernetes.io/projected/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-kube-api-access-7px9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.922383 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.922315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.922383 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.922369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7px9z\" (UniqueName: \"kubernetes.io/projected/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-kube-api-access-7px9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.922670 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.922649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:50.935262 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:50.935237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7px9z\" (UniqueName: \"kubernetes.io/projected/1f1b32ff-1b4e-44e8-9998-1c1862cdf456-kube-api-access-7px9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-5vcpz\" (UID: \"1f1b32ff-1b4e-44e8-9998-1c1862cdf456\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:51.022733 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:51.022700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" Sep 10 12:46:51.338517 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:51.338492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz"] Sep 10 12:46:51.340993 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:46:51.340970 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1b32ff_1b4e_44e8_9998_1c1862cdf456.slice/crio-3d725ca9553c4a4749b74f882fd4a565dff0225f61a0b1626aa2490592cae444 WatchSource:0}: Error finding container 3d725ca9553c4a4749b74f882fd4a565dff0225f61a0b1626aa2490592cae444: Status 404 returned error can't find the container with id 3d725ca9553c4a4749b74f882fd4a565dff0225f61a0b1626aa2490592cae444 Sep 10 12:46:52.011980 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:52.011947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" event={"ID":"1f1b32ff-1b4e-44e8-9998-1c1862cdf456","Type":"ContainerStarted","Data":"3d725ca9553c4a4749b74f882fd4a565dff0225f61a0b1626aa2490592cae444"} Sep 10 12:46:52.527935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:52.527903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:52.682597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:52.682554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:54.024380 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.024343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" event={"ID":"1f1b32ff-1b4e-44e8-9998-1c1862cdf456","Type":"ContainerStarted","Data":"6eb72bc78568090f4d12156f29bc7f5557eb80c88e726f7e12d6c28a03228fdd"} Sep 10 12:46:54.109636 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.109584 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5vcpz" podStartSLOduration=2.005358574 podStartE2EDuration="4.109567826s" totalImagesPullingTime="2.104209252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:54.10792693 +0000 UTC m=+284.758890683" watchObservedRunningTime="2026-09-10 12:46:54.109567826 +0000 UTC m=+284.760531647" Sep 10 12:46:54.476948 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.476913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:54.645098 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.645068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:54.836034 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.835957 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg"] Sep 10 12:46:54.857468 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.857445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:54.864546 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.864321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvbs9\"" Sep 10 12:46:54.866556 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.865521 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:46:54.867428 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.867404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:46:54.867811 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.867793 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg"] Sep 10 12:46:54.955481 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.955447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:54.955612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.955516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:54.955612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:54.955570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjrdm\" (UniqueName: \"kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.056907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.056880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.057235 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.056920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjrdm\" (UniqueName: \"kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.057235 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.056940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.057313 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.057234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.057313 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.057290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.069338 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.069314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjrdm\" (UniqueName: \"kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.169293 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.169220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:46:55.454686 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:55.454659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg"] Sep 10 12:46:55.456388 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:46:55.456364 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b97ab7b_1270_494b_97ad_46c1ddf266f1.slice/crio-75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7 WatchSource:0}: Error finding container 75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7: Status 404 returned error can't find the container with id 75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7 Sep 10 12:46:56.035108 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:56.035071 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerID="032026bea621c3921cfadb61fd3a7fe2d4a18cb885ca3cfca098defc5b49501f" exitCode=0 Sep 10 12:46:56.035330 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:56.035168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerDied","Data":"032026bea621c3921cfadb61fd3a7fe2d4a18cb885ca3cfca098defc5b49501f"} Sep 10 12:46:56.035330 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:56.035229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerStarted","Data":"75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7"} Sep 10 12:46:56.938881 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:56.938822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:57.117036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.116999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:57.205053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.204988 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g"] Sep 10 12:46:57.207106 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.207090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.211848 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.211826 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 12:46:57.212036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.212018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t97vq\"" Sep 10 12:46:57.212361 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.212347 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 12:46:57.230277 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.230253 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g"] Sep 10 12:46:57.275797 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.275747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.275946 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.275830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggshm\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-kube-api-access-ggshm\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.377282 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.377244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.377435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.377400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggshm\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-kube-api-access-ggshm\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.390845 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.390820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.391195 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.391166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggshm\" (UniqueName: \"kubernetes.io/projected/a01200ff-32b1-4527-b775-929a9d285956-kube-api-access-ggshm\") pod \"cert-manager-cainjector-559cdd8c87-cqt6g\" (UID: \"a01200ff-32b1-4527-b775-929a9d285956\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:57.524042 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:57.523966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" Sep 10 12:46:58.046389 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:58.046353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerStarted","Data":"6ef45294effbb5d2da9bfe64afe5dd7e9ee1c5c6450253853946ddaf5989eaf6"} Sep 10 12:46:58.184798 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:58.184750 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g"] Sep 10 12:46:58.190781 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:46:58.190739 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda01200ff_32b1_4527_b775_929a9d285956.slice/crio-13440e013a5d86769df81a47452dd0732af5859997584512882231daa43d0409 WatchSource:0}: Error finding container 13440e013a5d86769df81a47452dd0732af5859997584512882231daa43d0409: Status 404 returned error can't find the container with id 13440e013a5d86769df81a47452dd0732af5859997584512882231daa43d0409 Sep 10 12:46:58.853200 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:58.853167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:59.054207 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.054172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" event={"ID":"a01200ff-32b1-4527-b775-929a9d285956","Type":"ContainerStarted","Data":"13440e013a5d86769df81a47452dd0732af5859997584512882231daa43d0409"} Sep 10 12:46:59.056450 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.056420 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerID="6ef45294effbb5d2da9bfe64afe5dd7e9ee1c5c6450253853946ddaf5989eaf6" exitCode=0 Sep 10 12:46:59.056577 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.056482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerDied","Data":"6ef45294effbb5d2da9bfe64afe5dd7e9ee1c5c6450253853946ddaf5989eaf6"} Sep 10 12:46:59.182889 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.182866 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hpmsl"] Sep 10 12:46:59.185531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.185509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.204386 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.204362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v4dj2\"" Sep 10 12:46:59.211355 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.211330 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hpmsl"] Sep 10 12:46:59.218066 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.218047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:46:59.296261 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.296221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.296400 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.296344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbw5\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-kube-api-access-xvbw5\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.397035 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.396960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.397035 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.397027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbw5\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-kube-api-access-xvbw5\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.416254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.416225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.417477 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.417453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbw5\" (UniqueName: \"kubernetes.io/projected/298924d0-8dd7-4ea4-b51b-c55a41803bba-kube-api-access-xvbw5\") pod \"cert-manager-webhook-6486ffd997-hpmsl\" (UID: \"298924d0-8dd7-4ea4-b51b-c55a41803bba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.496223 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.496171 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:46:59.802398 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:46:59.802356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hpmsl"] Sep 10 12:46:59.806600 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:46:59.806569 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod298924d0_8dd7_4ea4_b51b_c55a41803bba.slice/crio-99a953dc34db2dfbabf6106b1513c788d8e67f625ff8daa6383d9c0af8ac3273 WatchSource:0}: Error finding container 99a953dc34db2dfbabf6106b1513c788d8e67f625ff8daa6383d9c0af8ac3273: Status 404 returned error can't find the container with id 99a953dc34db2dfbabf6106b1513c788d8e67f625ff8daa6383d9c0af8ac3273 Sep 10 12:47:00.063573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:00.063477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" event={"ID":"298924d0-8dd7-4ea4-b51b-c55a41803bba","Type":"ContainerStarted","Data":"99a953dc34db2dfbabf6106b1513c788d8e67f625ff8daa6383d9c0af8ac3273"} Sep 10 12:47:00.066036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:00.066005 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerID="954eaaeed7935ae29244c8bf1faf223f255cfc765ce76da88cb34795e5ed8166" exitCode=0 Sep 10 12:47:00.066163 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:00.066089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerDied","Data":"954eaaeed7935ae29244c8bf1faf223f255cfc765ce76da88cb34795e5ed8166"} Sep 10 12:47:01.204091 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.204068 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:47:01.311785 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.311695 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjrdm\" (UniqueName: \"kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm\") pod \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " Sep 10 12:47:01.311785 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.311749 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle\") pod \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " Sep 10 12:47:01.312013 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.311798 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util\") pod \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\" (UID: \"9b97ab7b-1270-494b-97ad-46c1ddf266f1\") " Sep 10 12:47:01.312228 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.312190 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle" (OuterVolumeSpecName: "bundle") pod "9b97ab7b-1270-494b-97ad-46c1ddf266f1" (UID: "9b97ab7b-1270-494b-97ad-46c1ddf266f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:01.313790 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.313743 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm" (OuterVolumeSpecName: "kube-api-access-vjrdm") pod "9b97ab7b-1270-494b-97ad-46c1ddf266f1" (UID: "9b97ab7b-1270-494b-97ad-46c1ddf266f1"). InnerVolumeSpecName "kube-api-access-vjrdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:01.315682 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.315657 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util" (OuterVolumeSpecName: "util") pod "9b97ab7b-1270-494b-97ad-46c1ddf266f1" (UID: "9b97ab7b-1270-494b-97ad-46c1ddf266f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:01.412780 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.412729 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjrdm\" (UniqueName: \"kubernetes.io/projected/9b97ab7b-1270-494b-97ad-46c1ddf266f1-kube-api-access-vjrdm\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:01.412780 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.412755 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:01.412780 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:01.412785 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b97ab7b-1270-494b-97ad-46c1ddf266f1-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:02.077646 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.077609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" event={"ID":"a01200ff-32b1-4527-b775-929a9d285956","Type":"ContainerStarted","Data":"df989be124c247821e75c27d117dce9ea5cf749b37d1224edc5a91e77d066402"} Sep 10 12:47:02.079162 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.079132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" event={"ID":"298924d0-8dd7-4ea4-b51b-c55a41803bba","Type":"ContainerStarted","Data":"de62401ca210e5102382ae16ef2c635748bed3de96c36bca942fb9ae391d14ab"} Sep 10 12:47:02.079300 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.079203 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:47:02.080934 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.080920 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" Sep 10 12:47:02.081014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.080919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flw4qg" event={"ID":"9b97ab7b-1270-494b-97ad-46c1ddf266f1","Type":"ContainerDied","Data":"75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7"} Sep 10 12:47:02.081054 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.081034 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75407c0b6a73ab48daeb95c23348b9fca221960604b0cf04d71ca34c962086f7" Sep 10 12:47:02.105513 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.105425 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqt6g" podStartSLOduration=2.226095386 podStartE2EDuration="5.105411848s" totalImagesPullingTime="2.879316462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:02.104636229 +0000 UTC m=+292.755599981" watchObservedRunningTime="2026-09-10 12:47:02.105411848 +0000 UTC m=+292.756375600" Sep 10 12:47:02.136136 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:02.136092 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" podStartSLOduration=1.872636787 podStartE2EDuration="3.136081178s" totalImagesPullingTime="1.263444391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:02.134704247 +0000 UTC m=+292.785668003" watchObservedRunningTime="2026-09-10 12:47:02.136081178 +0000 UTC m=+292.787044931" Sep 10 12:47:04.015056 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:04.015009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:05.628086 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:05.628051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:05.728902 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:05.728871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:07.049668 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.049637 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms"] Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.049976 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="util" Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.049988 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="util" Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.049998 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="pull" Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.050004 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="pull" Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.050012 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="extract" Sep 10 12:47:07.050051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.050018 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="extract" Sep 10 12:47:07.050246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.050079 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b97ab7b-1270-494b-97ad-46c1ddf266f1" containerName="extract" Sep 10 12:47:07.052958 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.052941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.055567 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.055547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pq497\"" Sep 10 12:47:07.056277 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.056256 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 12:47:07.056277 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.056266 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:47:07.065610 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.065589 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms"] Sep 10 12:47:07.159547 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.159518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a75a92-087b-46fe-9679-06ed565c0c34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.159671 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.159553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmh2t\" (UniqueName: \"kubernetes.io/projected/08a75a92-087b-46fe-9679-06ed565c0c34-kube-api-access-nmh2t\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.260123 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.260091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a75a92-087b-46fe-9679-06ed565c0c34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.260123 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.260125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmh2t\" (UniqueName: \"kubernetes.io/projected/08a75a92-087b-46fe-9679-06ed565c0c34-kube-api-access-nmh2t\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.260461 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.260443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a75a92-087b-46fe-9679-06ed565c0c34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.271265 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.271238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmh2t\" (UniqueName: \"kubernetes.io/projected/08a75a92-087b-46fe-9679-06ed565c0c34-kube-api-access-nmh2t\") pod \"openshift-lws-operator-fd8ccff4c-xhcms\" (UID: \"08a75a92-087b-46fe-9679-06ed565c0c34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.361523 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.361456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" Sep 10 12:47:07.641841 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:07.641749 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms"] Sep 10 12:47:07.645018 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:47:07.644987 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08a75a92_087b_46fe_9679_06ed565c0c34.slice/crio-4428e357f283831fc090c857fc8d7e39bb8c88d202a215b15386166b3cec3a44 WatchSource:0}: Error finding container 4428e357f283831fc090c857fc8d7e39bb8c88d202a215b15386166b3cec3a44: Status 404 returned error can't find the container with id 4428e357f283831fc090c857fc8d7e39bb8c88d202a215b15386166b3cec3a44 Sep 10 12:47:08.088025 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:08.087996 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hpmsl" Sep 10 12:47:08.108273 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:08.108243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" event={"ID":"08a75a92-087b-46fe-9679-06ed565c0c34","Type":"ContainerStarted","Data":"4428e357f283831fc090c857fc8d7e39bb8c88d202a215b15386166b3cec3a44"} Sep 10 12:47:09.770685 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:09.770653 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:47:10.120589 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:10.120508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" event={"ID":"08a75a92-087b-46fe-9679-06ed565c0c34","Type":"ContainerStarted","Data":"0400cad49df87cdfa22305147cda64ab172a8ec0bb1ca2eb957e20b2b20747cd"} Sep 10 12:47:10.140973 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:10.140788 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhcms" podStartSLOduration=1.557029103 podStartE2EDuration="3.14074745s" totalImagesPullingTime="1.583718347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:10.140287171 +0000 UTC m=+300.791250928" watchObservedRunningTime="2026-09-10 12:47:10.14074745 +0000 UTC m=+300.791711203" Sep 10 12:47:10.961313 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:10.961273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:11.216166 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:11.216102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:12.808745 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.808710 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9"] Sep 10 12:47:12.812268 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.812245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:12.814677 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.814654 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:47:12.815366 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.815348 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:47:12.815433 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.815348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvbs9\"" Sep 10 12:47:12.831412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.831385 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9"] Sep 10 12:47:12.912091 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.912045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8nlz\" (UniqueName: \"kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:12.912280 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.912133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:12.912448 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:12.912417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.013270 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.013236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8nlz\" (UniqueName: \"kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.013397 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.013275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.013397 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.013313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.013686 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.013667 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.013727 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.013682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.027305 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.027277 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8nlz\" (UniqueName: \"kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.057315 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.057289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:13.121657 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.121591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:13.404625 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:13.404599 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9"] Sep 10 12:47:13.407360 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:47:13.407331 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b96ae6_d9dd_4d9b_a2ba_c126e6286e06.slice/crio-84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed WatchSource:0}: Error finding container 84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed: Status 404 returned error can't find the container with id 84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed Sep 10 12:47:14.141027 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:14.140988 2579 generic.go:356] "Generic (PLEG): container finished" podID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerID="1bb126dbd761a338923cf23062f373f45334066d4df224e9d905f2cbe34ae3c0" exitCode=0 Sep 10 12:47:14.141381 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:14.141040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" event={"ID":"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06","Type":"ContainerDied","Data":"1bb126dbd761a338923cf23062f373f45334066d4df224e9d905f2cbe34ae3c0"} Sep 10 12:47:14.141381 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:14.141083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" event={"ID":"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06","Type":"ContainerStarted","Data":"84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed"} Sep 10 12:47:14.141531 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:14.141516 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:47:15.148140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:15.148053 2579 generic.go:356] "Generic (PLEG): container finished" podID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerID="bbda7892f15cf913aac3f9044d6c865b637696d55de75d351c2553eca2f97275" exitCode=0 Sep 10 12:47:15.148140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:15.148099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" event={"ID":"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06","Type":"ContainerDied","Data":"bbda7892f15cf913aac3f9044d6c865b637696d55de75d351c2553eca2f97275"} Sep 10 12:47:16.155700 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:16.155670 2579 generic.go:356] "Generic (PLEG): container finished" podID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerID="8bd3e53f2846ece90ef07c92ecc1256e59ffa74b6b55cd988169c7e7b61124c4" exitCode=0 Sep 10 12:47:16.156140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:16.155725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" event={"ID":"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06","Type":"ContainerDied","Data":"8bd3e53f2846ece90ef07c92ecc1256e59ffa74b6b55cd988169c7e7b61124c4"} Sep 10 12:47:17.281746 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.281717 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:17.449268 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.449244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8nlz\" (UniqueName: \"kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz\") pod \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " Sep 10 12:47:17.449439 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.449283 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util\") pod \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " Sep 10 12:47:17.449439 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.449301 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle\") pod \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\" (UID: \"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06\") " Sep 10 12:47:17.450012 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.449983 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle" (OuterVolumeSpecName: "bundle") pod "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" (UID: "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:17.451416 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.451393 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz" (OuterVolumeSpecName: "kube-api-access-v8nlz") pod "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" (UID: "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06"). InnerVolumeSpecName "kube-api-access-v8nlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:17.454895 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.454872 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util" (OuterVolumeSpecName: "util") pod "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" (UID: "17b96ae6-d9dd-4d9b-a2ba-c126e6286e06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:17.550426 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.550395 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8nlz\" (UniqueName: \"kubernetes.io/projected/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-kube-api-access-v8nlz\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:17.550426 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.550422 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:17.550594 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:17.550435 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b96ae6-d9dd-4d9b-a2ba-c126e6286e06-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:18.166249 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:18.166168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" event={"ID":"17b96ae6-d9dd-4d9b-a2ba-c126e6286e06","Type":"ContainerDied","Data":"84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed"} Sep 10 12:47:18.166249 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:18.166204 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh65q9" Sep 10 12:47:18.166249 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:18.166240 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84863a9ce29ff63d711e96316ac3ce5347af94e092ed218326115a36865891ed" Sep 10 12:47:24.627143 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:24.627106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:24.721960 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:24.721921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:28.866154 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.866120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:28.891915 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.891885 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb"] Sep 10 12:47:28.892226 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892214 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="pull" Sep 10 12:47:28.892266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892227 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="pull" Sep 10 12:47:28.892266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892246 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="extract" Sep 10 12:47:28.892266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892252 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="extract" Sep 10 12:47:28.892266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892263 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="util" Sep 10 12:47:28.892266 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892268 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="util" Sep 10 12:47:28.892409 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.892319 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b96ae6-d9dd-4d9b-a2ba-c126e6286e06" containerName="extract" Sep 10 12:47:28.898219 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.898194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:28.902438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.902419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvbs9\"" Sep 10 12:47:28.911251 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.911234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:47:28.911822 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.911807 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:47:28.939813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.939772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:28.939813 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.939796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:28.940022 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:28.939826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcwc\" (UniqueName: \"kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.040514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.040482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.040514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.040517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.040686 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.040549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcwc\" (UniqueName: \"kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.040892 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.040873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.040938 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.040903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.064185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.064154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcwc\" (UniqueName: \"kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.078257 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.078233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb"] Sep 10 12:47:29.146366 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.146296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:29.207408 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.207379 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:29.507912 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.507880 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb"] Sep 10 12:47:29.511523 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:47:29.511496 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711355bc_d14d_40b6_aa00_6ff3360c25e0.slice/crio-210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20 WatchSource:0}: Error finding container 210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20: Status 404 returned error can't find the container with id 210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20 Sep 10 12:47:29.640071 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:29.640043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:30.060682 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.060649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:30.220831 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.220793 2579 generic.go:356] "Generic (PLEG): container finished" podID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerID="dccc9c4a4d3d0bfe7bf012b246280d341907e3308f6b6cd20ba327b887b28e4d" exitCode=0 Sep 10 12:47:30.220991 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.220898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" event={"ID":"711355bc-d14d-40b6-aa00-6ff3360c25e0","Type":"ContainerDied","Data":"dccc9c4a4d3d0bfe7bf012b246280d341907e3308f6b6cd20ba327b887b28e4d"} Sep 10 12:47:30.220991 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.220939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" event={"ID":"711355bc-d14d-40b6-aa00-6ff3360c25e0","Type":"ContainerStarted","Data":"210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20"} Sep 10 12:47:30.230158 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.230130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:30.389615 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.389552 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw"] Sep 10 12:47:30.393185 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.393170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.398427 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.398409 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 12:47:30.398619 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.398580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 12:47:30.398735 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.398716 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:47:30.399579 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.399559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5947w\"" Sep 10 12:47:30.404455 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.404438 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:47:30.450345 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.450316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.450463 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.450352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-tmp\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.450463 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.450378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.450463 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.450450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx4qc\" (UniqueName: \"kubernetes.io/projected/ad0d408d-fcd2-4569-b546-8b40738a48e5-kube-api-access-vx4qc\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.450655 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.450498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-manifests\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.496482 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.496455 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw"] Sep 10 12:47:30.550863 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.550837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.551024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.550876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-tmp\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.551024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.550918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.551024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.550972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx4qc\" (UniqueName: \"kubernetes.io/projected/ad0d408d-fcd2-4569-b546-8b40738a48e5-kube-api-access-vx4qc\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.551024 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.551010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-manifests\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.551365 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.551337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-manifests\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.553315 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.553290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0d408d-fcd2-4569-b546-8b40738a48e5-tmp\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.553315 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.553312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.553464 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.553448 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad0d408d-fcd2-4569-b546-8b40738a48e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.575269 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.575238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx4qc\" (UniqueName: \"kubernetes.io/projected/ad0d408d-fcd2-4569-b546-8b40738a48e5-kube-api-access-vx4qc\") pod \"opendatahub-operator-controller-manager-5b549dd4b8-2k6bw\" (UID: \"ad0d408d-fcd2-4569-b546-8b40738a48e5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.614867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.614829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:30.703540 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.703509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:30.751025 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.750991 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:30.943059 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:30.943002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:31.023548 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.023521 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw"] Sep 10 12:47:31.050642 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:47:31.050611 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0d408d_fcd2_4569_b546_8b40738a48e5.slice/crio-e2a47352152d5908d1f7affd55559446109e092e322b297e1adf41aef71b7950 WatchSource:0}: Error finding container e2a47352152d5908d1f7affd55559446109e092e322b297e1adf41aef71b7950: Status 404 returned error can't find the container with id e2a47352152d5908d1f7affd55559446109e092e322b297e1adf41aef71b7950 Sep 10 12:47:31.056448 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.056427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:31.166249 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.166212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:31.226321 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.226289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" event={"ID":"ad0d408d-fcd2-4569-b546-8b40738a48e5","Type":"ContainerStarted","Data":"e2a47352152d5908d1f7affd55559446109e092e322b297e1adf41aef71b7950"} Sep 10 12:47:31.228128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.228055 2579 generic.go:356] "Generic (PLEG): container finished" podID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerID="75d5e1b6950ee91a686103058b6767846e24079e8158c467eb87d72c3d51cef5" exitCode=0 Sep 10 12:47:31.228243 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:31.228148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" event={"ID":"711355bc-d14d-40b6-aa00-6ff3360c25e0","Type":"ContainerDied","Data":"75d5e1b6950ee91a686103058b6767846e24079e8158c467eb87d72c3d51cef5"} Sep 10 12:47:32.238211 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:32.238063 2579 generic.go:356] "Generic (PLEG): container finished" podID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerID="5204e6ea502c22723cf15138594c6dba98da82e753a4766b3144409595cf5cc5" exitCode=0 Sep 10 12:47:32.238211 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:32.238142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" event={"ID":"711355bc-d14d-40b6-aa00-6ff3360c25e0","Type":"ContainerDied","Data":"5204e6ea502c22723cf15138594c6dba98da82e753a4766b3144409595cf5cc5"} Sep 10 12:47:34.164218 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.164195 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:34.185153 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.185131 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhcwc\" (UniqueName: \"kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc\") pod \"711355bc-d14d-40b6-aa00-6ff3360c25e0\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " Sep 10 12:47:34.185254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.185162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util\") pod \"711355bc-d14d-40b6-aa00-6ff3360c25e0\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " Sep 10 12:47:34.185254 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.185195 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle\") pod \"711355bc-d14d-40b6-aa00-6ff3360c25e0\" (UID: \"711355bc-d14d-40b6-aa00-6ff3360c25e0\") " Sep 10 12:47:34.185875 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.185850 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle" (OuterVolumeSpecName: "bundle") pod "711355bc-d14d-40b6-aa00-6ff3360c25e0" (UID: "711355bc-d14d-40b6-aa00-6ff3360c25e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:34.187132 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.187106 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc" (OuterVolumeSpecName: "kube-api-access-hhcwc") pod "711355bc-d14d-40b6-aa00-6ff3360c25e0" (UID: "711355bc-d14d-40b6-aa00-6ff3360c25e0"). InnerVolumeSpecName "kube-api-access-hhcwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:34.189747 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.189716 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util" (OuterVolumeSpecName: "util") pod "711355bc-d14d-40b6-aa00-6ff3360c25e0" (UID: "711355bc-d14d-40b6-aa00-6ff3360c25e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:34.249978 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.249950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" event={"ID":"711355bc-d14d-40b6-aa00-6ff3360c25e0","Type":"ContainerDied","Data":"210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20"} Sep 10 12:47:34.249978 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.249970 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjckb" Sep 10 12:47:34.250143 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.249998 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="210c3d5ed92fc6d5fbc6d5caf501b825cb53329f1ee04eed045f36ce5b1dec20" Sep 10 12:47:34.285891 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.285867 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhcwc\" (UniqueName: \"kubernetes.io/projected/711355bc-d14d-40b6-aa00-6ff3360c25e0-kube-api-access-hhcwc\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:34.285891 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.285890 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:34.286018 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:34.285899 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/711355bc-d14d-40b6-aa00-6ff3360c25e0-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:47:35.256624 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:35.256585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" event={"ID":"ad0d408d-fcd2-4569-b546-8b40738a48e5","Type":"ContainerStarted","Data":"0b393df2849805f9b4321d3e805982043050530c78c8abfbf970fe5b4f7091f4"} Sep 10 12:47:36.265558 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:36.265524 2579 generic.go:356] "Generic (PLEG): container finished" podID="ad0d408d-fcd2-4569-b546-8b40738a48e5" containerID="0b393df2849805f9b4321d3e805982043050530c78c8abfbf970fe5b4f7091f4" exitCode=0 Sep 10 12:47:36.266007 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:36.265614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" event={"ID":"ad0d408d-fcd2-4569-b546-8b40738a48e5","Type":"ContainerDied","Data":"0b393df2849805f9b4321d3e805982043050530c78c8abfbf970fe5b4f7091f4"} Sep 10 12:47:37.272495 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:37.272463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" event={"ID":"ad0d408d-fcd2-4569-b546-8b40738a48e5","Type":"ContainerStarted","Data":"8e4d991a960cdd2b6a233b0356130d60c0d2dd9744f3bd25ae1924c61b880834"} Sep 10 12:47:37.272895 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:37.272536 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:37.301788 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:37.301352 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" podStartSLOduration=2.633022927 podStartE2EDuration="7.30133168s" totalImagesPullingTime="3.646744706s" totalInitContainerRuntime="1.021564047s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:37.299797409 +0000 UTC m=+327.950761161" watchObservedRunningTime="2026-09-10 12:47:37.30133168 +0000 UTC m=+327.952295434" Sep 10 12:47:39.078179 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:39.078148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:41.132161 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:41.132123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:45.818470 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:45.818440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:45.918537 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:45.918499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:48.278898 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:48.278861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b549dd4b8-2k6bw" Sep 10 12:47:50.263431 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:50.263399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:50.583089 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:50.583015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:51.036397 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:51.036362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:51.195042 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:51.195015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:53.934614 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.934584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:53.940646 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940621 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:47:53.940952 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940940 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="util" Sep 10 12:47:53.941000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940953 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="util" Sep 10 12:47:53.941000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940968 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="pull" Sep 10 12:47:53.941000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940973 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="pull" Sep 10 12:47:53.941000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940980 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="extract" Sep 10 12:47:53.941000 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.940985 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="extract" Sep 10 12:47:53.941145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.941046 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="711355bc-d14d-40b6-aa00-6ff3360c25e0" containerName="extract" Sep 10 12:47:53.949365 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.949348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:53.952660 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.952638 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 12:47:53.952883 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.952866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 12:47:53.952937 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.952900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s8z5j\"" Sep 10 12:47:53.953166 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.953150 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 12:47:53.953334 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.953320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 12:47:53.953401 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.953389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 12:47:53.953561 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.953548 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 12:47:53.965961 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:53.965940 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:47:54.055074 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055232 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055415 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhjq\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.055415 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.055318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.057113 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.057086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:54.155848 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.155994 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.155994 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.155994 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.155994 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhjq\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.155994 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.155974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.156314 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.156013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.156674 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.156648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.158360 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.158335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.158460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.158348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.158460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.158405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.158460 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.158422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.174875 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.174854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhjq\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.175833 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.175813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-75hnj\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.258376 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.258307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:54.542039 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:54.542016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:47:54.544589 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:47:54.544563 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5767ec_8e95_4737_a032_bbef793f122f.slice/crio-f67a264c1e2402fb6949aaab251446030e337b31e2e8a1c2c29a776d36fb523e WatchSource:0}: Error finding container f67a264c1e2402fb6949aaab251446030e337b31e2e8a1c2c29a776d36fb523e: Status 404 returned error can't find the container with id f67a264c1e2402fb6949aaab251446030e337b31e2e8a1c2c29a776d36fb523e Sep 10 12:47:55.357166 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:55.357128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" event={"ID":"cb5767ec-8e95-4737-a032-bbef793f122f","Type":"ContainerStarted","Data":"f67a264c1e2402fb6949aaab251446030e337b31e2e8a1c2c29a776d36fb523e"} Sep 10 12:47:55.667398 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:55.667323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:56.871533 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:56.871490 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:47:56.871837 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:56.871558 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:47:57.370723 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.370688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" event={"ID":"cb5767ec-8e95-4737-a032-bbef793f122f","Type":"ContainerStarted","Data":"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749"} Sep 10 12:47:57.371159 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.370927 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:47:57.372658 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.372633 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-75hnj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 12:47:57.372787 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.372680 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 12:47:57.760063 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.760027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:57.862202 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:57.862172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:58.375869 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:58.375836 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-75hnj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 12:47:58.376243 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:58.375888 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 12:47:58.746580 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:58.746541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:58.999807 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:58.999704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:47:59.119723 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:47:59.119687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:01.376273 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:01.376239 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:48:01.405622 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:01.405573 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" podStartSLOduration=6.080916728 podStartE2EDuration="8.405558157s" totalImagesPullingTime="2.324641429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:57.400860004 +0000 UTC m=+348.051823755" watchObservedRunningTime="2026-09-10 12:48:01.405558157 +0000 UTC m=+352.056521910" Sep 10 12:48:01.425356 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:01.425329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:01.581352 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:01.581323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:01.682944 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:01.682919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:02.085406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:02.085302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:02.332034 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:02.332001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:02.444693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:02.444667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:09.661137 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.661099 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85854c564c-7749f"] Sep 10 12:48:09.668161 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.668133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.671840 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.671813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 12:48:09.671973 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.671855 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 12:48:09.671973 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.671881 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 12:48:09.671973 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.671862 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c9b6b\"" Sep 10 12:48:09.682060 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.682033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85854c564c-7749f"] Sep 10 12:48:09.802917 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.802883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.803078 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.802928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef86d821-c1d9-4a30-ba11-a1e94589e197-manager-config\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.803078 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.802995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4xwr\" (UniqueName: \"kubernetes.io/projected/ef86d821-c1d9-4a30-ba11-a1e94589e197-kube-api-access-w4xwr\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.803151 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.803074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-metrics-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.904406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.904364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-metrics-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.904637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.904427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.904637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.904461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef86d821-c1d9-4a30-ba11-a1e94589e197-manager-config\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.904637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.904518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4xwr\" (UniqueName: \"kubernetes.io/projected/ef86d821-c1d9-4a30-ba11-a1e94589e197-kube-api-access-w4xwr\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.908839 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.908812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 12:48:09.909283 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.909263 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 12:48:09.909612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.909598 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 12:48:09.916086 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.916031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef86d821-c1d9-4a30-ba11-a1e94589e197-manager-config\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.917805 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.917782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.917975 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.917958 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef86d821-c1d9-4a30-ba11-a1e94589e197-metrics-cert\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.938598 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.938574 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4xwr\" (UniqueName: \"kubernetes.io/projected/ef86d821-c1d9-4a30-ba11-a1e94589e197-kube-api-access-w4xwr\") pod \"lws-controller-manager-85854c564c-7749f\" (UID: \"ef86d821-c1d9-4a30-ba11-a1e94589e197\") " pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:09.981022 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.980991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c9b6b\"" Sep 10 12:48:09.987442 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:09.987421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:10.285681 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:10.285656 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85854c564c-7749f"] Sep 10 12:48:10.287638 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:48:10.287613 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef86d821_c1d9_4a30_ba11_a1e94589e197.slice/crio-53415d243a2a8dc862cab59405e3e6e5baa5a2ae03101edb87fd08992c1ba5c4 WatchSource:0}: Error finding container 53415d243a2a8dc862cab59405e3e6e5baa5a2ae03101edb87fd08992c1ba5c4: Status 404 returned error can't find the container with id 53415d243a2a8dc862cab59405e3e6e5baa5a2ae03101edb87fd08992c1ba5c4 Sep 10 12:48:10.434208 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:10.434174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" event={"ID":"ef86d821-c1d9-4a30-ba11-a1e94589e197","Type":"ContainerStarted","Data":"53415d243a2a8dc862cab59405e3e6e5baa5a2ae03101edb87fd08992c1ba5c4"} Sep 10 12:48:12.446377 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:12.446337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" event={"ID":"ef86d821-c1d9-4a30-ba11-a1e94589e197","Type":"ContainerStarted","Data":"be1e8274561da3ce940c85f29f7432ac57922d5c9643deebef8234effb46cecc"} Sep 10 12:48:12.446753 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:12.446481 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:12.474620 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:12.474573 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" podStartSLOduration=2.039850814 podStartE2EDuration="3.474557661s" totalImagesPullingTime="1.434706847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:48:12.473562674 +0000 UTC m=+363.124526440" watchObservedRunningTime="2026-09-10 12:48:12.474557661 +0000 UTC m=+363.125521414" Sep 10 12:48:13.758505 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:13.758473 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:48:13.758936 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:13.758700 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" containerID="cri-o://cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749" gracePeriod=30 Sep 10 12:48:13.851144 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:13.851109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:14.007382 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.007353 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:48:14.035555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035530 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035554 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzhjq\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035617 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035642 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.035941 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.035719 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap\") pod \"cb5767ec-8e95-4737-a032-bbef793f122f\" (UID: \"cb5767ec-8e95-4737-a032-bbef793f122f\") " Sep 10 12:48:14.036406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.036359 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:48:14.037978 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.037951 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts" (OuterVolumeSpecName: "cacerts") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:48:14.038064 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.038003 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:48:14.038181 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.038152 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:48:14.038181 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.038151 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs" (OuterVolumeSpecName: "local-certs") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:48:14.038303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.038201 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq" (OuterVolumeSpecName: "kube-api-access-mzhjq") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "kube-api-access-mzhjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:48:14.038303 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.038262 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cb5767ec-8e95-4737-a032-bbef793f122f" (UID: "cb5767ec-8e95-4737-a032-bbef793f122f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:48:14.058099 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.058074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:14.136910 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136875 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-ca-configmap\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.136910 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136899 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-istio-token\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.136910 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136909 2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-kubeconfig\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.136910 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136917 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzhjq\" (UniqueName: \"kubernetes.io/projected/cb5767ec-8e95-4737-a032-bbef793f122f-kube-api-access-mzhjq\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.137145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136925 2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-cacerts\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.137145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136936 2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb5767ec-8e95-4737-a032-bbef793f122f-local-certs\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.137145 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.136944 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb5767ec-8e95-4737-a032-bbef793f122f-istio-csr-dns-cert\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:48:14.302026 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.301948 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl"] Sep 10 12:48:14.302336 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.302323 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" Sep 10 12:48:14.302378 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.302338 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" Sep 10 12:48:14.302420 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.302403 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" containerName="discovery" Sep 10 12:48:14.304769 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.304744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.325998 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.325970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 12:48:14.326285 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.326264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:14.327282 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.327266 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rt5zh\"" Sep 10 12:48:14.336200 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.336179 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl"] Sep 10 12:48:14.338464 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.338445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a15a009-c259-4586-b462-2841e5331b1a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.338550 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.338502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsb5\" (UniqueName: \"kubernetes.io/projected/0a15a009-c259-4586-b462-2841e5331b1a-kube-api-access-xcsb5\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.439642 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.439607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a15a009-c259-4586-b462-2841e5331b1a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.439824 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.439690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsb5\" (UniqueName: \"kubernetes.io/projected/0a15a009-c259-4586-b462-2841e5331b1a-kube-api-access-xcsb5\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.442021 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.441994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a15a009-c259-4586-b462-2841e5331b1a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.451710 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.451686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsb5\" (UniqueName: \"kubernetes.io/projected/0a15a009-c259-4586-b462-2841e5331b1a-kube-api-access-xcsb5\") pod \"llmisvc-controller-manager-777c6bd7d5-48jgl\" (UID: \"0a15a009-c259-4586-b462-2841e5331b1a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.457744 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.457720 2579 generic.go:356] "Generic (PLEG): container finished" podID="cb5767ec-8e95-4737-a032-bbef793f122f" containerID="cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749" exitCode=0 Sep 10 12:48:14.457843 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.457753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" event={"ID":"cb5767ec-8e95-4737-a032-bbef793f122f","Type":"ContainerDied","Data":"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749"} Sep 10 12:48:14.457843 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.457825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" event={"ID":"cb5767ec-8e95-4737-a032-bbef793f122f","Type":"ContainerDied","Data":"f67a264c1e2402fb6949aaab251446030e337b31e2e8a1c2c29a776d36fb523e"} Sep 10 12:48:14.457915 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.457846 2579 scope.go:117] "RemoveContainer" containerID="cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749" Sep 10 12:48:14.457915 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.457784 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj" Sep 10 12:48:14.467095 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.467076 2579 scope.go:117] "RemoveContainer" containerID="cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749" Sep 10 12:48:14.467354 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:48:14.467336 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749\": container with ID starting with cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749 not found: ID does not exist" containerID="cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749" Sep 10 12:48:14.467414 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.467361 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749"} err="failed to get container status \"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749\": rpc error: code = NotFound desc = could not find container \"cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749\": container with ID starting with cba24f4762a4c68271686b27f9e80a65d8d27746e758e71d7b38556830244749 not found: ID does not exist" Sep 10 12:48:14.492745 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.492719 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:48:14.497216 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.497196 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75hnj"] Sep 10 12:48:14.613890 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.613815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:14.923459 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:14.923436 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl"] Sep 10 12:48:14.925026 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:48:14.924991 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0a15a009_c259_4586_b462_2841e5331b1a.slice/crio-8a88dc5330350f4ce36858927088e61416df75755a35b4a2e9f4d66a5483ab4d WatchSource:0}: Error finding container 8a88dc5330350f4ce36858927088e61416df75755a35b4a2e9f4d66a5483ab4d: Status 404 returned error can't find the container with id 8a88dc5330350f4ce36858927088e61416df75755a35b4a2e9f4d66a5483ab4d Sep 10 12:48:15.470283 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:15.470237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" event={"ID":"0a15a009-c259-4586-b462-2841e5331b1a","Type":"ContainerStarted","Data":"8a88dc5330350f4ce36858927088e61416df75755a35b4a2e9f4d66a5483ab4d"} Sep 10 12:48:15.563960 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:15.563922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:15.750853 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:15.750735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:15.830327 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:15.830295 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5767ec-8e95-4737-a032-bbef793f122f" path="/var/lib/kubelet/pods/cb5767ec-8e95-4737-a032-bbef793f122f/volumes" Sep 10 12:48:16.146514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:16.146434 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:17.724013 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:17.723992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:18.491038 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:18.491005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" event={"ID":"0a15a009-c259-4586-b462-2841e5331b1a","Type":"ContainerStarted","Data":"b7a70e59f5728693067bb03b476466e78d7305e08f2d59fd2f3370583a7cf788"} Sep 10 12:48:18.491226 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:18.491127 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:18.519734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:18.519678 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" podStartSLOduration=1.84360392 podStartE2EDuration="4.519662002s" totalImagesPullingTime="2.676058082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:48:18.517830721 +0000 UTC m=+369.168794514" watchObservedRunningTime="2026-09-10 12:48:18.519662002 +0000 UTC m=+369.170625754" Sep 10 12:48:23.454602 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:23.454570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85854c564c-7749f" Sep 10 12:48:37.177748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:37.177711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:37.314073 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:37.314040 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:49.498826 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:49.498794 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-48jgl" Sep 10 12:48:49.645539 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:49.645504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:49.808341 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:49.808250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:50.275118 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:50.275081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:48:50.423931 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:48:50.423896 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:01.072378 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:01.072340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:01.188447 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:01.188408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:02.441454 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:02.441422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:02.668867 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:02.668838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:09.770899 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.770869 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb"] Sep 10 12:49:09.774826 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.774806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:09.783929 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.783908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:49:09.785362 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.785342 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kvbs9\"" Sep 10 12:49:09.785457 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.785400 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:49:09.796456 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.796427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb"] Sep 10 12:49:09.905236 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.905201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:09.905236 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.905241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:09.905489 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.905363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vkzs\" (UniqueName: \"kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:09.976769 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.976726 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr"] Sep 10 12:49:09.981429 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.981412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:09.999471 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:09.999445 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr"] Sep 10 12:49:10.005947 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.005926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.006047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.005954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.006047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.005981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vkzs\" (UniqueName: \"kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.006269 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.006252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.006354 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.006332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.027576 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.027518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vkzs\" (UniqueName: \"kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.083299 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.083274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:10.106440 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.106413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.106557 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.106452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.106557 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.106487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnr8g\" (UniqueName: \"kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.120086 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.120060 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6"] Sep 10 12:49:10.124246 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.124226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.139798 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.139772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6"] Sep 10 12:49:10.207435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.207597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l688\" (UniqueName: \"kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.207597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.207597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.207714 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnr8g\" (UniqueName: \"kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.207714 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.207823 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.207909 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.207889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.220036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.220009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnr8g\" (UniqueName: \"kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.275785 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.275742 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292"] Sep 10 12:49:10.279323 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.279281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.290135 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.290118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:10.296960 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.296939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292"] Sep 10 12:49:10.309033 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.309008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.309152 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.309050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.309152 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.309097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l688\" (UniqueName: \"kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.309515 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.309492 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.309585 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.309499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.325904 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.325879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l688\" (UniqueName: \"kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.373131 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.373104 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb"] Sep 10 12:49:10.376742 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:10.376718 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d17309d_3cd8_4185_b01b_6efae68eb962.slice/crio-b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610 WatchSource:0}: Error finding container b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610: Status 404 returned error can't find the container with id b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610 Sep 10 12:49:10.409708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.409683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.409823 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.409750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.409823 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.409802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szmk\" (UniqueName: \"kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.435481 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.435461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:10.510921 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.510890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.511051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.510992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.511051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.511022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szmk\" (UniqueName: \"kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.511269 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.511247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.511310 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.511298 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.528222 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.528202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szmk\" (UniqueName: \"kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.575435 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.575410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr"] Sep 10 12:49:10.578700 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:10.578676 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c73203_ad78_415e_b5e7_1baa958e58a5.slice/crio-75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666 WatchSource:0}: Error finding container 75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666: Status 404 returned error can't find the container with id 75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666 Sep 10 12:49:10.588428 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.588410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:10.716152 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.716124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6"] Sep 10 12:49:10.743872 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.743838 2579 generic.go:356] "Generic (PLEG): container finished" podID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerID="c3ff62f5238569522f80238fb0c42443a14ca1f4f8db36a3abcbe9868e3f37a9" exitCode=0 Sep 10 12:49:10.743964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.743877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" event={"ID":"12c73203-ad78-415e-b5e7-1baa958e58a5","Type":"ContainerDied","Data":"c3ff62f5238569522f80238fb0c42443a14ca1f4f8db36a3abcbe9868e3f37a9"} Sep 10 12:49:10.743964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.743917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" event={"ID":"12c73203-ad78-415e-b5e7-1baa958e58a5","Type":"ContainerStarted","Data":"75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666"} Sep 10 12:49:10.745621 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.745597 2579 generic.go:356] "Generic (PLEG): container finished" podID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerID="5936aee0c612d3fc3aa3d188db505c22908801b607bf94e2619f70e8ee944148" exitCode=0 Sep 10 12:49:10.745694 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.745625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" event={"ID":"7d17309d-3cd8-4185-b01b-6efae68eb962","Type":"ContainerDied","Data":"5936aee0c612d3fc3aa3d188db505c22908801b607bf94e2619f70e8ee944148"} Sep 10 12:49:10.745694 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.745677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" event={"ID":"7d17309d-3cd8-4185-b01b-6efae68eb962","Type":"ContainerStarted","Data":"b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610"} Sep 10 12:49:10.750545 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:10.750524 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c49e1a_27b1_4fbf_b561_ac222f3b56e2.slice/crio-33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7 WatchSource:0}: Error finding container 33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7: Status 404 returned error can't find the container with id 33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7 Sep 10 12:49:10.873344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:10.873316 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292"] Sep 10 12:49:10.914787 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:10.914737 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6683d7ba_dcbc_432b_a911_c2f507b54920.slice/crio-91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049 WatchSource:0}: Error finding container 91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049: Status 404 returned error can't find the container with id 91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049 Sep 10 12:49:11.753730 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.753696 2579 generic.go:356] "Generic (PLEG): container finished" podID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerID="7e1f15d188ab66033fdae495dc7fc43caef0b5bc0f79fa5de8298b88ac589d91" exitCode=0 Sep 10 12:49:11.753911 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.753730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" event={"ID":"6683d7ba-dcbc-432b-a911-c2f507b54920","Type":"ContainerDied","Data":"7e1f15d188ab66033fdae495dc7fc43caef0b5bc0f79fa5de8298b88ac589d91"} Sep 10 12:49:11.753911 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.753794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" event={"ID":"6683d7ba-dcbc-432b-a911-c2f507b54920","Type":"ContainerStarted","Data":"91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049"} Sep 10 12:49:11.755608 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.755585 2579 generic.go:356] "Generic (PLEG): container finished" podID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerID="07890d11a18dbe14c4a2f2207ce3fb5ba3c54197c2a996b0294dde5e6d271885" exitCode=0 Sep 10 12:49:11.755700 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.755615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" event={"ID":"96c49e1a-27b1-4fbf-b561-ac222f3b56e2","Type":"ContainerDied","Data":"07890d11a18dbe14c4a2f2207ce3fb5ba3c54197c2a996b0294dde5e6d271885"} Sep 10 12:49:11.755700 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:11.755662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" event={"ID":"96c49e1a-27b1-4fbf-b561-ac222f3b56e2","Type":"ContainerStarted","Data":"33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7"} Sep 10 12:49:12.763321 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:12.763283 2579 generic.go:356] "Generic (PLEG): container finished" podID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerID="f051da098a0622a16d78fe0da8ab6f5ffefada670bfd1ebe7538085aae5d1c81" exitCode=0 Sep 10 12:49:12.763740 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:12.763371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" event={"ID":"7d17309d-3cd8-4185-b01b-6efae68eb962","Type":"ContainerDied","Data":"f051da098a0622a16d78fe0da8ab6f5ffefada670bfd1ebe7538085aae5d1c81"} Sep 10 12:49:12.765438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:12.765411 2579 generic.go:356] "Generic (PLEG): container finished" podID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerID="1d5709f1400884e88c3abf7d00a97c5cedb3796d87d1636d27f27453c1f79bf9" exitCode=0 Sep 10 12:49:12.765533 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:12.765492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" event={"ID":"12c73203-ad78-415e-b5e7-1baa958e58a5","Type":"ContainerDied","Data":"1d5709f1400884e88c3abf7d00a97c5cedb3796d87d1636d27f27453c1f79bf9"} Sep 10 12:49:13.773375 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.773339 2579 generic.go:356] "Generic (PLEG): container finished" podID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerID="44ad48b62a56db2ab60514d8f29dbda0fd885f3a08399f84e365483350fb36c8" exitCode=0 Sep 10 12:49:13.773792 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.773429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" event={"ID":"7d17309d-3cd8-4185-b01b-6efae68eb962","Type":"ContainerDied","Data":"44ad48b62a56db2ab60514d8f29dbda0fd885f3a08399f84e365483350fb36c8"} Sep 10 12:49:13.775514 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.775490 2579 generic.go:356] "Generic (PLEG): container finished" podID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerID="0621c393297ec2953b6ee6f821881980b9f694f5ba46ce5ba708bbe01d00810a" exitCode=0 Sep 10 12:49:13.775636 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.775554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" event={"ID":"12c73203-ad78-415e-b5e7-1baa958e58a5","Type":"ContainerDied","Data":"0621c393297ec2953b6ee6f821881980b9f694f5ba46ce5ba708bbe01d00810a"} Sep 10 12:49:13.777227 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.777202 2579 generic.go:356] "Generic (PLEG): container finished" podID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerID="a38a7192bedd5b1e111e19e2232c0234ad2ed11ac3205771818b48911d907042" exitCode=0 Sep 10 12:49:13.777314 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.777289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" event={"ID":"6683d7ba-dcbc-432b-a911-c2f507b54920","Type":"ContainerDied","Data":"a38a7192bedd5b1e111e19e2232c0234ad2ed11ac3205771818b48911d907042"} Sep 10 12:49:13.779213 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.779197 2579 generic.go:356] "Generic (PLEG): container finished" podID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerID="83d301b51f688522cb339dc4a2f2790300879561db60903a89408b8156f440d0" exitCode=0 Sep 10 12:49:13.779275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:13.779262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" event={"ID":"96c49e1a-27b1-4fbf-b561-ac222f3b56e2","Type":"ContainerDied","Data":"83d301b51f688522cb339dc4a2f2790300879561db60903a89408b8156f440d0"} Sep 10 12:49:14.787061 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.787027 2579 generic.go:356] "Generic (PLEG): container finished" podID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerID="c3a7ffb8621369abb767d3c9d0a8332c46f79bee0c488459eb296b640b5853bf" exitCode=0 Sep 10 12:49:14.787454 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.787146 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" event={"ID":"96c49e1a-27b1-4fbf-b561-ac222f3b56e2","Type":"ContainerDied","Data":"c3a7ffb8621369abb767d3c9d0a8332c46f79bee0c488459eb296b640b5853bf"} Sep 10 12:49:14.789262 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.789238 2579 generic.go:356] "Generic (PLEG): container finished" podID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerID="7244e2134618a755141106512b5c99ff8bebd02366825bc2c9f1eef78627736b" exitCode=0 Sep 10 12:49:14.789368 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.789310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" event={"ID":"6683d7ba-dcbc-432b-a911-c2f507b54920","Type":"ContainerDied","Data":"7244e2134618a755141106512b5c99ff8bebd02366825bc2c9f1eef78627736b"} Sep 10 12:49:14.944693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.944670 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:14.947418 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:14.947394 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:15.053797 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053701 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util\") pod \"7d17309d-3cd8-4185-b01b-6efae68eb962\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " Sep 10 12:49:15.053797 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053751 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle\") pod \"7d17309d-3cd8-4185-b01b-6efae68eb962\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " Sep 10 12:49:15.054014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053798 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle\") pod \"12c73203-ad78-415e-b5e7-1baa958e58a5\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " Sep 10 12:49:15.054014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnr8g\" (UniqueName: \"kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g\") pod \"12c73203-ad78-415e-b5e7-1baa958e58a5\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " Sep 10 12:49:15.054014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053839 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vkzs\" (UniqueName: \"kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs\") pod \"7d17309d-3cd8-4185-b01b-6efae68eb962\" (UID: \"7d17309d-3cd8-4185-b01b-6efae68eb962\") " Sep 10 12:49:15.054014 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.053887 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util\") pod \"12c73203-ad78-415e-b5e7-1baa958e58a5\" (UID: \"12c73203-ad78-415e-b5e7-1baa958e58a5\") " Sep 10 12:49:15.054286 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.054256 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle" (OuterVolumeSpecName: "bundle") pod "7d17309d-3cd8-4185-b01b-6efae68eb962" (UID: "7d17309d-3cd8-4185-b01b-6efae68eb962"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:15.054637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.054606 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle" (OuterVolumeSpecName: "bundle") pod "12c73203-ad78-415e-b5e7-1baa958e58a5" (UID: "12c73203-ad78-415e-b5e7-1baa958e58a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:15.056070 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.056044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs" (OuterVolumeSpecName: "kube-api-access-7vkzs") pod "7d17309d-3cd8-4185-b01b-6efae68eb962" (UID: "7d17309d-3cd8-4185-b01b-6efae68eb962"). InnerVolumeSpecName "kube-api-access-7vkzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:15.056177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.056082 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g" (OuterVolumeSpecName: "kube-api-access-vnr8g") pod "12c73203-ad78-415e-b5e7-1baa958e58a5" (UID: "12c73203-ad78-415e-b5e7-1baa958e58a5"). InnerVolumeSpecName "kube-api-access-vnr8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:15.059568 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.059528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util" (OuterVolumeSpecName: "util") pod "7d17309d-3cd8-4185-b01b-6efae68eb962" (UID: "7d17309d-3cd8-4185-b01b-6efae68eb962"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:15.059666 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.059592 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util" (OuterVolumeSpecName: "util") pod "12c73203-ad78-415e-b5e7-1baa958e58a5" (UID: "12c73203-ad78-415e-b5e7-1baa958e58a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:15.154702 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154666 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.154702 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154699 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnr8g\" (UniqueName: \"kubernetes.io/projected/12c73203-ad78-415e-b5e7-1baa958e58a5-kube-api-access-vnr8g\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.154702 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154709 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vkzs\" (UniqueName: \"kubernetes.io/projected/7d17309d-3cd8-4185-b01b-6efae68eb962-kube-api-access-7vkzs\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.154903 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154718 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c73203-ad78-415e-b5e7-1baa958e58a5-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.154903 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154726 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.154903 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.154733 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d17309d-3cd8-4185-b01b-6efae68eb962-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:15.797528 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.797497 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" Sep 10 12:49:15.797528 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.797510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6x7zxb" event={"ID":"7d17309d-3cd8-4185-b01b-6efae68eb962","Type":"ContainerDied","Data":"b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610"} Sep 10 12:49:15.798080 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.797581 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8906744597117661b2a2cf2c373efc53d6e0b1efcdef66c9bbb60b4613fe610" Sep 10 12:49:15.799453 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.799432 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" Sep 10 12:49:15.799575 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.799457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ax5mgr" event={"ID":"12c73203-ad78-415e-b5e7-1baa958e58a5","Type":"ContainerDied","Data":"75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666"} Sep 10 12:49:15.799575 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.799504 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75a5853be895e88c3e13b7cb8d0615fac2f75d1ecbda6adbbbffc6f20f734666" Sep 10 12:49:15.953646 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.953624 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:15.955617 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:15.955601 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:16.063168 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063103 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util\") pod \"6683d7ba-dcbc-432b-a911-c2f507b54920\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " Sep 10 12:49:16.063296 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle\") pod \"6683d7ba-dcbc-432b-a911-c2f507b54920\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " Sep 10 12:49:16.063296 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063215 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util\") pod \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " Sep 10 12:49:16.063296 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l688\" (UniqueName: \"kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688\") pod \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " Sep 10 12:49:16.063296 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063272 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle\") pod \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\" (UID: \"96c49e1a-27b1-4fbf-b561-ac222f3b56e2\") " Sep 10 12:49:16.063500 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063295 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4szmk\" (UniqueName: \"kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk\") pod \"6683d7ba-dcbc-432b-a911-c2f507b54920\" (UID: \"6683d7ba-dcbc-432b-a911-c2f507b54920\") " Sep 10 12:49:16.063755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063724 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle" (OuterVolumeSpecName: "bundle") pod "6683d7ba-dcbc-432b-a911-c2f507b54920" (UID: "6683d7ba-dcbc-432b-a911-c2f507b54920"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:16.063922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.063839 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle" (OuterVolumeSpecName: "bundle") pod "96c49e1a-27b1-4fbf-b561-ac222f3b56e2" (UID: "96c49e1a-27b1-4fbf-b561-ac222f3b56e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:16.065438 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.065406 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688" (OuterVolumeSpecName: "kube-api-access-5l688") pod "96c49e1a-27b1-4fbf-b561-ac222f3b56e2" (UID: "96c49e1a-27b1-4fbf-b561-ac222f3b56e2"). InnerVolumeSpecName "kube-api-access-5l688". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:16.065550 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.065474 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk" (OuterVolumeSpecName: "kube-api-access-4szmk") pod "6683d7ba-dcbc-432b-a911-c2f507b54920" (UID: "6683d7ba-dcbc-432b-a911-c2f507b54920"). InnerVolumeSpecName "kube-api-access-4szmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:16.070975 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.070953 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util" (OuterVolumeSpecName: "util") pod "6683d7ba-dcbc-432b-a911-c2f507b54920" (UID: "6683d7ba-dcbc-432b-a911-c2f507b54920"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:16.088268 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.088245 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util" (OuterVolumeSpecName: "util") pod "96c49e1a-27b1-4fbf-b561-ac222f3b56e2" (UID: "96c49e1a-27b1-4fbf-b561-ac222f3b56e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:16.164828 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164802 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.164828 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164823 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6683d7ba-dcbc-432b-a911-c2f507b54920-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.164828 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164832 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-util\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.165015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164842 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l688\" (UniqueName: \"kubernetes.io/projected/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-kube-api-access-5l688\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.165015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164852 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96c49e1a-27b1-4fbf-b561-ac222f3b56e2-bundle\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.165015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.164860 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4szmk\" (UniqueName: \"kubernetes.io/projected/6683d7ba-dcbc-432b-a911-c2f507b54920-kube-api-access-4szmk\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:16.807218 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.807187 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" Sep 10 12:49:16.807645 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.807187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hl292" event={"ID":"6683d7ba-dcbc-432b-a911-c2f507b54920","Type":"ContainerDied","Data":"91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049"} Sep 10 12:49:16.807645 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.807315 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91fdcafbe499be2c77c69f43413469e9483b318a8f234fdfb74225730bee6049" Sep 10 12:49:16.809206 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.809174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" event={"ID":"96c49e1a-27b1-4fbf-b561-ac222f3b56e2","Type":"ContainerDied","Data":"33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7"} Sep 10 12:49:16.809358 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.809209 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5phm6" Sep 10 12:49:16.809358 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:16.809214 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33117d5d2e29477e39ee7d89745952a8cf6c2c26e1411ca51b94570f372aefe7" Sep 10 12:49:18.108275 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:18.108238 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:18.251900 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:18.251866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:18.656586 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:18.656553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:19.451053 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:19.451021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:19.860974 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:19.860888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:22.131745 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.131711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:22.883833 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.883801 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg"] Sep 10 12:49:22.884157 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884144 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="util" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884159 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="util" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884167 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="pull" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884173 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="pull" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884184 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="util" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884190 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="util" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884197 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="pull" Sep 10 12:49:22.884201 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884202 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="pull" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884212 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884217 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884225 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="util" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884230 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="util" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884237 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="util" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884242 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="util" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884247 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884253 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884262 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884267 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884272 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884277 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884285 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="pull" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884290 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="pull" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884297 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="pull" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884301 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="pull" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884353 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c73203-ad78-415e-b5e7-1baa958e58a5" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884361 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d17309d-3cd8-4185-b01b-6efae68eb962" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884366 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6683d7ba-dcbc-432b-a911-c2f507b54920" containerName="extract" Sep 10 12:49:22.884406 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.884372 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c49e1a-27b1-4fbf-b561-ac222f3b56e2" containerName="extract" Sep 10 12:49:22.888567 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.888550 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:22.893595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.893574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jthqz\"" Sep 10 12:49:22.894279 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.894264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 12:49:22.900393 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.900374 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 12:49:22.907136 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.907112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg"] Sep 10 12:49:22.922192 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.922161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6nz\" (UniqueName: \"kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:22.922295 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:22.922243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.022704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.022667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.022897 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.022803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6nz\" (UniqueName: \"kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.023148 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.023125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.036554 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.036526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6nz\" (UniqueName: \"kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4hjhg\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.039368 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.039345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:23.198734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.198711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:23.517332 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.517211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:23.559681 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:23.559653 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc9ea6d_2f1f_4612_8083_c2ed1909c613.slice/crio-d188eac4dfe67eff3a8637fdcdb90e6a6c6f84de9796bdc4c4fab9e30d7b079e WatchSource:0}: Error finding container d188eac4dfe67eff3a8637fdcdb90e6a6c6f84de9796bdc4c4fab9e30d7b079e: Status 404 returned error can't find the container with id d188eac4dfe67eff3a8637fdcdb90e6a6c6f84de9796bdc4c4fab9e30d7b079e Sep 10 12:49:23.565864 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.565839 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg"] Sep 10 12:49:23.773780 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.773667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:23.846596 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.846565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" event={"ID":"cdc9ea6d-2f1f-4612-8083-c2ed1909c613","Type":"ContainerStarted","Data":"d188eac4dfe67eff3a8637fdcdb90e6a6c6f84de9796bdc4c4fab9e30d7b079e"} Sep 10 12:49:23.918974 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:23.918926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:26.070892 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:26.070861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:27.646848 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.646806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:27.854642 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.854620 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn"] Sep 10 12:49:27.858546 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.858530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:27.872667 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.872643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" event={"ID":"cdc9ea6d-2f1f-4612-8083-c2ed1909c613","Type":"ContainerStarted","Data":"9cc535d490a18d56d73553d0e6ef5ec8408f08dd17cc3ac2024bb3ccf38af728"} Sep 10 12:49:27.872750 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.872705 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:27.880458 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.880443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 12:49:27.891392 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.891373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn"] Sep 10 12:49:27.917790 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.917703 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j86rz\"" Sep 10 12:49:27.967918 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:27.967887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8hjf\" (UniqueName: \"kubernetes.io/projected/2d44ad79-d802-4d94-aeef-4cb3c87e5095-kube-api-access-c8hjf\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjzmn\" (UID: \"2d44ad79-d802-4d94-aeef-4cb3c87e5095\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:28.063615 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.063562 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" podStartSLOduration=1.828975556 podStartE2EDuration="6.063542871s" totalImagesPullingTime="4.234567315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:28.062308679 +0000 UTC m=+438.713272431" watchObservedRunningTime="2026-09-10 12:49:28.063542871 +0000 UTC m=+438.714506626" Sep 10 12:49:28.068755 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.068728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8hjf\" (UniqueName: \"kubernetes.io/projected/2d44ad79-d802-4d94-aeef-4cb3c87e5095-kube-api-access-c8hjf\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjzmn\" (UID: \"2d44ad79-d802-4d94-aeef-4cb3c87e5095\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:28.115063 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.115035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8hjf\" (UniqueName: \"kubernetes.io/projected/2d44ad79-d802-4d94-aeef-4cb3c87e5095-kube-api-access-c8hjf\") pod \"dns-operator-controller-manager-7b84cd7c9c-wjzmn\" (UID: \"2d44ad79-d802-4d94-aeef-4cb3c87e5095\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:28.170676 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.170614 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:28.383401 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.383366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:28.490574 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:28.490539 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d44ad79_d802_4d94_aeef_4cb3c87e5095.slice/crio-b487dc56efc21e0cb896a4877a776eab8c5d74bf44193706c38c0dadb3913ab2 WatchSource:0}: Error finding container b487dc56efc21e0cb896a4877a776eab8c5d74bf44193706c38c0dadb3913ab2: Status 404 returned error can't find the container with id b487dc56efc21e0cb896a4877a776eab8c5d74bf44193706c38c0dadb3913ab2 Sep 10 12:49:28.494917 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.494892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn"] Sep 10 12:49:28.809873 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.809788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:28.880015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:28.879986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" event={"ID":"2d44ad79-d802-4d94-aeef-4cb3c87e5095","Type":"ContainerStarted","Data":"b487dc56efc21e0cb896a4877a776eab8c5d74bf44193706c38c0dadb3913ab2"} Sep 10 12:49:30.894084 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.894038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" event={"ID":"2d44ad79-d802-4d94-aeef-4cb3c87e5095","Type":"ContainerStarted","Data":"d5c84debeac8c4a32f9454072255b4a0813301ed0da8155b966ec0c235524055"} Sep 10 12:49:30.894530 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.894200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:30.949042 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.948987 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" podStartSLOduration=2.422812748 podStartE2EDuration="3.948967245s" totalImagesPullingTime="1.526154497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:30.947567691 +0000 UTC m=+441.598531446" watchObservedRunningTime="2026-09-10 12:49:30.948967245 +0000 UTC m=+441.599930998" Sep 10 12:49:30.991222 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.991192 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25"] Sep 10 12:49:30.995350 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.995328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:30.998393 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.998371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 12:49:30.998712 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.998697 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 12:49:30.998825 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:30.998808 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cb2d7\"" Sep 10 12:49:31.012541 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.012521 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25"] Sep 10 12:49:31.054240 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.054210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:31.106077 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.104550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.106077 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.104648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfqxf\" (UniqueName: \"kubernetes.io/projected/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-kube-api-access-nfqxf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.106077 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.104724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.205491 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.205461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfqxf\" (UniqueName: \"kubernetes.io/projected/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-kube-api-access-nfqxf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.205663 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.205507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.205663 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.205568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.206291 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.206267 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.208289 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.208265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.232054 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.232029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfqxf\" (UniqueName: \"kubernetes.io/projected/4d81a1e0-2b32-4520-be3e-0f6e2ba5658a-kube-api-access-nfqxf\") pod \"kuadrant-console-plugin-fbdd4f445-cct25\" (UID: \"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.238815 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.238790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:31.303999 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.303970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" Sep 10 12:49:31.618107 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.618080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25"] Sep 10 12:49:31.619901 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:31.619876 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d81a1e0_2b32_4520_be3e_0f6e2ba5658a.slice/crio-4269fcb6d0eed02d2822dc42faa7d5a56eb6b8ea58e9b632572babf43b19ed39 WatchSource:0}: Error finding container 4269fcb6d0eed02d2822dc42faa7d5a56eb6b8ea58e9b632572babf43b19ed39: Status 404 returned error can't find the container with id 4269fcb6d0eed02d2822dc42faa7d5a56eb6b8ea58e9b632572babf43b19ed39 Sep 10 12:49:31.900361 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:31.900279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" event={"ID":"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a","Type":"ContainerStarted","Data":"4269fcb6d0eed02d2822dc42faa7d5a56eb6b8ea58e9b632572babf43b19ed39"} Sep 10 12:49:33.486704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:33.486660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:33.605178 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:33.605147 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:33.855157 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:33.855057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:33.993810 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:33.993776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:34.316008 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:34.315973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:34.446250 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:34.446201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:36.508709 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:36.508678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:36.931388 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:36.931357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" event={"ID":"4d81a1e0-2b32-4520-be3e-0f6e2ba5658a","Type":"ContainerStarted","Data":"1edcbfe7e109034dcd58226c4844b3724774b8a0fd42f8fb6121dd860b1b81dd"} Sep 10 12:49:36.964344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:36.964288 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cct25" podStartSLOduration=2.245784873 podStartE2EDuration="6.964273381s" totalImagesPullingTime="4.718488508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:36.962599993 +0000 UTC m=+447.613563747" watchObservedRunningTime="2026-09-10 12:49:36.964273381 +0000 UTC m=+447.615237135" Sep 10 12:49:38.882783 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:38.882737 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:41.803530 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.803486 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg"] Sep 10 12:49:41.804042 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.803704 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" podUID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" containerName="manager" containerID="cri-o://9cc535d490a18d56d73553d0e6ef5ec8408f08dd17cc3ac2024bb3ccf38af728" gracePeriod=2 Sep 10 12:49:41.818552 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.818525 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg"] Sep 10 12:49:41.869945 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.869919 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:49:41.870322 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.870308 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" containerName="manager" Sep 10 12:49:41.870366 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.870324 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" containerName="manager" Sep 10 12:49:41.870429 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.870420 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" containerName="manager" Sep 10 12:49:41.873396 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.873373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:41.902693 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.902675 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wjzmn" Sep 10 12:49:41.959015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.958985 2579 generic.go:356] "Generic (PLEG): container finished" podID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" containerID="9cc535d490a18d56d73553d0e6ef5ec8408f08dd17cc3ac2024bb3ccf38af728" exitCode=0 Sep 10 12:49:41.986379 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:41.986351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:49:42.002450 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.002424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.002610 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.002496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4pvk\" (UniqueName: \"kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.056052 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.055991 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:42.103673 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.103646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.103839 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.103802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4pvk\" (UniqueName: \"kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.104047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.104023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.127705 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.127675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4pvk\" (UniqueName: \"kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ts7z8\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.189846 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.189804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:42.204947 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.204910 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume\") pod \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " Sep 10 12:49:42.205094 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.204968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf6nz\" (UniqueName: \"kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz\") pod \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\" (UID: \"cdc9ea6d-2f1f-4612-8083-c2ed1909c613\") " Sep 10 12:49:42.205444 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.205420 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cdc9ea6d-2f1f-4612-8083-c2ed1909c613" (UID: "cdc9ea6d-2f1f-4612-8083-c2ed1909c613"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:42.207186 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.207163 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz" (OuterVolumeSpecName: "kube-api-access-wf6nz") pod "cdc9ea6d-2f1f-4612-8083-c2ed1909c613" (UID: "cdc9ea6d-2f1f-4612-8083-c2ed1909c613"). InnerVolumeSpecName "kube-api-access-wf6nz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:42.306535 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.306464 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-extensions-socket-volume\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:42.306535 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.306490 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf6nz\" (UniqueName: \"kubernetes.io/projected/cdc9ea6d-2f1f-4612-8083-c2ed1909c613-kube-api-access-wf6nz\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:49:42.524154 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.524124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:49:42.526823 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:42.526796 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cefc0f6_b366_4955_b10a_2cb1acd545c4.slice/crio-4e3c7255d21447f0fed6410c3639d1560849e064e8dbe672a5a6a0df991033f5 WatchSource:0}: Error finding container 4e3c7255d21447f0fed6410c3639d1560849e064e8dbe672a5a6a0df991033f5: Status 404 returned error can't find the container with id 4e3c7255d21447f0fed6410c3639d1560849e064e8dbe672a5a6a0df991033f5 Sep 10 12:49:42.821589 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.821503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:42.966276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.966246 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4hjhg" Sep 10 12:49:42.966276 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.966240 2579 scope.go:117] "RemoveContainer" containerID="9cc535d490a18d56d73553d0e6ef5ec8408f08dd17cc3ac2024bb3ccf38af728" Sep 10 12:49:42.968339 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.968309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" event={"ID":"4cefc0f6-b366-4955-b10a-2cb1acd545c4","Type":"ContainerStarted","Data":"1539c7237f5fe3a50ba48c16ab1cba8a9a184ce0d4ed2a571ab62aa94ee21115"} Sep 10 12:49:42.968450 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.968368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" event={"ID":"4cefc0f6-b366-4955-b10a-2cb1acd545c4","Type":"ContainerStarted","Data":"4e3c7255d21447f0fed6410c3639d1560849e064e8dbe672a5a6a0df991033f5"} Sep 10 12:49:42.968450 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:42.968436 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:43.033656 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:43.033610 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" podStartSLOduration=2.033595864 podStartE2EDuration="2.033595864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:43.032778527 +0000 UTC m=+453.683742273" watchObservedRunningTime="2026-09-10 12:49:43.033595864 +0000 UTC m=+453.684559616" Sep 10 12:49:43.101344 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:43.101270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:43.303216 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:43.303181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:43.830824 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:43.830791 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc9ea6d-2f1f-4612-8083-c2ed1909c613" path="/var/lib/kubelet/pods/cdc9ea6d-2f1f-4612-8083-c2ed1909c613/volumes" Sep 10 12:49:45.367967 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:45.367932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:45.541140 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:45.541106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:45.866873 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:45.866843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:46.420854 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.420826 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p"] Sep 10 12:49:46.426083 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.426062 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.510400 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.510377 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p"] Sep 10 12:49:46.544421 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.544399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj27m\" (UniqueName: \"kubernetes.io/projected/1bd18aeb-f0ef-437a-8588-7a80eee1795d-kube-api-access-xj27m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.544564 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.544455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bd18aeb-f0ef-437a-8588-7a80eee1795d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.645357 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.645327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bd18aeb-f0ef-437a-8588-7a80eee1795d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.645521 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.645385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj27m\" (UniqueName: \"kubernetes.io/projected/1bd18aeb-f0ef-437a-8588-7a80eee1795d-kube-api-access-xj27m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.645699 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.645677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bd18aeb-f0ef-437a-8588-7a80eee1795d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.663004 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.662973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj27m\" (UniqueName: \"kubernetes.io/projected/1bd18aeb-f0ef-437a-8588-7a80eee1795d-kube-api-access-xj27m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nwb6p\" (UID: \"1bd18aeb-f0ef-437a-8588-7a80eee1795d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:46.736619 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:46.736594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:47.052486 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:47.052462 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p"] Sep 10 12:49:47.055074 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:49:47.055046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd18aeb_f0ef_437a_8588_7a80eee1795d.slice/crio-60ea3e8355d9040e8ebfd7e7f09225eadf190f954db32c76ff39368be56188ef WatchSource:0}: Error finding container 60ea3e8355d9040e8ebfd7e7f09225eadf190f954db32c76ff39368be56188ef: Status 404 returned error can't find the container with id 60ea3e8355d9040e8ebfd7e7f09225eadf190f954db32c76ff39368be56188ef Sep 10 12:49:47.999312 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:47.999276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" event={"ID":"1bd18aeb-f0ef-437a-8588-7a80eee1795d","Type":"ContainerStarted","Data":"34c1deb2e96f841465199e7aa9074e55aad772cfff754073de98d265ec3cb6b0"} Sep 10 12:49:47.999709 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:47.999341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" event={"ID":"1bd18aeb-f0ef-437a-8588-7a80eee1795d","Type":"ContainerStarted","Data":"60ea3e8355d9040e8ebfd7e7f09225eadf190f954db32c76ff39368be56188ef"} Sep 10 12:49:47.999709 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:47.999369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:48.053031 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:48.052977 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" podStartSLOduration=2.052962702 podStartE2EDuration="2.052962702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:48.051816322 +0000 UTC m=+458.702780075" watchObservedRunningTime="2026-09-10 12:49:48.052962702 +0000 UTC m=+458.703926454" Sep 10 12:49:50.022279 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:50.022245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:50.199378 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:50.199347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:49:53.977383 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:53.977354 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:49:59.007559 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:59.007524 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nwb6p" Sep 10 12:49:59.153294 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:59.153258 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:49:59.153509 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:49:59.153482 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" podUID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" containerName="manager" containerID="cri-o://1539c7237f5fe3a50ba48c16ab1cba8a9a184ce0d4ed2a571ab62aa94ee21115" gracePeriod=10 Sep 10 12:50:00.066948 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.066914 2579 generic.go:356] "Generic (PLEG): container finished" podID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" containerID="1539c7237f5fe3a50ba48c16ab1cba8a9a184ce0d4ed2a571ab62aa94ee21115" exitCode=0 Sep 10 12:50:00.067283 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.066968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" event={"ID":"4cefc0f6-b366-4955-b10a-2cb1acd545c4","Type":"ContainerDied","Data":"1539c7237f5fe3a50ba48c16ab1cba8a9a184ce0d4ed2a571ab62aa94ee21115"} Sep 10 12:50:00.092907 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.092886 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:50:00.258668 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.258641 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4pvk\" (UniqueName: \"kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk\") pod \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " Sep 10 12:50:00.258859 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.258705 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume\") pod \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\" (UID: \"4cefc0f6-b366-4955-b10a-2cb1acd545c4\") " Sep 10 12:50:00.259080 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.259058 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4cefc0f6-b366-4955-b10a-2cb1acd545c4" (UID: "4cefc0f6-b366-4955-b10a-2cb1acd545c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:50:00.260673 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.260654 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk" (OuterVolumeSpecName: "kube-api-access-z4pvk") pod "4cefc0f6-b366-4955-b10a-2cb1acd545c4" (UID: "4cefc0f6-b366-4955-b10a-2cb1acd545c4"). InnerVolumeSpecName "kube-api-access-z4pvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:50:00.359502 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.359474 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4pvk\" (UniqueName: \"kubernetes.io/projected/4cefc0f6-b366-4955-b10a-2cb1acd545c4-kube-api-access-z4pvk\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:50:00.359502 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:00.359499 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cefc0f6-b366-4955-b10a-2cb1acd545c4-extensions-socket-volume\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:50:01.073412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.073377 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" Sep 10 12:50:01.073412 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.073400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8" event={"ID":"4cefc0f6-b366-4955-b10a-2cb1acd545c4","Type":"ContainerDied","Data":"4e3c7255d21447f0fed6410c3639d1560849e064e8dbe672a5a6a0df991033f5"} Sep 10 12:50:01.074010 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.073464 2579 scope.go:117] "RemoveContainer" containerID="1539c7237f5fe3a50ba48c16ab1cba8a9a184ce0d4ed2a571ab62aa94ee21115" Sep 10 12:50:01.102478 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.102451 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:50:01.105776 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:01.105734 2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cefc0f6_b366_4955_b10a_2cb1acd545c4.slice\": RecentStats: unable to find data in memory cache]" Sep 10 12:50:01.107736 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.107716 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ts7z8"] Sep 10 12:50:01.829856 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:01.829816 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" path="/var/lib/kubelet/pods/4cefc0f6-b366-4955-b10a-2cb1acd545c4/volumes" Sep 10 12:50:15.812328 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.812298 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f"] Sep 10 12:50:15.812803 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.812707 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" containerName="manager" Sep 10 12:50:15.812803 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.812721 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" containerName="manager" Sep 10 12:50:15.812884 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.812823 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cefc0f6-b366-4955-b10a-2cb1acd545c4" containerName="manager" Sep 10 12:50:15.828602 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.828570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.831551 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.831527 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 12:50:15.832227 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.832210 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 12:50:15.832827 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.832807 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d2w8c\"" Sep 10 12:50:15.833257 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.833242 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 12:50:15.845474 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.845451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:15.868311 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.868287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f"] Sep 10 12:50:15.892512 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892617 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbfl\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-kube-api-access-zsbfl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892617 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892617 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/764fbdb2-c6d1-41dd-9050-cece61c3f505-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892748 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.892990 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.892786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993501 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993501 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/764fbdb2-c6d1-41dd-9050-cece61c3f505-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbfl\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-kube-api-access-zsbfl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.993726 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.993947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994047 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.994037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994212 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.994178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994212 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.994200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.994311 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.994289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/764fbdb2-c6d1-41dd-9050-cece61c3f505-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.995926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.995898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:15.996051 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:15.996002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:16.011381 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:16.011350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbfl\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-kube-api-access-zsbfl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:16.011972 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:16.011955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/764fbdb2-c6d1-41dd-9050-cece61c3f505-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jjw2f\" (UID: \"764fbdb2-c6d1-41dd-9050-cece61c3f505\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:16.104082 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:16.103995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:16.141708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:16.141681 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:16.437213 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:16.437190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f"] Sep 10 12:50:16.439280 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:50:16.439251 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764fbdb2_c6d1_41dd_9050_cece61c3f505.slice/crio-845aaf2ec51c76775d7328b853d619c293a123aaa274a84c37971eb4ca4b9bd9 WatchSource:0}: Error finding container 845aaf2ec51c76775d7328b853d619c293a123aaa274a84c37971eb4ca4b9bd9: Status 404 returned error can't find the container with id 845aaf2ec51c76775d7328b853d619c293a123aaa274a84c37971eb4ca4b9bd9 Sep 10 12:50:17.161570 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:17.161533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" event={"ID":"764fbdb2-c6d1-41dd-9050-cece61c3f505","Type":"ContainerStarted","Data":"845aaf2ec51c76775d7328b853d619c293a123aaa274a84c37971eb4ca4b9bd9"} Sep 10 12:50:19.476081 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:19.476045 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:50:19.476375 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:19.476124 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:50:19.476375 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:19.476155 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:50:20.183285 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:20.183254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" event={"ID":"764fbdb2-c6d1-41dd-9050-cece61c3f505","Type":"ContainerStarted","Data":"7678b7681b14862ff18bcea960bd7126795db6da26b497e689da8c2c3da2a910"} Sep 10 12:50:20.226425 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:20.226377 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podStartSLOduration=2.191860665 podStartE2EDuration="5.226363119s" totalImagesPullingTime="3.034502454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:20.22249718 +0000 UTC m=+490.873460933" watchObservedRunningTime="2026-09-10 12:50:20.226363119 +0000 UTC m=+490.877326871" Sep 10 12:50:21.142469 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.142434 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:21.147156 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.147134 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:21.188999 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.188972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:21.189866 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.189844 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:50:21.645787 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.645735 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:21.648301 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.648286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.652188 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.652166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 12:50:21.667599 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.667578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:21.722686 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.722654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:21.731551 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.731528 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:21.745502 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.745478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ntn\" (UniqueName: \"kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.745605 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.745556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.846616 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.846589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ntn\" (UniqueName: \"kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.846809 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.846674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.847313 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.847290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.851624 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.851596 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:21.868307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.868285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ntn\" (UniqueName: \"kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn\") pod \"limitador-limitador-8588749977-469gp\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:21.958999 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:21.958966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:22.239654 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:22.239627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:22.240038 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:50:22.240011 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e0c27f_f69f_46bf_b66f_53571cfe1474.slice/crio-4e73097b7a37970dddd033f4b60162bf9480e0267746ffb834a06580cf5e7cb9 WatchSource:0}: Error finding container 4e73097b7a37970dddd033f4b60162bf9480e0267746ffb834a06580cf5e7cb9: Status 404 returned error can't find the container with id 4e73097b7a37970dddd033f4b60162bf9480e0267746ffb834a06580cf5e7cb9 Sep 10 12:50:22.692045 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:22.692000 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:22.963652 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:22.963574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:23.202102 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:23.202054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-469gp" event={"ID":"35e0c27f-f69f-46bf-b66f-53571cfe1474","Type":"ContainerStarted","Data":"4e73097b7a37970dddd033f4b60162bf9480e0267746ffb834a06580cf5e7cb9"} Sep 10 12:50:24.208922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:24.208885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-469gp" event={"ID":"35e0c27f-f69f-46bf-b66f-53571cfe1474","Type":"ContainerStarted","Data":"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9"} Sep 10 12:50:24.209301 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:24.209019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:24.239533 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:24.239475 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-469gp" podStartSLOduration=2.201248439 podStartE2EDuration="3.239461492s" totalImagesPullingTime="1.038213053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:24.236712839 +0000 UTC m=+494.887676591" watchObservedRunningTime="2026-09-10 12:50:24.239461492 +0000 UTC m=+494.890425244" Sep 10 12:50:35.215447 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:35.215413 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:35.239306 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:35.239270 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:35.270429 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:35.270390 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-469gp" podUID="35e0c27f-f69f-46bf-b66f-53571cfe1474" containerName="limitador" containerID="cri-o://9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9" gracePeriod=30 Sep 10 12:50:36.214809 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.214786 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:36.276832 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.276800 2579 generic.go:356] "Generic (PLEG): container finished" podID="35e0c27f-f69f-46bf-b66f-53571cfe1474" containerID="9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9" exitCode=0 Sep 10 12:50:36.277193 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.276846 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-469gp" Sep 10 12:50:36.277193 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.276890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-469gp" event={"ID":"35e0c27f-f69f-46bf-b66f-53571cfe1474","Type":"ContainerDied","Data":"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9"} Sep 10 12:50:36.277193 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.276943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-469gp" event={"ID":"35e0c27f-f69f-46bf-b66f-53571cfe1474","Type":"ContainerDied","Data":"4e73097b7a37970dddd033f4b60162bf9480e0267746ffb834a06580cf5e7cb9"} Sep 10 12:50:36.277193 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.276971 2579 scope.go:117] "RemoveContainer" containerID="9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9" Sep 10 12:50:36.285494 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.285479 2579 scope.go:117] "RemoveContainer" containerID="9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9" Sep 10 12:50:36.285742 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:36.285726 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9\": container with ID starting with 9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9 not found: ID does not exist" containerID="9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9" Sep 10 12:50:36.285811 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.285752 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9"} err="failed to get container status \"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9\": rpc error: code = NotFound desc = could not find container \"9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9\": container with ID starting with 9b1c36d0d1584eca013567ec3c4f183fedd7121254d0bf9dddecb5c3524e0ce9 not found: ID does not exist" Sep 10 12:50:36.375652 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.375577 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4ntn\" (UniqueName: \"kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn\") pod \"35e0c27f-f69f-46bf-b66f-53571cfe1474\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " Sep 10 12:50:36.375652 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.375633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file\") pod \"35e0c27f-f69f-46bf-b66f-53571cfe1474\" (UID: \"35e0c27f-f69f-46bf-b66f-53571cfe1474\") " Sep 10 12:50:36.376007 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.375984 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file" (OuterVolumeSpecName: "config-file") pod "35e0c27f-f69f-46bf-b66f-53571cfe1474" (UID: "35e0c27f-f69f-46bf-b66f-53571cfe1474"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:50:36.377573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.377549 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn" (OuterVolumeSpecName: "kube-api-access-t4ntn") pod "35e0c27f-f69f-46bf-b66f-53571cfe1474" (UID: "35e0c27f-f69f-46bf-b66f-53571cfe1474"). InnerVolumeSpecName "kube-api-access-t4ntn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:50:36.476836 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.476798 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35e0c27f-f69f-46bf-b66f-53571cfe1474-config-file\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:50:36.476836 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.476834 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4ntn\" (UniqueName: \"kubernetes.io/projected/35e0c27f-f69f-46bf-b66f-53571cfe1474-kube-api-access-t4ntn\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:50:36.603909 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.603881 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:36.606684 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:36.606662 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-469gp"] Sep 10 12:50:37.604662 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:37.604626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:37.712016 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:37.711977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:37.829808 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:37.829751 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e0c27f-f69f-46bf-b66f-53571cfe1474" path="/var/lib/kubelet/pods/35e0c27f-f69f-46bf-b66f-53571cfe1474/volumes" Sep 10 12:50:38.083081 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.083044 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sssfr"] Sep 10 12:50:38.083504 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.083486 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e0c27f-f69f-46bf-b66f-53571cfe1474" containerName="limitador" Sep 10 12:50:38.083597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.083506 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e0c27f-f69f-46bf-b66f-53571cfe1474" containerName="limitador" Sep 10 12:50:38.083597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.083588 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e0c27f-f69f-46bf-b66f-53571cfe1474" containerName="limitador" Sep 10 12:50:38.086425 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.086400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.095614 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.095597 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wpll2\"" Sep 10 12:50:38.095790 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.095746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 12:50:38.095878 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.095864 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 12:50:38.096893 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.096879 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 12:50:38.113921 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.113899 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sssfr"] Sep 10 12:50:38.145130 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.145108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:38.190177 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.190151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78207bed-ef55-4974-a6fa-b5b4f37a199c-data\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.190322 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.190193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztnl\" (UniqueName: \"kubernetes.io/projected/78207bed-ef55-4974-a6fa-b5b4f37a199c-kube-api-access-mztnl\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.291227 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.291195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78207bed-ef55-4974-a6fa-b5b4f37a199c-data\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.291405 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.291239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mztnl\" (UniqueName: \"kubernetes.io/projected/78207bed-ef55-4974-a6fa-b5b4f37a199c-kube-api-access-mztnl\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.291612 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.291588 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78207bed-ef55-4974-a6fa-b5b4f37a199c-data\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.301119 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.301091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztnl\" (UniqueName: \"kubernetes.io/projected/78207bed-ef55-4974-a6fa-b5b4f37a199c-kube-api-access-mztnl\") pod \"postgres-69fb4594cf-sssfr\" (UID: \"78207bed-ef55-4974-a6fa-b5b4f37a199c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.396248 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.396167 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:38.671819 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:38.671794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sssfr"] Sep 10 12:50:38.672754 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:50:38.672730 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78207bed_ef55_4974_a6fa_b5b4f37a199c.slice/crio-20deb571ef3f0da1de80e1a5aa48defa91298997df8e5cfc77b540ba4e712d7f WatchSource:0}: Error finding container 20deb571ef3f0da1de80e1a5aa48defa91298997df8e5cfc77b540ba4e712d7f: Status 404 returned error can't find the container with id 20deb571ef3f0da1de80e1a5aa48defa91298997df8e5cfc77b540ba4e712d7f Sep 10 12:50:39.295040 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:39.295005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" event={"ID":"78207bed-ef55-4974-a6fa-b5b4f37a199c","Type":"ContainerStarted","Data":"20deb571ef3f0da1de80e1a5aa48defa91298997df8e5cfc77b540ba4e712d7f"} Sep 10 12:50:41.309446 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:41.309362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" event={"ID":"78207bed-ef55-4974-a6fa-b5b4f37a199c","Type":"ContainerStarted","Data":"aa72457defa725dbb088f4b4c74763a3aa8bfe856532d6b7c1115319d54a7afd"} Sep 10 12:50:41.309446 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:41.309434 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:41.340739 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:41.340689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" podStartSLOduration=1.037030397 podStartE2EDuration="3.340675153s" totalImagesPullingTime="2.303644756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:41.340144924 +0000 UTC m=+511.991108678" watchObservedRunningTime="2026-09-10 12:50:41.340675153 +0000 UTC m=+511.991638905" Sep 10 12:50:47.344625 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:47.344558 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sssfr" Sep 10 12:50:47.678969 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:47.678934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:48.129725 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:48.129643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:55.640940 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.640904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:55.744982 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.744952 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:50:55.752202 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.752185 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.760522 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.760503 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 12:50:55.761239 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.761221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 12:50:55.761357 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.761268 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 12:50:55.761481 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.761461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nxd6f\"" Sep 10 12:50:55.771403 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.771381 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:50:55.810444 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.810414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:55.831294 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.831273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.831424 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.831312 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.831488 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.831449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phnxh\" (UniqueName: \"kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.932546 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.932515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.932720 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.932561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.932720 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.932627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phnxh\" (UniqueName: \"kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:55.932720 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:55.932676 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 12:50:55.932912 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:55.932740 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert podName:1c64e086-5282-4946-a379-b606684f02e7 nodeName:}" failed. No retries permitted until 2026-09-10 12:50:56.43272362 +0000 UTC m=+527.083687351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert") pod "maas-controller-74767bc6b8-7vzxk" (UID: "1c64e086-5282-4946-a379-b606684f02e7") : secret "maas-controller-webhook-cert" not found Sep 10 12:50:55.932912 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:55.932741 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 10 12:50:55.932912 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:55.932826 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs podName:1c64e086-5282-4946-a379-b606684f02e7 nodeName:}" failed. No retries permitted until 2026-09-10 12:50:56.432809779 +0000 UTC m=+527.083773526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs") pod "maas-controller-74767bc6b8-7vzxk" (UID: "1c64e086-5282-4946-a379-b606684f02e7") : secret "maas-controller-metrics-tls" not found Sep 10 12:50:55.961733 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:55.961706 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phnxh\" (UniqueName: \"kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.018357 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.018324 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5ddfb77fc5-9kszr"] Sep 10 12:50:56.020751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.020730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.033015 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.032988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.033128 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.033100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.033234 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.033175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvxm\" (UniqueName: \"kubernetes.io/projected/90e8bd7a-41be-40be-8eb2-dba28695047f-kube-api-access-tjvxm\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.037179 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.037155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ddfb77fc5-9kszr"] Sep 10 12:50:56.038065 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.038041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:56.133810 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.133755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.133968 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.133819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvxm\" (UniqueName: \"kubernetes.io/projected/90e8bd7a-41be-40be-8eb2-dba28695047f-kube-api-access-tjvxm\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.133968 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.133890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.133968 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:56.133914 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 12:50:56.134081 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:56.133982 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert podName:90e8bd7a-41be-40be-8eb2-dba28695047f nodeName:}" failed. No retries permitted until 2026-09-10 12:50:56.633963789 +0000 UTC m=+527.284927527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert") pod "maas-controller-5ddfb77fc5-9kszr" (UID: "90e8bd7a-41be-40be-8eb2-dba28695047f") : secret "maas-controller-webhook-cert" not found Sep 10 12:50:56.134081 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:56.133993 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 10 12:50:56.134081 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:50:56.134065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs podName:90e8bd7a-41be-40be-8eb2-dba28695047f nodeName:}" failed. No retries permitted until 2026-09-10 12:50:56.634052662 +0000 UTC m=+527.285016393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs") pod "maas-controller-5ddfb77fc5-9kszr" (UID: "90e8bd7a-41be-40be-8eb2-dba28695047f") : secret "maas-controller-metrics-tls" not found Sep 10 12:50:56.152566 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.152539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvxm\" (UniqueName: \"kubernetes.io/projected/90e8bd7a-41be-40be-8eb2-dba28695047f-kube-api-access-tjvxm\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.392555 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.392462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:56.436486 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.436461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.436661 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.436503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.438975 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.438949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.439093 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.439028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") pod \"maas-controller-74767bc6b8-7vzxk\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.490146 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.490116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:50:56.638135 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.638103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.638311 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.638177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.640541 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.640511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-metrics-certs\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.640663 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.640556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e8bd7a-41be-40be-8eb2-dba28695047f-webhook-cert\") pod \"maas-controller-5ddfb77fc5-9kszr\" (UID: \"90e8bd7a-41be-40be-8eb2-dba28695047f\") " pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.662518 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.662460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:50:56.931432 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.931401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:50:56.954505 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:56.954482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:50:56.956292 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:50:56.956267 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c64e086_5282_4946_a379_b606684f02e7.slice/crio-f618d37ff88a1ae98fe0408ce76601f301ca10daa0c895e3239edd79d9d01ea0 WatchSource:0}: Error finding container f618d37ff88a1ae98fe0408ce76601f301ca10daa0c895e3239edd79d9d01ea0: Status 404 returned error can't find the container with id f618d37ff88a1ae98fe0408ce76601f301ca10daa0c895e3239edd79d9d01ea0 Sep 10 12:50:57.214162 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:57.214132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ddfb77fc5-9kszr"] Sep 10 12:50:57.215979 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:50:57.215951 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e8bd7a_41be_40be_8eb2_dba28695047f.slice/crio-101259b61b4ae0918a0dfc6b5c8b390f40afe37d06877434da11100818fe67d8 WatchSource:0}: Error finding container 101259b61b4ae0918a0dfc6b5c8b390f40afe37d06877434da11100818fe67d8: Status 404 returned error can't find the container with id 101259b61b4ae0918a0dfc6b5c8b390f40afe37d06877434da11100818fe67d8 Sep 10 12:50:57.402546 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:57.402508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" event={"ID":"90e8bd7a-41be-40be-8eb2-dba28695047f","Type":"ContainerStarted","Data":"101259b61b4ae0918a0dfc6b5c8b390f40afe37d06877434da11100818fe67d8"} Sep 10 12:50:57.403754 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:57.403723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" event={"ID":"1c64e086-5282-4946-a379-b606684f02e7","Type":"ContainerStarted","Data":"f618d37ff88a1ae98fe0408ce76601f301ca10daa0c895e3239edd79d9d01ea0"} Sep 10 12:50:59.956865 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:50:59.956754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:00.211247 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.211167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:00.427307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.427267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" event={"ID":"90e8bd7a-41be-40be-8eb2-dba28695047f","Type":"ContainerStarted","Data":"6a0e15242261f9cf040d918e2166fa12280fd9b0049001eadabcf63ea244acf0"} Sep 10 12:51:00.427492 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.427417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:51:00.428865 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.428840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" event={"ID":"1c64e086-5282-4946-a379-b606684f02e7","Type":"ContainerStarted","Data":"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e"} Sep 10 12:51:00.429002 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.428988 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:51:00.450416 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.450367 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" podStartSLOduration=2.960810335 podStartE2EDuration="5.450354678s" totalImagesPullingTime="2.489544343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:00.447834499 +0000 UTC m=+531.098798256" watchObservedRunningTime="2026-09-10 12:51:00.450354678 +0000 UTC m=+531.101318430" Sep 10 12:51:00.472001 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:00.471919 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" podStartSLOduration=2.734555299 podStartE2EDuration="5.471905812s" totalImagesPullingTime="2.737350513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:00.470719469 +0000 UTC m=+531.121683224" watchObservedRunningTime="2026-09-10 12:51:00.471905812 +0000 UTC m=+531.122869565" Sep 10 12:51:11.437091 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.437056 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:51:11.437500 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.437125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5ddfb77fc5-9kszr" Sep 10 12:51:11.530304 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.530273 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:51:11.530515 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.530487 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" podUID="1c64e086-5282-4946-a379-b606684f02e7" containerName="manager" containerID="cri-o://abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e" gracePeriod=30 Sep 10 12:51:11.770838 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.770807 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:51:11.876811 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.876781 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") pod \"1c64e086-5282-4946-a379-b606684f02e7\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " Sep 10 12:51:11.876811 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.876815 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") pod \"1c64e086-5282-4946-a379-b606684f02e7\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " Sep 10 12:51:11.876998 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.876836 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phnxh\" (UniqueName: \"kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh\") pod \"1c64e086-5282-4946-a379-b606684f02e7\" (UID: \"1c64e086-5282-4946-a379-b606684f02e7\") " Sep 10 12:51:11.879078 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.879049 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c64e086-5282-4946-a379-b606684f02e7" (UID: "1c64e086-5282-4946-a379-b606684f02e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:51:11.879078 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.879065 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1c64e086-5282-4946-a379-b606684f02e7" (UID: "1c64e086-5282-4946-a379-b606684f02e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:51:11.879241 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.879172 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh" (OuterVolumeSpecName: "kube-api-access-phnxh") pod "1c64e086-5282-4946-a379-b606684f02e7" (UID: "1c64e086-5282-4946-a379-b606684f02e7"). InnerVolumeSpecName "kube-api-access-phnxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:51:11.977697 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.977631 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-metrics-certs\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:51:11.977697 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.977655 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c64e086-5282-4946-a379-b606684f02e7-webhook-cert\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:51:11.977697 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:11.977663 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phnxh\" (UniqueName: \"kubernetes.io/projected/1c64e086-5282-4946-a379-b606684f02e7-kube-api-access-phnxh\") on node \"ip-10-0-140-44.ec2.internal\" DevicePath \"\"" Sep 10 12:51:12.496136 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.496102 2579 generic.go:356] "Generic (PLEG): container finished" podID="1c64e086-5282-4946-a379-b606684f02e7" containerID="abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e" exitCode=0 Sep 10 12:51:12.496553 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.496148 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" Sep 10 12:51:12.496553 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.496183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" event={"ID":"1c64e086-5282-4946-a379-b606684f02e7","Type":"ContainerDied","Data":"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e"} Sep 10 12:51:12.496553 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.496236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74767bc6b8-7vzxk" event={"ID":"1c64e086-5282-4946-a379-b606684f02e7","Type":"ContainerDied","Data":"f618d37ff88a1ae98fe0408ce76601f301ca10daa0c895e3239edd79d9d01ea0"} Sep 10 12:51:12.496553 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.496263 2579 scope.go:117] "RemoveContainer" containerID="abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e" Sep 10 12:51:12.506161 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.506144 2579 scope.go:117] "RemoveContainer" containerID="abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e" Sep 10 12:51:12.506422 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:51:12.506406 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e\": container with ID starting with abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e not found: ID does not exist" containerID="abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e" Sep 10 12:51:12.506466 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.506430 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e"} err="failed to get container status \"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e\": rpc error: code = NotFound desc = could not find container \"abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e\": container with ID starting with abb7c90b5cf7f0a506ef52cc8dd113f9745452bff16f879522406e116e65953e not found: ID does not exist" Sep 10 12:51:12.520859 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.520833 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:51:12.526196 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:12.526176 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74767bc6b8-7vzxk"] Sep 10 12:51:13.830070 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:13.830040 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c64e086-5282-4946-a379-b606684f02e7" path="/var/lib/kubelet/pods/1c64e086-5282-4946-a379-b606684f02e7/volumes" Sep 10 12:51:19.543927 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:19.543886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:32.114167 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:32.114132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:32.203921 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:32.203888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:33.818719 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.818686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:33.916660 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.916626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:33.923519 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.923492 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d"] Sep 10 12:51:33.923897 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.923884 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64e086-5282-4946-a379-b606684f02e7" containerName="manager" Sep 10 12:51:33.923945 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.923899 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64e086-5282-4946-a379-b606684f02e7" containerName="manager" Sep 10 12:51:33.923980 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.923973 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64e086-5282-4946-a379-b606684f02e7" containerName="manager" Sep 10 12:51:33.929625 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.929599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:33.939935 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.939913 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fr5nr\"" Sep 10 12:51:33.940869 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.940852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 12:51:33.940963 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.940892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 12:51:33.947317 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:33.947290 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d"] Sep 10 12:51:34.048595 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.048565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:34.068037 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.068013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-openshift-service-ca\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.068167 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.068058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.068167 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.068111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-maas-api-tls\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.068167 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.068139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvsr\" (UniqueName: \"kubernetes.io/projected/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-kube-api-access-wjvsr\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.169535 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.169431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.169535 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.169483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-maas-api-tls\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.169751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.169578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvsr\" (UniqueName: \"kubernetes.io/projected/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-kube-api-access-wjvsr\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.169751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.169677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-openshift-service-ca\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.169751 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:51:34.169579 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 10 12:51:34.169922 ip-10-0-140-44 kubenswrapper[2579]: E0910 12:51:34.169842 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs podName:ae809a3c-ca98-4462-8b69-88a66ec0fbc4 nodeName:}" failed. No retries permitted until 2026-09-10 12:51:34.669818243 +0000 UTC m=+565.320781975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs") pod "maas-api-6f665df67c-vpp6d" (UID: "ae809a3c-ca98-4462-8b69-88a66ec0fbc4") : secret "maas-api-metrics-tls" not found Sep 10 12:51:34.170436 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.170417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-openshift-service-ca\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.171980 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.171960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-maas-api-tls\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.181264 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.181236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvsr\" (UniqueName: \"kubernetes.io/projected/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-kube-api-access-wjvsr\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.352307 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.352273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:34.593362 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.593334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:34.674088 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.674059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.676423 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.676403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae809a3c-ca98-4462-8b69-88a66ec0fbc4-metrics-certs\") pod \"maas-api-6f665df67c-vpp6d\" (UID: \"ae809a3c-ca98-4462-8b69-88a66ec0fbc4\") " pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.840379 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.840346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:34.948953 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.948924 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r596k"] Sep 10 12:51:34.951842 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.951823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:34.983155 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:34.983126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 12:51:35.001149 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.001121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hmkxq\"" Sep 10 12:51:35.001737 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.001718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r596k"] Sep 10 12:51:35.049932 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.049887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:35.077520 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.077495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8a060f-3471-4eda-8810-941623639681-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.077648 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.077542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5r6\" (UniqueName: \"kubernetes.io/projected/9c8a060f-3471-4eda-8810-941623639681-kube-api-access-wb5r6\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.178590 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.178515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8a060f-3471-4eda-8810-941623639681-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.178590 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.178573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5r6\" (UniqueName: \"kubernetes.io/projected/9c8a060f-3471-4eda-8810-941623639681-kube-api-access-wb5r6\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.179258 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.179237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8a060f-3471-4eda-8810-941623639681-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.200102 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.200074 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5r6\" (UniqueName: \"kubernetes.io/projected/9c8a060f-3471-4eda-8810-941623639681-kube-api-access-wb5r6\") pod \"payload-pre-processing-59fbc47bf8-r596k\" (UID: \"9c8a060f-3471-4eda-8810-941623639681\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.225456 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.225417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d"] Sep 10 12:51:35.228076 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:51:35.228049 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae809a3c_ca98_4462_8b69_88a66ec0fbc4.slice/crio-22b9ec634e7f17b1bacdb4c094e22b7b0c21326e079b3809bb0535211a26deff WatchSource:0}: Error finding container 22b9ec634e7f17b1bacdb4c094e22b7b0c21326e079b3809bb0535211a26deff: Status 404 returned error can't find the container with id 22b9ec634e7f17b1bacdb4c094e22b7b0c21326e079b3809bb0535211a26deff Sep 10 12:51:35.263321 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.263291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:35.562936 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.562855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r596k"] Sep 10 12:51:35.571778 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:51:35.571720 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8a060f_3471_4eda_8810_941623639681.slice/crio-802b351fee5cc2267239d97d5dd3797e99179934d772c248846714982672d44e WatchSource:0}: Error finding container 802b351fee5cc2267239d97d5dd3797e99179934d772c248846714982672d44e: Status 404 returned error can't find the container with id 802b351fee5cc2267239d97d5dd3797e99179934d772c248846714982672d44e Sep 10 12:51:35.624656 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.624608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" event={"ID":"ae809a3c-ca98-4462-8b69-88a66ec0fbc4","Type":"ContainerStarted","Data":"22b9ec634e7f17b1bacdb4c094e22b7b0c21326e079b3809bb0535211a26deff"} Sep 10 12:51:35.625809 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:35.625787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" event={"ID":"9c8a060f-3471-4eda-8810-941623639681","Type":"ContainerStarted","Data":"802b351fee5cc2267239d97d5dd3797e99179934d772c248846714982672d44e"} Sep 10 12:51:37.643607 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:37.643441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" event={"ID":"ae809a3c-ca98-4462-8b69-88a66ec0fbc4","Type":"ContainerStarted","Data":"4b0932aa799d0de80b40fcc3e952e107c207492424dbca8c623bf2d38a95c9a7"} Sep 10 12:51:37.644032 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:37.643622 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:37.664221 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:37.664171 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" podStartSLOduration=2.5656417449999998 podStartE2EDuration="4.664150061s" totalImagesPullingTime="2.098508316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:37.66334569 +0000 UTC m=+568.314309445" watchObservedRunningTime="2026-09-10 12:51:37.664150061 +0000 UTC m=+568.315113816" Sep 10 12:51:38.650723 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:38.650684 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" event={"ID":"9c8a060f-3471-4eda-8810-941623639681","Type":"ContainerStarted","Data":"1eb55c3c53e4fe8e9d0dda288b6b63c17935221ffdb4b19659cd59e1737d8eab"} Sep 10 12:51:38.651213 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:38.650769 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:43.656404 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:43.656369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f665df67c-vpp6d" Sep 10 12:51:43.686231 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:43.678825 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" podStartSLOduration=7.400874012 podStartE2EDuration="9.678799706s" totalImagesPullingTime="2.277925694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:38.706468586 +0000 UTC m=+569.357432340" watchObservedRunningTime="2026-09-10 12:51:43.678799706 +0000 UTC m=+574.329763459" Sep 10 12:51:44.688639 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.688603 2579 generic.go:356] "Generic (PLEG): container finished" podID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerID="7678b7681b14862ff18bcea960bd7126795db6da26b497e689da8c2c3da2a910" exitCode=0 Sep 10 12:51:44.689111 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.688670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" event={"ID":"764fbdb2-c6d1-41dd-9050-cece61c3f505","Type":"ContainerDied","Data":"7678b7681b14862ff18bcea960bd7126795db6da26b497e689da8c2c3da2a910"} Sep 10 12:51:44.689175 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.689157 2579 scope.go:117] "RemoveContainer" containerID="7678b7681b14862ff18bcea960bd7126795db6da26b497e689da8c2c3da2a910" Sep 10 12:51:44.690141 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.690109 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:51:44.690204 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.690190 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:51:44.690241 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.690225 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 12:51:44.721399 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.721370 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:44.818690 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:44.818655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:51:45.701020 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:45.700977 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" event={"ID":"764fbdb2-c6d1-41dd-9050-cece61c3f505","Type":"ContainerStarted","Data":"c214bda80e9d2197200679520da8c25c839ea86e37573afc10eefd0638699522"} Sep 10 12:51:46.142546 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:46.142465 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:51:46.142740 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:46.142715 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jjw2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Sep 10 12:51:46.142832 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:46.142792 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podUID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Sep 10 12:51:47.142627 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:47.142595 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jjw2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Sep 10 12:51:47.143017 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:47.142648 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podUID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Sep 10 12:51:48.142596 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:48.142561 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jjw2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Sep 10 12:51:48.142794 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:48.142623 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podUID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Sep 10 12:51:49.142688 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:49.142655 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jjw2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Sep 10 12:51:49.142908 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:49.142709 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podUID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Sep 10 12:51:49.657961 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:49.657930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r596k" Sep 10 12:51:50.142423 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:50.142386 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jjw2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Sep 10 12:51:50.142602 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:50.142443 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" podUID="764fbdb2-c6d1-41dd-9050-cece61c3f505" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Sep 10 12:51:51.145819 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:51.145786 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:51:51.146183 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:51.146043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:51:51.146649 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:51.146630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jjw2f" Sep 10 12:51:52.338937 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:52.338895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-48jgl_0a15a009-c259-4586-b462-2841e5331b1a/manager/0.log" Sep 10 12:51:52.454117 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:52.454088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5ddfb77fc5-9kszr_90e8bd7a-41be-40be-8eb2-dba28695047f/manager/0.log" Sep 10 12:51:52.922817 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:52.922786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b549dd4b8-2k6bw_ad0d408d-fcd2-4569-b546-8b40738a48e5/copy-manifests/0.log" Sep 10 12:51:52.931118 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:52.931095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b549dd4b8-2k6bw_ad0d408d-fcd2-4569-b546-8b40738a48e5/manager/0.log" Sep 10 12:51:53.386470 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:53.386438 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f665df67c-vpp6d_ae809a3c-ca98-4462-8b69-88a66ec0fbc4/maas-api/0.log" Sep 10 12:51:53.500798 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:53.500754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sssfr_78207bed-ef55-4974-a6fa-b5b4f37a199c/postgres/0.log" Sep 10 12:51:54.485877 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:54.485847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wjzmn_2d44ad79-d802-4d94-aeef-4cb3c87e5095/manager/0.log" Sep 10 12:51:54.599036 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:54.599008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-cct25_4d81a1e0-2b32-4520-be3e-0f6e2ba5658a/kuadrant-console-plugin/0.log" Sep 10 12:51:54.710596 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:54.710568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-nwb6p_1bd18aeb-f0ef-437a-8588-7a80eee1795d/manager/0.log" Sep 10 12:51:55.786039 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:55.786003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/1.log" Sep 10 12:51:55.899081 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:51:55.899052 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r596k_9c8a060f-3471-4eda-8810-941623639681/payload-pre-processing/0.log" Sep 10 12:52:01.383805 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:01.383772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:52:01.539692 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:01.539637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" limit=1024 Sep 10 12:52:04.648661 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:04.648631 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xts8q_963e74f7-61fd-44ba-865d-4b84000799b7/global-pull-secret-syncer/0.log" Sep 10 12:52:04.700628 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:04.700605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d6hmr_a2c6be37-ec79-4987-8aff-d33dc3c5e591/konnectivity-agent/0.log" Sep 10 12:52:04.825279 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:04.825248 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-44.ec2.internal_9c85114910600898b0d381eadda58806/haproxy/0.log" Sep 10 12:52:09.028176 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:09.028143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wjzmn_2d44ad79-d802-4d94-aeef-4cb3c87e5095/manager/0.log" Sep 10 12:52:09.067060 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:09.067039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-cct25_4d81a1e0-2b32-4520-be3e-0f6e2ba5658a/kuadrant-console-plugin/0.log" Sep 10 12:52:09.114418 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:09.114392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-nwb6p_1bd18aeb-f0ef-437a-8588-7a80eee1795d/manager/0.log" Sep 10 12:52:10.737831 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.737791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/alertmanager/0.log" Sep 10 12:52:10.769964 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.769926 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/config-reloader/0.log" Sep 10 12:52:10.803704 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.803681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/kube-rbac-proxy-web/0.log" Sep 10 12:52:10.835860 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.835837 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/kube-rbac-proxy/0.log" Sep 10 12:52:10.865264 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.865241 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/kube-rbac-proxy-metric/0.log" Sep 10 12:52:10.895484 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.895456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/prom-label-proxy/0.log" Sep 10 12:52:10.934914 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.934895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e131375-3637-40a3-a507-7138502e0640/init-config-reloader/0.log" Sep 10 12:52:10.985346 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:10.985316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-wtvht_ac68bd65-a2fd-44d9-95a8-c5b0f8417735/cluster-monitoring-operator/0.log" Sep 10 12:52:11.018203 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.018147 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t7lvq_14d52d8a-da63-405e-88b2-a440f12b6b28/kube-state-metrics/0.log" Sep 10 12:52:11.052623 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.052594 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t7lvq_14d52d8a-da63-405e-88b2-a440f12b6b28/kube-rbac-proxy-main/0.log" Sep 10 12:52:11.092019 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.091988 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t7lvq_14d52d8a-da63-405e-88b2-a440f12b6b28/kube-rbac-proxy-self/0.log" Sep 10 12:52:11.141457 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.141431 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5554dc4478-hfd85_c0d4bea4-f813-4323-a897-114be5c2ef88/metrics-server/0.log" Sep 10 12:52:11.315027 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.314950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqppg_7b6b092f-06bc-411e-8299-507eed9aaff6/node-exporter/0.log" Sep 10 12:52:11.350734 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.350710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqppg_7b6b092f-06bc-411e-8299-507eed9aaff6/kube-rbac-proxy/0.log" Sep 10 12:52:11.380652 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.380627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqppg_7b6b092f-06bc-411e-8299-507eed9aaff6/init-textfile/0.log" Sep 10 12:52:11.545611 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.545580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-k6ljl_bd0390d5-f399-4fd5-baa6-fcd81680ee24/kube-rbac-proxy-main/0.log" Sep 10 12:52:11.575486 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.575414 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-k6ljl_bd0390d5-f399-4fd5-baa6-fcd81680ee24/kube-rbac-proxy-self/0.log" Sep 10 12:52:11.609926 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.609902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-k6ljl_bd0390d5-f399-4fd5-baa6-fcd81680ee24/openshift-state-metrics/0.log" Sep 10 12:52:11.924849 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.924754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-sdchx_3791d1fb-9a23-4f4c-b8d2-733d94f905a4/prometheus-operator/0.log" Sep 10 12:52:11.962306 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.962280 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-sdchx_3791d1fb-9a23-4f4c-b8d2-733d94f905a4/kube-rbac-proxy/0.log" Sep 10 12:52:11.999440 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:11.999418 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-nv6zk_be1f8529-19fd-4704-89aa-712af17da834/prometheus-operator-admission-webhook/0.log" Sep 10 12:52:12.040670 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:12.040646 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76748f497c-q7qg8_35b64669-fe37-4668-b162-d5dd7034c8ec/telemeter-client/0.log" Sep 10 12:52:12.080300 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:12.080283 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76748f497c-q7qg8_35b64669-fe37-4668-b162-d5dd7034c8ec/reload/0.log" Sep 10 12:52:12.138749 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:12.138727 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76748f497c-q7qg8_35b64669-fe37-4668-b162-d5dd7034c8ec/kube-rbac-proxy/0.log" Sep 10 12:52:14.364160 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.364124 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd"] Sep 10 12:52:14.367884 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.367867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.370114 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.370095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rnfcr\"/\"default-dockercfg-gqxt4\"" Sep 10 12:52:14.370248 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.370115 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnfcr\"/\"openshift-service-ca.crt\"" Sep 10 12:52:14.370943 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.370927 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnfcr\"/\"kube-root-ca.crt\"" Sep 10 12:52:14.378625 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.378606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd"] Sep 10 12:52:14.445708 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.445680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-sys\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.445827 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.445711 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfn57\" (UniqueName: \"kubernetes.io/projected/36868809-6295-41f0-afc3-078ed954ba1c-kube-api-access-zfn57\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.445827 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.445776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-podres\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.445827 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.445807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-lib-modules\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.445944 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.445878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-proc\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546637 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-lib-modules\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546786 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-proc\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546786 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-sys\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546786 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfn57\" (UniqueName: \"kubernetes.io/projected/36868809-6295-41f0-afc3-078ed954ba1c-kube-api-access-zfn57\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546786 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-podres\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546967 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546800 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-lib-modules\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546967 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-proc\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546967 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-sys\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.546967 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.546919 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36868809-6295-41f0-afc3-078ed954ba1c-podres\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.555644 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.555622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfn57\" (UniqueName: \"kubernetes.io/projected/36868809-6295-41f0-afc3-078ed954ba1c-kube-api-access-zfn57\") pod \"perf-node-gather-daemonset-pkxgd\" (UID: \"36868809-6295-41f0-afc3-078ed954ba1c\") " pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.678427 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.678354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:14.952848 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:14.952825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd"] Sep 10 12:52:14.955338 ip-10-0-140-44 kubenswrapper[2579]: W0910 12:52:14.955317 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36868809_6295_41f0_afc3_078ed954ba1c.slice/crio-8538f049cf66d72117eb63916b20f4d0b9b5160a8531870f44468712f15d0af4 WatchSource:0}: Error finding container 8538f049cf66d72117eb63916b20f4d0b9b5160a8531870f44468712f15d0af4: Status 404 returned error can't find the container with id 8538f049cf66d72117eb63916b20f4d0b9b5160a8531870f44468712f15d0af4 Sep 10 12:52:15.869510 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:15.869474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" event={"ID":"36868809-6295-41f0-afc3-078ed954ba1c","Type":"ContainerStarted","Data":"3732ad2f22e72adc0351d01d227529ff75edb684a5ef160f99b00ca8d61dc013"} Sep 10 12:52:15.869922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:15.869533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" event={"ID":"36868809-6295-41f0-afc3-078ed954ba1c","Type":"ContainerStarted","Data":"8538f049cf66d72117eb63916b20f4d0b9b5160a8531870f44468712f15d0af4"} Sep 10 12:52:15.869922 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:15.869561 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:15.892525 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:15.892474 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" podStartSLOduration=1.892458441 podStartE2EDuration="1.892458441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:52:15.888926668 +0000 UTC m=+606.539890419" watchObservedRunningTime="2026-09-10 12:52:15.892458441 +0000 UTC m=+606.543422188" Sep 10 12:52:17.091898 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:17.091869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dr6f_4770560d-99aa-41a2-bc7f-29534b80ed65/dns/0.log" Sep 10 12:52:17.144702 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:17.144674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dr6f_4770560d-99aa-41a2-bc7f-29534b80ed65/kube-rbac-proxy/0.log" Sep 10 12:52:17.479326 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:17.479286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7ft7_532efd3a-4395-4b80-914c-654988832fb5/dns-node-resolver/0.log" Sep 10 12:52:18.163224 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:18.163188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64fmz_edf08a7d-7299-4812-bce4-a01b714e21b0/node-ca/0.log" Sep 10 12:52:19.636213 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:19.636184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/1.log" Sep 10 12:52:19.636653 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:19.636556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/0.log" Sep 10 12:52:19.682192 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:19.682149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r596k_9c8a060f-3471-4eda-8810-941623639681/payload-pre-processing/0.log" Sep 10 12:52:20.692685 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:20.692659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pklwq_8bdfb7d0-5c86-4ac1-b9a6-1c7697474991/serve-healthcheck-canary/0.log" Sep 10 12:52:21.498473 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:21.498446 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pd6c_b3cd3d55-cdda-48ff-bec5-44d8e84a3a53/kube-rbac-proxy/0.log" Sep 10 12:52:21.554056 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:21.554026 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pd6c_b3cd3d55-cdda-48ff-bec5-44d8e84a3a53/exporter/0.log" Sep 10 12:52:21.592309 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:21.592285 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pd6c_b3cd3d55-cdda-48ff-bec5-44d8e84a3a53/extractor/0.log" Sep 10 12:52:21.885191 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:21.885120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rnfcr/perf-node-gather-daemonset-pkxgd" Sep 10 12:52:24.693751 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:24.693715 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-48jgl_0a15a009-c259-4586-b462-2841e5331b1a/manager/0.log" Sep 10 12:52:24.751597 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:24.751572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/1.log" Sep 10 12:52:24.752045 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:24.752028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/0.log" Sep 10 12:52:24.804905 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:24.804868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r596k_9c8a060f-3471-4eda-8810-941623639681/payload-pre-processing/0.log" Sep 10 12:52:24.807583 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:24.807564 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5ddfb77fc5-9kszr_90e8bd7a-41be-40be-8eb2-dba28695047f/manager/0.log" Sep 10 12:52:25.107493 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:25.107404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b549dd4b8-2k6bw_ad0d408d-fcd2-4569-b546-8b40738a48e5/manager/0.log" Sep 10 12:52:25.140969 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:25.140943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b549dd4b8-2k6bw_ad0d408d-fcd2-4569-b546-8b40738a48e5/copy-manifests/0.log" Sep 10 12:52:26.273178 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:26.273094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/1.log" Sep 10 12:52:26.273573 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:26.273431 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jjw2f_764fbdb2-c6d1-41dd-9050-cece61c3f505/istio-proxy/0.log" Sep 10 12:52:26.296692 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:26.296665 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r596k_9c8a060f-3471-4eda-8810-941623639681/payload-pre-processing/0.log" Sep 10 12:52:26.750946 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:26.750917 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85854c564c-7749f_ef86d821-c1d9-4a30-ba11-a1e94589e197/manager/0.log" Sep 10 12:52:26.843892 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:26.843863 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xhcms_08a75a92-087b-46fe-9679-06ed565c0c34/openshift-lws-operator/0.log" Sep 10 12:52:32.013162 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:32.013024 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nmgkp_f63198a3-6fec-47f9-b0f6-06693c2b436c/migrator/0.log" Sep 10 12:52:32.039353 ip-10-0-140-44 kubenswrapper[2579]: I0910 12:52:32.039322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nmgkp_f63198a3-6fec-47f9-b0f6-06693c2b436c/graceful-termination/0.log"