Sep 16 18:40:33.295642 ip-10-0-130-28 systemd[1]: Starting Kubernetes Kubelet... Sep 16 18:40:33.718537 ip-10-0-130-28 kubenswrapper[2528]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 18:40:33.718537 ip-10-0-130-28 kubenswrapper[2528]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 18:40:33.718537 ip-10-0-130-28 kubenswrapper[2528]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 18:40:33.718537 ip-10-0-130-28 kubenswrapper[2528]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 18:40:33.718537 ip-10-0-130-28 kubenswrapper[2528]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 18:40:33.719673 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.719580 2528 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 18:40:33.725432 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725414 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.725432 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725433 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725438 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725442 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725446 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725449 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725452 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725455 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725458 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725460 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725463 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725466 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725468 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725471 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725473 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725476 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725480 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725484 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725487 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725489 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.725500 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725492 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725494 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725497 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725500 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725503 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725506 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725509 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725515 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725518 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725521 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725523 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725526 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725528 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725531 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725533 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725536 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725538 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725541 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725543 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725545 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.725952 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725548 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725550 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725553 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725555 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725560 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725563 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725567 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725570 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725573 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725575 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725577 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725580 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725582 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725585 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725588 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725592 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725595 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725597 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725600 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.726449 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725602 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725605 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725607 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725610 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725613 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725616 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725618 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725621 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725623 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725625 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725628 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725630 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725633 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725635 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725638 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725640 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725643 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725646 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725649 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725651 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.726994 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725654 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725657 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725660 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725663 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725665 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725668 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725670 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725673 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725676 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725679 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725681 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725684 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725686 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725689 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725691 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725694 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725696 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725699 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725702 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.725704 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.727498 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726409 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726416 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726418 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726422 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726424 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726427 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726429 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726432 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726435 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726437 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726440 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726442 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726445 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726448 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726451 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726454 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726456 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726459 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726462 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726465 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.727975 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726468 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726470 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726473 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726476 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726478 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726481 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726484 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726486 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726489 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726492 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726495 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726497 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726500 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726502 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726505 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726508 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726510 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726513 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726515 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726518 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.728538 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726520 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726523 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726526 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726529 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726532 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726535 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726538 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726540 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726545 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726548 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726550 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726554 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726557 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726562 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726565 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726568 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726571 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726576 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.729032 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726580 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726583 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726586 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726589 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726592 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726595 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726598 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726601 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726604 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726607 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726609 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726612 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726615 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726617 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726619 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726622 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726625 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726628 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726630 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726633 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.729490 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726635 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726638 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726641 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726644 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726646 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726649 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726652 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726655 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726657 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726660 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726663 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726665 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726668 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726670 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726673 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726675 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726678 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726680 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726683 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726685 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.729979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.726688 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727100 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727105 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727108 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727111 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727114 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727117 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727120 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727124 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727126 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727129 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727132 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727136 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727140 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727143 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727146 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727149 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727152 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727155 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.730485 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727158 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727161 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727163 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727166 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727169 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727171 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727174 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727176 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727179 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727182 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727184 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727186 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727189 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727191 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727194 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727197 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727200 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727202 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727204 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727220 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.730945 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727224 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727227 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727230 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727233 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727236 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727239 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727241 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727244 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727247 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727250 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727252 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727255 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727257 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727260 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727262 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727265 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727267 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727270 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727272 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727275 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.731459 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727277 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727280 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727282 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727285 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727288 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727291 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727295 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727298 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727301 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727303 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727306 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727308 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727311 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727329 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727333 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727335 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727338 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727340 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727343 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727346 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.731958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727350 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727352 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727355 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727358 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727360 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727363 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727366 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727368 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727371 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727373 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727376 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727378 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727381 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727384 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727386 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727389 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727391 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727397 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727399 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727402 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.732462 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.727404 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727476 2528 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727515 2528 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727525 2528 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727530 2528 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727534 2528 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727538 2528 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727542 2528 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727547 2528 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727550 2528 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727553 2528 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727556 2528 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727560 2528 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727564 2528 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727567 2528 flags.go:64] FLAG: --cgroup-root="" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727570 2528 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727573 2528 flags.go:64] FLAG: --client-ca-file="" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727576 2528 flags.go:64] FLAG: --cloud-provider="external" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727579 2528 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727583 2528 flags.go:64] FLAG: --cluster-domain="" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727586 2528 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727589 2528 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727592 2528 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727595 2528 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 18:40:33.732954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727599 2528 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727602 2528 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727605 2528 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727608 2528 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727611 2528 flags.go:64] FLAG: --contention-profiling="false" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727616 2528 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727619 2528 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727622 2528 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727625 2528 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727629 2528 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727632 2528 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727635 2528 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727639 2528 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727642 2528 flags.go:64] FLAG: --enable-server="true" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727644 2528 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727650 2528 flags.go:64] FLAG: --event-burst="100" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727653 2528 flags.go:64] FLAG: --event-qps="50" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727656 2528 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727659 2528 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727662 2528 flags.go:64] FLAG: --eviction-hard="" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727666 2528 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727669 2528 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727673 2528 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727676 2528 flags.go:64] FLAG: --eviction-soft="" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727679 2528 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 18:40:33.733570 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727682 2528 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727685 2528 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727688 2528 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727690 2528 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727693 2528 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727696 2528 flags.go:64] FLAG: --feature-gates="" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727700 2528 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727703 2528 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727706 2528 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727709 2528 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727712 2528 flags.go:64] FLAG: --healthz-port="10248" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727715 2528 flags.go:64] FLAG: --help="false" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727719 2528 flags.go:64] FLAG: --hostname-override="ip-10-0-130-28.ec2.internal" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727722 2528 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727725 2528 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727728 2528 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727731 2528 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727735 2528 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727737 2528 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727740 2528 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727743 2528 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727746 2528 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727749 2528 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727752 2528 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 18:40:33.734184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727755 2528 flags.go:64] FLAG: --kube-reserved="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727758 2528 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727762 2528 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727765 2528 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727768 2528 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727771 2528 flags.go:64] FLAG: --lock-file="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727779 2528 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727782 2528 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727785 2528 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727795 2528 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727798 2528 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727801 2528 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727804 2528 flags.go:64] FLAG: --logging-format="text" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727807 2528 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727810 2528 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727813 2528 flags.go:64] FLAG: --manifest-url="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727816 2528 flags.go:64] FLAG: --manifest-url-header="" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727820 2528 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727823 2528 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727827 2528 flags.go:64] FLAG: --max-pods="110" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727831 2528 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727834 2528 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727837 2528 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727840 2528 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727844 2528 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 18:40:33.734831 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727847 2528 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727850 2528 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727857 2528 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727860 2528 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727863 2528 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727867 2528 flags.go:64] FLAG: --pod-cidr="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727869 2528 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727875 2528 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727878 2528 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727881 2528 flags.go:64] FLAG: --pods-per-core="0" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727884 2528 flags.go:64] FLAG: --port="10250" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727887 2528 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727890 2528 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03cd44064d2a2a72f" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727893 2528 flags.go:64] FLAG: --qos-reserved="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727897 2528 flags.go:64] FLAG: --read-only-port="10255" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727900 2528 flags.go:64] FLAG: --register-node="true" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727903 2528 flags.go:64] FLAG: --register-with-taints="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727906 2528 flags.go:64] FLAG: --registry-burst="10" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727909 2528 flags.go:64] FLAG: --registry-qps="5" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727911 2528 flags.go:64] FLAG: --reserved-cpus="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727914 2528 flags.go:64] FLAG: --reserved-memory="" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727918 2528 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727921 2528 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727924 2528 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727926 2528 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 18:40:33.735483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727929 2528 flags.go:64] FLAG: --runonce="false" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727932 2528 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727936 2528 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727940 2528 flags.go:64] FLAG: --seccomp-default="false" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727943 2528 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727947 2528 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727950 2528 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727953 2528 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727956 2528 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727959 2528 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727962 2528 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727965 2528 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727968 2528 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727971 2528 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727974 2528 flags.go:64] FLAG: --system-cgroups="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727977 2528 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727983 2528 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727986 2528 flags.go:64] FLAG: --tls-cert-file="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727989 2528 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727993 2528 flags.go:64] FLAG: --tls-min-version="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727996 2528 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.727999 2528 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728002 2528 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728005 2528 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728008 2528 flags.go:64] FLAG: --v="2" Sep 16 18:40:33.736095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728012 2528 flags.go:64] FLAG: --version="false" Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728017 2528 flags.go:64] FLAG: --vmodule="" Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728020 2528 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728023 2528 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728145 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728149 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728153 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728157 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728160 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728163 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728166 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728169 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728174 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728176 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728179 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728182 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728185 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728188 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728190 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728193 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.736779 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728196 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728198 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728201 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728203 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728206 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728209 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728211 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728214 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728217 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728219 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728228 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728231 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728233 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728236 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728239 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728242 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728244 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728247 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728249 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728252 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.737278 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728254 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728257 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728260 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728263 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728266 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728269 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728271 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728274 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728277 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728280 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728284 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728287 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728290 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728293 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728296 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728298 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728301 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728305 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728308 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.737787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728311 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728314 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728330 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728333 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728337 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728340 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728343 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728346 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728349 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728351 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728354 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728357 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728359 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728363 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728365 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728368 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728371 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728375 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728378 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728380 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.738249 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728383 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728386 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728388 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728391 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728394 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728397 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728406 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728411 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728414 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728419 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728422 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728425 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728427 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728430 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728432 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728435 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728438 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728442 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728445 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728447 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.738759 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728450 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728452 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728455 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.728457 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.728463 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.736446 2528 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.736465 2528 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.736488 2528 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.736497 2528 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736554 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736560 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736563 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736566 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736568 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736571 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.739236 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736574 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736577 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736580 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736583 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736585 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736588 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736591 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736594 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736596 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736599 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736601 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736604 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736606 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736609 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736612 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736615 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736617 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736620 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736622 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736625 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.739638 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736628 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736630 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736633 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736637 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736642 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736646 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736649 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736651 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736654 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736657 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736660 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736663 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736666 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736669 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736672 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736674 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736677 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736680 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736682 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.740141 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736685 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736687 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736690 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736693 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736695 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736698 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736700 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736703 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736707 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736710 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736713 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736716 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736719 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736722 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736725 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736728 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736731 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736735 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736738 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736741 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.740684 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736743 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736746 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736748 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736751 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736754 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736757 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736759 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736762 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736766 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736770 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736773 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736775 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736778 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736780 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736784 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736787 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736790 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736792 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736795 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.741175 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736798 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736800 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736803 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736806 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736809 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736811 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736814 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736817 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736819 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736822 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736825 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736828 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736831 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736833 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736836 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.736842 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 18:40:33.741660 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736961 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736967 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736970 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736972 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736975 2528 feature_gate.go:328] unrecognized feature gate: Example Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736978 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736981 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736983 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736986 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736989 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736992 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736994 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.736997 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737000 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737002 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737006 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737011 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737014 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737017 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737019 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 18:40:33.742064 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737022 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737025 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737027 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737030 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737033 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737035 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737038 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737041 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737044 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737047 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737050 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737053 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737055 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737058 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737061 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737063 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737066 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737069 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737071 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737074 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 18:40:33.742587 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737076 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737079 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737081 2528 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737084 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737086 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737089 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737092 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737094 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737097 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737100 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737104 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737106 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737109 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737112 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737114 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737117 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737119 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737122 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737125 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737127 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 18:40:33.743085 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737130 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737136 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737139 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737142 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737144 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737147 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737149 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737152 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737154 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737157 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737161 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737164 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737166 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737170 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737172 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737175 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737178 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737181 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737183 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737186 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 18:40:33.743600 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737189 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737193 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737196 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737198 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737201 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737204 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737206 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737209 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737212 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737215 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737217 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737220 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737222 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737225 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737228 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737231 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737234 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737236 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 18:40:33.744096 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:33.737239 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.737244 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.737383 2528 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.739628 2528 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.740675 2528 server.go:1019] "Starting client certificate rotation" Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.740728 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.740768 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 18:40:33.744717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.743496 2528 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 18:40:33.745736 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.745718 2528 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 18:40:33.759654 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.759626 2528 log.go:25] "Validated CRI v1 runtime API" Sep 16 18:40:33.763281 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.763263 2528 log.go:25] "Validated CRI v1 image API" Sep 16 18:40:33.764117 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.764097 2528 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 18:40:33.766351 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.766310 2528 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c60e82a7-7082-4315-921a-e58592a37497:/dev/nvme0n1p3 e91ce4db-e193-4d97-86a8-14f09b3af6e2:/dev/nvme0n1p4] Sep 16 18:40:33.766425 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.766349 2528 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 18:40:33.770992 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.770971 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 18:40:33.771868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.771749 2528 manager.go:216] Machine: {Timestamp:2026-09-16 18:40:33.770361187 +0000 UTC m=+0.348892795 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098370 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2abbe25475f263bd7edcca439b20b0 SystemUUID:ec2abbe2-5475-f263-bd7e-dcca439b20b0 BootID:e5a6a544-b6b5-46a4-bb07-f19c8c78d6f1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cc:ff:7c:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cc:ff:7c:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:58:15:33:3a:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 18:40:33.771868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.771864 2528 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 18:40:33.771981 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.771950 2528 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 18:40:33.775455 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.775426 2528 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 18:40:33.775633 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.775457 2528 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 18:40:33.776286 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.776274 2528 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 18:40:33.776357 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.776293 2528 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 18:40:33.776357 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.776304 2528 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 18:40:33.779102 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.779089 2528 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 18:40:33.780004 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.779992 2528 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 18:40:33.783533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783518 2528 state_mem.go:36] "Initialized new in-memory state store" Sep 16 18:40:33.783680 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783668 2528 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 18:40:33.783736 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783714 2528 kubelet.go:486] "Attempting to sync node with API server" Sep 16 18:40:33.783781 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783737 2528 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 18:40:33.783781 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783753 2528 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 18:40:33.783781 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783768 2528 kubelet.go:398] "Adding apiserver pod source" Sep 16 18:40:33.783781 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.783780 2528 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 18:40:33.784184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.784169 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 18:40:33.784247 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.784193 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 18:40:33.786645 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.786630 2528 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 18:40:33.788819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.788804 2528 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 18:40:33.788886 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.788834 2528 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 18:40:33.790399 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790388 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 18:40:33.790437 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790404 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 18:40:33.790437 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790411 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 18:40:33.790437 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790416 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 18:40:33.790437 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790425 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 18:40:33.790437 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790430 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790443 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790448 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790455 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790461 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790474 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 18:40:33.790652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.790479 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 18:40:33.791869 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.791856 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 18:40:33.791869 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.791866 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 18:40:33.794064 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.794040 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 18:40:33.794124 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.794048 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 18:40:33.795814 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.795799 2528 server.go:1268] "Started kubelet" Sep 16 18:40:33.795891 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.795864 2528 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 18:40:33.796206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.796049 2528 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 18:40:33.796206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.796134 2528 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 18:40:33.796743 ip-10-0-130-28 systemd[1]: Started Kubernetes Kubelet. Sep 16 18:40:33.797801 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.797783 2528 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 18:40:33.804707 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.804421 2528 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 18:40:33.804853 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.804842 2528 server.go:310] "Adding debug handlers to kubelet server" Sep 16 18:40:33.805489 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.805472 2528 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 18:40:33.806963 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.805518 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-28.ec2.internal.18d5e132761b81aa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-28.ec2.internal,UID:ip-10-0-130-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-28.ec2.internal,},FirstTimestamp:2026-09-16 18:40:33.795768746 +0000 UTC m=+0.374300354,LastTimestamp:2026-09-16 18:40:33.795768746 +0000 UTC m=+0.374300354,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-28.ec2.internal,}" Sep 16 18:40:33.807278 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.807257 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 18:40:33.807964 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.807943 2528 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 18:40:33.808140 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.808121 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:33.808646 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808625 2528 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 18:40:33.808646 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808646 2528 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 18:40:33.808786 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808730 2528 factory.go:55] Registering systemd factory Sep 16 18:40:33.808786 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808743 2528 reconstruct.go:97] "Volume reconstruction finished" Sep 16 18:40:33.808786 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808749 2528 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 18:40:33.808786 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808746 2528 factory.go:223] Registration of the systemd container factory successfully Sep 16 18:40:33.808786 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808753 2528 reconciler.go:29] "Reconciler: start to sync state" Sep 16 18:40:33.809004 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.808990 2528 factory.go:153] Registering CRI-O factory Sep 16 18:40:33.809036 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.809009 2528 factory.go:223] Registration of the crio container factory successfully Sep 16 18:40:33.809067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.809061 2528 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 18:40:33.809102 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.809081 2528 factory.go:103] Registering Raw factory Sep 16 18:40:33.809102 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.809093 2528 manager.go:1196] Started watching for new ooms in manager Sep 16 18:40:33.809500 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.809488 2528 manager.go:349] Starting recovery of all containers Sep 16 18:40:33.812464 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.812434 2528 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 18:40:33.812568 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.812538 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 16 18:40:33.822072 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.822056 2528 manager.go:354] Recovery completed Sep 16 18:40:33.826660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.826644 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:33.828735 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.828705 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:33.828795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.828759 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:33.828795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.828775 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:33.829452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.829435 2528 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 18:40:33.829452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.829449 2528 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 18:40:33.829582 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.829463 2528 state_mem.go:36] "Initialized new in-memory state store" Sep 16 18:40:33.829582 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.829513 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:33.830279 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830264 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:33.830359 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830294 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:33.830359 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830310 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:33.830680 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.830582 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-28.ec2.internal.18d5e13278128c37 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-28.ec2.internal,UID:ip-10-0-130-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-28.ec2.internal,},FirstTimestamp:2026-09-16 18:40:33.828736055 +0000 UTC m=+0.407267667,LastTimestamp:2026-09-16 18:40:33.828736055 +0000 UTC m=+0.407267667,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-28.ec2.internal,}" Sep 16 18:40:33.830741 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830730 2528 policy_none.go:49] "None policy: Start" Sep 16 18:40:33.830778 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830744 2528 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 18:40:33.830778 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.830756 2528 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 18:40:33.831943 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.831927 2528 policy_none.go:47] "Start" Sep 16 18:40:33.839809 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.839724 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-28.ec2.internal.18d5e13278130259 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-28.ec2.internal,UID:ip-10-0-130-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-28.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-28.ec2.internal,},FirstTimestamp:2026-09-16 18:40:33.828766297 +0000 UTC m=+0.407297907,LastTimestamp:2026-09-16 18:40:33.828766297 +0000 UTC m=+0.407297907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-28.ec2.internal,}" Sep 16 18:40:33.846944 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.846649 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xrhm" Sep 16 18:40:33.848871 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.848801 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-28.ec2.internal.18d5e132781338ee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-28.ec2.internal,UID:ip-10-0-130-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-28.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-28.ec2.internal,},FirstTimestamp:2026-09-16 18:40:33.82878027 +0000 UTC m=+0.407311879,LastTimestamp:2026-09-16 18:40:33.82878027 +0000 UTC m=+0.407311879,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-28.ec2.internal,}" Sep 16 18:40:33.855499 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.855266 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xrhm" Sep 16 18:40:33.856529 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.856461 2528 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-28.ec2.internal.18d5e13278128c37\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-28.ec2.internal.18d5e13278128c37 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-28.ec2.internal,UID:ip-10-0-130-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-28.ec2.internal,},FirstTimestamp:2026-09-16 18:40:33.828736055 +0000 UTC m=+0.407267667,LastTimestamp:2026-09-16 18:40:33.83027899 +0000 UTC m=+0.408810607,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-28.ec2.internal,}" Sep 16 18:40:33.870132 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.870112 2528 manager.go:337] "Starting Device Plugin manager" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.870160 2528 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.870174 2528 server.go:87] "Starting device plugin registration server" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.870577 2528 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.870626 2528 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.871202 2528 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.871287 2528 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.871297 2528 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.872054 2528 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 18:40:33.882167 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.872104 2528 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:33.907969 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.907924 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 18:40:33.909108 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.909079 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 18:40:33.909221 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.909131 2528 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 18:40:33.909221 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.909203 2528 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 18:40:33.909331 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.909307 2528 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 18:40:33.911849 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.911827 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 18:40:33.971269 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.971157 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:33.972242 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.972223 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:33.972353 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.972255 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:33.972353 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.972266 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:33.972353 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.972292 2528 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-28.ec2.internal" Sep 16 18:40:33.981948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:33.981929 2528 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-28.ec2.internal" Sep 16 18:40:33.982000 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.981957 2528 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-28.ec2.internal\": node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:33.996020 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:33.995998 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.009615 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.009581 2528 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal"] Sep 16 18:40:34.009734 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.009654 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:34.010750 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.010733 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:34.010841 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.010768 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:34.010841 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.010799 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:34.012354 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.012338 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:34.012541 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.012523 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.012611 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.012555 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:34.013158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013140 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:34.013237 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013171 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:34.013237 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013183 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:34.013237 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013187 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:34.013237 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013209 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:34.013237 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.013218 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:34.014862 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.014849 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.014920 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.014872 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:34.015604 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.015589 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:34.015681 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.015615 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:34.015681 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.015625 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:34.039122 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.039092 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-28.ec2.internal\" not found" node="ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.043764 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.043747 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-28.ec2.internal\" not found" node="ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.096877 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.096848 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.110201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.110173 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.110298 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.110210 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09f1ac8d1bb41b4ad31726e0bf202fb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-28.ec2.internal\" (UID: \"09f1ac8d1bb41b4ad31726e0bf202fb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.110298 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.110233 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.197475 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.197433 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.211056 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211022 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.211201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211062 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.211201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211104 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09f1ac8d1bb41b4ad31726e0bf202fb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-28.ec2.internal\" (UID: \"09f1ac8d1bb41b4ad31726e0bf202fb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.211201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211136 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.211201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211156 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09f1ac8d1bb41b4ad31726e0bf202fb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-28.ec2.internal\" (UID: \"09f1ac8d1bb41b4ad31726e0bf202fb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.211201 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.211193 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80971e7a50769b9a4eacc82d13c1b2e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal\" (UID: \"80971e7a50769b9a4eacc82d13c1b2e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.298579 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.298506 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.343080 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.343051 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.348127 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.348108 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:34.398975 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.398940 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.499686 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.499625 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.600783 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.600690 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.705119 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.705079 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.740213 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.740182 2528 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 18:40:34.740711 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.740329 2528 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 18:40:34.805983 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.805942 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.859770 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.859668 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 18:35:34 +0000 UTC" deadline="2028-02-23 09:50:32.551433742 +0000 UTC" Sep 16 18:40:34.859770 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.859715 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12591h9m57.691722737s" Sep 16 18:40:34.876561 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:34.876521 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f1ac8d1bb41b4ad31726e0bf202fb7.slice/crio-3485020a24736688814518c2f6a041cf033796e7f4d6c84606429406c210a10d WatchSource:0}: Error finding container 3485020a24736688814518c2f6a041cf033796e7f4d6c84606429406c210a10d: Status 404 returned error can't find the container with id 3485020a24736688814518c2f6a041cf033796e7f4d6c84606429406c210a10d Sep 16 18:40:34.876804 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:34.876790 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80971e7a50769b9a4eacc82d13c1b2e7.slice/crio-a426a224c31f19b47f6b040a2e4e75efcbb9fb8ac9d3e68d3b6b4ca54175d0bf WatchSource:0}: Error finding container a426a224c31f19b47f6b040a2e4e75efcbb9fb8ac9d3e68d3b6b4ca54175d0bf: Status 404 returned error can't find the container with id a426a224c31f19b47f6b040a2e4e75efcbb9fb8ac9d3e68d3b6b4ca54175d0bf Sep 16 18:40:34.881167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.881147 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 18:40:34.906721 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:34.906686 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:34.914135 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.914089 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" event={"ID":"80971e7a50769b9a4eacc82d13c1b2e7","Type":"ContainerStarted","Data":"a426a224c31f19b47f6b040a2e4e75efcbb9fb8ac9d3e68d3b6b4ca54175d0bf"} Sep 16 18:40:34.915207 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.915180 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" event={"ID":"09f1ac8d1bb41b4ad31726e0bf202fb7","Type":"ContainerStarted","Data":"3485020a24736688814518c2f6a041cf033796e7f4d6c84606429406c210a10d"} Sep 16 18:40:34.923945 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.923915 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 18:40:34.924896 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.924877 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientMemory" Sep 16 18:40:34.925002 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.924913 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 18:40:34.925002 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:34.924928 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeHasSufficientPID" Sep 16 18:40:35.007914 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.007877 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:35.108999 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.108958 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-28.ec2.internal\" not found" Sep 16 18:40:35.179674 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.179583 2528 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 18:40:35.203881 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.203844 2528 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 18:40:35.208662 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.208639 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" Sep 16 18:40:35.224374 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.224349 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 18:40:35.225510 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.225460 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" Sep 16 18:40:35.241842 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.241818 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 18:40:35.400612 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.400580 2528 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 18:40:35.785452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.785414 2528 apiserver.go:52] "Watching apiserver" Sep 16 18:40:35.796760 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.796729 2528 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 18:40:35.798309 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.798275 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq","openshift-cluster-node-tuning-operator/tuned-vrr4j","openshift-image-registry/node-ca-hrl8s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal","openshift-multus/multus-additional-cni-plugins-9dzlc","openshift-multus/multus-kqrjf","kube-system/konnectivity-agent-6lrkx","openshift-dns/node-resolver-k856b","openshift-multus/network-metrics-daemon-72z2n","openshift-network-diagnostics/network-check-target-gc2rp","openshift-network-operator/iptables-alerter-vww2q","openshift-ovn-kubernetes/ovnkube-node-t9bng","kube-system/global-pull-secret-syncer-p8kgc"] Sep 16 18:40:35.800339 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.800310 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.801982 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.801905 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:35.802098 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.802011 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:35.803103 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803080 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.803205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803101 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 18:40:35.803205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803175 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.803358 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803336 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-777c7\"" Sep 16 18:40:35.803659 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803642 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 18:40:35.803778 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.803756 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.804382 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.804361 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.805622 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.805600 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.805711 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.805684 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:35.805911 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.805891 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.806309 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.806293 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pw4tg\"" Sep 16 18:40:35.807189 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807167 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.807337 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807298 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.807447 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807373 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.807447 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807387 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rbwd6\"" Sep 16 18:40:35.807557 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807298 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 18:40:35.807767 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.807749 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 18:40:35.808320 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.808295 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.810378 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.810160 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 18:40:35.810378 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.810174 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 18:40:35.810378 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.810164 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wmxd8\"" Sep 16 18:40:35.810607 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.810590 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.812198 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.812181 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.813288 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.813269 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42vhc\"" Sep 16 18:40:35.813458 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.813276 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.813458 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.813275 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.814271 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.814253 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.815312 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815257 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vg8fr\"" Sep 16 18:40:35.815430 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815348 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 18:40:35.815430 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815380 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.815430 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815410 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.815699 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815681 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 18:40:35.815814 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.815797 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:35.816520 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.816484 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:35.817011 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.816850 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 18:40:35.817011 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.816861 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 18:40:35.817265 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.817243 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 18:40:35.817738 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.817498 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.817738 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.817625 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.817902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.817791 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:35.817902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.817826 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gbvkb\"" Sep 16 18:40:35.819793 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.819774 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:35.820634 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.820614 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 18:40:35.820744 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.820657 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tzrkn\"" Sep 16 18:40:35.820744 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.820677 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 18:40:35.821592 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821572 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-cnibin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.821700 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821597 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-cni-binary-copy\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.821700 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821624 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-netns\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.821700 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821655 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-bin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.821858 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821701 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.821858 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821745 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-sys\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.821858 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821794 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-system-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.821858 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821824 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-k8s-cni-cncf-io\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.822047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.821862 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-multus\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.822047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822008 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-lib-modules\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.822047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822028 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-host\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.822047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822045 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-etc-tuned\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822088 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-kubelet-config\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822130 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-hostroot\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822146 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822178 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c320b0f-ee18-4b39-bb91-01f2e809495b-hosts-file\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822196 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzr8\" (UniqueName: \"kubernetes.io/projected/4c320b0f-ee18-4b39-bb91-01f2e809495b-kube-api-access-kfzr8\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822211 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-tmp\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.822236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822227 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z52ck\" (UniqueName: \"kubernetes.io/projected/6be3e366-9d55-4822-a591-5cd294186bed-kube-api-access-z52ck\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.822541 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822242 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c56zz\" (UniqueName: \"kubernetes.io/projected/5defc264-c4d3-4972-b2de-9c85a3978486-kube-api-access-c56zz\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.822541 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.822265 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-dbus\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.823503 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-system-cni-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.823604 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-conf\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.823681 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-kubelet\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.823724 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2xsv\" (UniqueName: \"kubernetes.io/projected/beac7ae2-161f-4f06-a551-b3fccd851dc7-kube-api-access-d2xsv\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.823924 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.824152 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c320b0f-ee18-4b39-bb91-01f2e809495b-tmp-dir\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.824814 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysconfig\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.824960 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-kubernetes\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825001 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825022 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g89zc\"" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825030 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-var-lib-kubelet\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825290 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-systemd\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825326 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-run\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825477 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825488 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5defc264-c4d3-4972-b2de-9c85a3978486-serviceca\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825539 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825757 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825755 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-conf-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.825948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825892 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-daemon-config\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.825954 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-multus-certs\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826006 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-etc-kubernetes\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826045 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826175 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-modprobe-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826233 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5defc264-c4d3-4972-b2de-9c85a3978486-host\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826293 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-socket-dir-parent\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826349 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826472 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cnibin\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826558 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826696 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6cs7\" (UniqueName: \"kubernetes.io/projected/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-kube-api-access-c6cs7\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.826952 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.826747 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.828615 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.828583 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 18:40:35.857697 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.857671 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vgscv" Sep 16 18:40:35.869660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.869633 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vgscv" Sep 16 18:40:35.909760 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.909720 2528 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 18:40:35.927650 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927608 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tscnh\" (UniqueName: \"kubernetes.io/projected/2397aac8-2d8f-4b03-8240-0eb87c82311f-kube-api-access-tscnh\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927661 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-cnibin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927690 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-cni-binary-copy\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927710 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-netns\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927726 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-bin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927751 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927773 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-sys\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927797 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-lib-modules\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.927833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927815 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-k8s-cni-cncf-io\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927844 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-etc-tuned\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927872 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-kubelet-config\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927903 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-slash\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927927 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-netns\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927965 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-log-socket\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.927985 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-bin\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928002 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-netd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928018 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-hostroot\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928038 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z52ck\" (UniqueName: \"kubernetes.io/projected/6be3e366-9d55-4822-a591-5cd294186bed-kube-api-access-z52ck\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928063 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-systemd-units\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928093 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-registration-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928124 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928146 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8ps\" (UniqueName: \"kubernetes.io/projected/1aa6138f-2482-4e97-8488-fa5a76286249-kube-api-access-zj8ps\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928171 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-conf\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928187 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovn-node-metrics-cert\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.928215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928202 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-socket-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928247 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928266 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c320b0f-ee18-4b39-bb91-01f2e809495b-tmp-dir\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928286 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-netns\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928291 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-kubernetes\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928316 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-var-lib-kubelet\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928331 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-bin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928340 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-run\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928358 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5defc264-c4d3-4972-b2de-9c85a3978486-serviceca\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928407 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-cni-binary-copy\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928538 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-cnibin\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928592 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-hostroot\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.928887 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928880 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5defc264-c4d3-4972-b2de-9c85a3978486-serviceca\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928956 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.928977 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-conf\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929032 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-var-lib-kubelet\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929054 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-sys\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929101 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-run\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929111 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929128 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-lib-modules\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929148 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-kubelet-config\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929156 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-config\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929055 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-kubernetes\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929190 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-device-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929171 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c320b0f-ee18-4b39-bb91-01f2e809495b-tmp-dir\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929207 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-k8s-cni-cncf-io\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929241 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-multus-certs\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929267 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-run-multus-certs\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929278 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-etc-kubernetes\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.929299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929302 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5defc264-c4d3-4972-b2de-9c85a3978486-host\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929353 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-etc-kubernetes\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929397 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929426 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929450 2528 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929472 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5defc264-c4d3-4972-b2de-9c85a3978486-host\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929512 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-socket-dir-parent\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929558 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929609 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6cs7\" (UniqueName: \"kubernetes.io/projected/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-kube-api-access-c6cs7\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929611 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-socket-dir-parent\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929771 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a63410-755b-47f5-83c9-6a6bb37e7e3e-agent-certs\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929823 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a63410-755b-47f5-83c9-6a6bb37e7e3e-konnectivity-ca\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929855 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2397aac8-2d8f-4b03-8240-0eb87c82311f-host-slash\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929888 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929919 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-system-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929959 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-multus\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929981 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-host\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.930057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929991 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-system-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.929998 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5qj\" (UniqueName: \"kubernetes.io/projected/b69d60c2-c582-4be2-bc2b-3c0a594b2913-kube-api-access-9r5qj\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930035 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-cni-multus\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930066 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930087 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c320b0f-ee18-4b39-bb91-01f2e809495b-hosts-file\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930135 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-host\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930149 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c320b0f-ee18-4b39-bb91-01f2e809495b-hosts-file\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930150 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-cni-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930196 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzr8\" (UniqueName: \"kubernetes.io/projected/4c320b0f-ee18-4b39-bb91-01f2e809495b-kube-api-access-kfzr8\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930213 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-tmp\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930231 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c56zz\" (UniqueName: \"kubernetes.io/projected/5defc264-c4d3-4972-b2de-9c85a3978486-kube-api-access-c56zz\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930298 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-dbus\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930327 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2397aac8-2d8f-4b03-8240-0eb87c82311f-iptables-alerter-script\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930386 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-node-log\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930416 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-system-cni-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930442 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-systemd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930468 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-var-lib-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.930848 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930599 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-ovn\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930627 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-env-overrides\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930652 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-script-lib\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930725 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5822f711-f318-4cb7-8b04-baeb464c0881-dbus\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930723 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-sys-fs\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930724 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-system-cni-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930774 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-kubelet\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930829 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xsv\" (UniqueName: \"kubernetes.io/projected/beac7ae2-161f-4f06-a551-b3fccd851dc7-kube-api-access-d2xsv\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930859 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysconfig\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930893 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvkx\" (UniqueName: \"kubernetes.io/projected/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kube-api-access-8tvkx\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930920 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-host-var-lib-kubelet\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930939 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-systemd\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.930940 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysconfig\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931019 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931069 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931170 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-conf-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931204 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-daemon-config\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.931671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931208 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-systemd\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931248 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931284 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-modprobe-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931319 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-kubelet\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.931366 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931379 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-etc-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931409 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931450 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cnibin\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931480 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.931513 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:36.431478822 +0000 UTC m=+3.010010444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931644 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.931758 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-conf-dir\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932154 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/beac7ae2-161f-4f06-a551-b3fccd851dc7-multus-daemon-config\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932211 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932218 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-cnibin\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932304 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-modprobe-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932353 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.932547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.932467 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6be3e366-9d55-4822-a591-5cd294186bed-etc-sysctl-d\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.933737 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.933715 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-tmp\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.933829 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.933747 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6be3e366-9d55-4822-a591-5cd294186bed-etc-tuned\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.940118 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.940098 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:35.940118 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.940120 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:35.940231 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.940131 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:35.940231 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:35.940181 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:36.440168066 +0000 UTC m=+3.018699678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:35.943873 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.943845 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z52ck\" (UniqueName: \"kubernetes.io/projected/6be3e366-9d55-4822-a591-5cd294186bed-kube-api-access-z52ck\") pod \"tuned-vrr4j\" (UID: \"6be3e366-9d55-4822-a591-5cd294186bed\") " pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:35.943988 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.943970 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xsv\" (UniqueName: \"kubernetes.io/projected/beac7ae2-161f-4f06-a551-b3fccd851dc7-kube-api-access-d2xsv\") pod \"multus-kqrjf\" (UID: \"beac7ae2-161f-4f06-a551-b3fccd851dc7\") " pod="openshift-multus/multus-kqrjf" Sep 16 18:40:35.943988 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.943967 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c56zz\" (UniqueName: \"kubernetes.io/projected/5defc264-c4d3-4972-b2de-9c85a3978486-kube-api-access-c56zz\") pod \"node-ca-hrl8s\" (UID: \"5defc264-c4d3-4972-b2de-9c85a3978486\") " pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:35.944086 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.944040 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzr8\" (UniqueName: \"kubernetes.io/projected/4c320b0f-ee18-4b39-bb91-01f2e809495b-kube-api-access-kfzr8\") pod \"node-resolver-k856b\" (UID: \"4c320b0f-ee18-4b39-bb91-01f2e809495b\") " pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:35.944452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:35.944435 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6cs7\" (UniqueName: \"kubernetes.io/projected/b880441f-a2bd-4dd1-a749-3a7b93c3d4b8-kube-api-access-c6cs7\") pod \"multus-additional-cni-plugins-9dzlc\" (UID: \"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8\") " pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:36.032725 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032682 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-systemd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032737 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-var-lib-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032764 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-ovn\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032766 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-systemd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032790 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-env-overrides\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032836 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-script-lib\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032853 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-var-lib-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032872 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-sys-fs\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032881 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-ovn\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.032926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032900 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvkx\" (UniqueName: \"kubernetes.io/projected/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kube-api-access-8tvkx\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032943 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032973 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-kubelet\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.032998 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-etc-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033023 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033045 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-sys-fs\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033050 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tscnh\" (UniqueName: \"kubernetes.io/projected/2397aac8-2d8f-4b03-8240-0eb87c82311f-kube-api-access-tscnh\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033060 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-run-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033113 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-kubelet\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033117 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-slash\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033146 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-netns\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033152 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-etc-openvswitch\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033174 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-log-socket\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033198 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-bin\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033209 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-slash\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033221 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-netd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.033241 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033259 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-log-socket\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.033308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033270 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-netd\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.033298 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:36.533277968 +0000 UTC m=+3.111809586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033309 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-netns\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033314 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-cni-bin\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033316 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-systemd-units\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033348 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-systemd-units\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033343 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-env-overrides\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033348 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-registration-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033396 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-registration-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033425 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033444 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8ps\" (UniqueName: \"kubernetes.io/projected/1aa6138f-2482-4e97-8488-fa5a76286249-kube-api-access-zj8ps\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033470 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovn-node-metrics-cert\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033489 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-script-lib\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033496 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-socket-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033518 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033560 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-config\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033587 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-device-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033620 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-socket-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033611 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033690 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033742 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-device-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033757 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033804 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a63410-755b-47f5-83c9-6a6bb37e7e3e-agent-certs\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033830 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a63410-755b-47f5-83c9-6a6bb37e7e3e-konnectivity-ca\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033858 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2397aac8-2d8f-4b03-8240-0eb87c82311f-host-slash\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033895 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033855 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033906 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2397aac8-2d8f-4b03-8240-0eb87c82311f-host-slash\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033956 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.033927 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5qj\" (UniqueName: \"kubernetes.io/projected/b69d60c2-c582-4be2-bc2b-3c0a594b2913-kube-api-access-9r5qj\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034005 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2397aac8-2d8f-4b03-8240-0eb87c82311f-iptables-alerter-script\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034035 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-node-log\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034103 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b69d60c2-c582-4be2-bc2b-3c0a594b2913-node-log\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.034874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034128 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovnkube-config\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.035748 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034497 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17a63410-755b-47f5-83c9-6a6bb37e7e3e-konnectivity-ca\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:36.035748 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.034750 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2397aac8-2d8f-4b03-8240-0eb87c82311f-iptables-alerter-script\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.037127 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.037102 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b69d60c2-c582-4be2-bc2b-3c0a594b2913-ovn-node-metrics-cert\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.037257 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.037234 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17a63410-755b-47f5-83c9-6a6bb37e7e3e-agent-certs\") pod \"konnectivity-agent-6lrkx\" (UID: \"17a63410-755b-47f5-83c9-6a6bb37e7e3e\") " pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:36.047558 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.047527 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvkx\" (UniqueName: \"kubernetes.io/projected/f8d54880-433c-4177-8ad6-24f2cfe9fe50-kube-api-access-8tvkx\") pod \"aws-ebs-csi-driver-node-6nkcq\" (UID: \"f8d54880-433c-4177-8ad6-24f2cfe9fe50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.048045 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.048020 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8ps\" (UniqueName: \"kubernetes.io/projected/1aa6138f-2482-4e97-8488-fa5a76286249-kube-api-access-zj8ps\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:36.048394 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.048350 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5qj\" (UniqueName: \"kubernetes.io/projected/b69d60c2-c582-4be2-bc2b-3c0a594b2913-kube-api-access-9r5qj\") pod \"ovnkube-node-t9bng\" (UID: \"b69d60c2-c582-4be2-bc2b-3c0a594b2913\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.048565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.048538 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tscnh\" (UniqueName: \"kubernetes.io/projected/2397aac8-2d8f-4b03-8240-0eb87c82311f-kube-api-access-tscnh\") pod \"iptables-alerter-vww2q\" (UID: \"2397aac8-2d8f-4b03-8240-0eb87c82311f\") " pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.113631 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.113592 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqrjf" Sep 16 18:40:36.124694 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.124662 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" Sep 16 18:40:36.137409 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.137378 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrl8s" Sep 16 18:40:36.142308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.142285 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" Sep 16 18:40:36.149415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.149387 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k856b" Sep 16 18:40:36.157559 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.157532 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:40:36.165763 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.165741 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" Sep 16 18:40:36.173988 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.173958 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:40:36.179988 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.179965 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vww2q" Sep 16 18:40:36.214110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.214076 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 18:40:36.437525 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.437439 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:36.437696 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.437583 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:36.437765 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.437698 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:37.437679965 +0000 UTC m=+4.016211577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:36.538160 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.538114 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:36.538378 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.538199 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:36.538378 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538300 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:36.538378 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538321 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:36.538378 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538326 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:36.538378 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538357 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:36.538657 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538411 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:37.53839299 +0000 UTC m=+4.116924603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:36.538657 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:36.538432 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:37.538422276 +0000 UTC m=+4.116953872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:36.811678 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.811650 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a63410_755b_47f5_83c9_6a6bb37e7e3e.slice/crio-cdf13507e18646deb95ad16f8036ce2220119cdc7eb8e994e8d8141805f5e630 WatchSource:0}: Error finding container cdf13507e18646deb95ad16f8036ce2220119cdc7eb8e994e8d8141805f5e630: Status 404 returned error can't find the container with id cdf13507e18646deb95ad16f8036ce2220119cdc7eb8e994e8d8141805f5e630 Sep 16 18:40:36.813679 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.813515 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be3e366_9d55_4822_a591_5cd294186bed.slice/crio-cf82204ac0751ca99d7873dc3604f6005fb983cfb154327280be61c3a6193c9b WatchSource:0}: Error finding container cf82204ac0751ca99d7873dc3604f6005fb983cfb154327280be61c3a6193c9b: Status 404 returned error can't find the container with id cf82204ac0751ca99d7873dc3604f6005fb983cfb154327280be61c3a6193c9b Sep 16 18:40:36.814852 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.814821 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69d60c2_c582_4be2_bc2b_3c0a594b2913.slice/crio-938d7704dc5fec66e5789ba44dd2f9281975d7ad0e8a8f8a4e049d0e51dc64a5 WatchSource:0}: Error finding container 938d7704dc5fec66e5789ba44dd2f9281975d7ad0e8a8f8a4e049d0e51dc64a5: Status 404 returned error can't find the container with id 938d7704dc5fec66e5789ba44dd2f9281975d7ad0e8a8f8a4e049d0e51dc64a5 Sep 16 18:40:36.818131 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.818105 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d54880_433c_4177_8ad6_24f2cfe9fe50.slice/crio-b2eceb3ce8aa6de24a29e57712622f85ec33c7f9cd49163b79cf642f26f82f69 WatchSource:0}: Error finding container b2eceb3ce8aa6de24a29e57712622f85ec33c7f9cd49163b79cf642f26f82f69: Status 404 returned error can't find the container with id b2eceb3ce8aa6de24a29e57712622f85ec33c7f9cd49163b79cf642f26f82f69 Sep 16 18:40:36.819258 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.819237 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeac7ae2_161f_4f06_a551_b3fccd851dc7.slice/crio-75db7230b1502e45145b4884f7c45aeec5b5a4fdfc1bded5035130a5ac938f26 WatchSource:0}: Error finding container 75db7230b1502e45145b4884f7c45aeec5b5a4fdfc1bded5035130a5ac938f26: Status 404 returned error can't find the container with id 75db7230b1502e45145b4884f7c45aeec5b5a4fdfc1bded5035130a5ac938f26 Sep 16 18:40:36.820958 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.820926 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb880441f_a2bd_4dd1_a749_3a7b93c3d4b8.slice/crio-e5c11a8ee7ec4d354e2e8040b5bf501a674fd90e2f26673f28ec5c06b3a28f23 WatchSource:0}: Error finding container e5c11a8ee7ec4d354e2e8040b5bf501a674fd90e2f26673f28ec5c06b3a28f23: Status 404 returned error can't find the container with id e5c11a8ee7ec4d354e2e8040b5bf501a674fd90e2f26673f28ec5c06b3a28f23 Sep 16 18:40:36.821770 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.821700 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c320b0f_ee18_4b39_bb91_01f2e809495b.slice/crio-f599ba4e09118ef93f180d895d6f9f5ff7ae593fe29cd17ce57a9cf628917f00 WatchSource:0}: Error finding container f599ba4e09118ef93f180d895d6f9f5ff7ae593fe29cd17ce57a9cf628917f00: Status 404 returned error can't find the container with id f599ba4e09118ef93f180d895d6f9f5ff7ae593fe29cd17ce57a9cf628917f00 Sep 16 18:40:36.823150 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.823124 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5defc264_c4d3_4972_b2de_9c85a3978486.slice/crio-361046525bbcb4852e4b55f9399438d89c8bebdd8cbc7fb5bee0df668a5d9af7 WatchSource:0}: Error finding container 361046525bbcb4852e4b55f9399438d89c8bebdd8cbc7fb5bee0df668a5d9af7: Status 404 returned error can't find the container with id 361046525bbcb4852e4b55f9399438d89c8bebdd8cbc7fb5bee0df668a5d9af7 Sep 16 18:40:36.823982 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:40:36.823841 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2397aac8_2d8f_4b03_8240_0eb87c82311f.slice/crio-b204562b557cef1cafc7dd436f0945385de74b3e5858b37d655cf8360c9a2bee WatchSource:0}: Error finding container b204562b557cef1cafc7dd436f0945385de74b3e5858b37d655cf8360c9a2bee: Status 404 returned error can't find the container with id b204562b557cef1cafc7dd436f0945385de74b3e5858b37d655cf8360c9a2bee Sep 16 18:40:36.871913 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.871684 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:35:36 +0000 UTC" deadline="2028-03-01 21:34:07.958171106 +0000 UTC" Sep 16 18:40:36.872026 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.871919 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12770h53m31.086263235s" Sep 16 18:40:36.919977 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.919945 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrl8s" event={"ID":"5defc264-c4d3-4972-b2de-9c85a3978486","Type":"ContainerStarted","Data":"361046525bbcb4852e4b55f9399438d89c8bebdd8cbc7fb5bee0df668a5d9af7"} Sep 16 18:40:36.921110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.921082 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k856b" event={"ID":"4c320b0f-ee18-4b39-bb91-01f2e809495b","Type":"ContainerStarted","Data":"f599ba4e09118ef93f180d895d6f9f5ff7ae593fe29cd17ce57a9cf628917f00"} Sep 16 18:40:36.922281 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.922252 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerStarted","Data":"e5c11a8ee7ec4d354e2e8040b5bf501a674fd90e2f26673f28ec5c06b3a28f23"} Sep 16 18:40:36.923643 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.923616 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqrjf" event={"ID":"beac7ae2-161f-4f06-a551-b3fccd851dc7","Type":"ContainerStarted","Data":"75db7230b1502e45145b4884f7c45aeec5b5a4fdfc1bded5035130a5ac938f26"} Sep 16 18:40:36.924914 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.924886 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"938d7704dc5fec66e5789ba44dd2f9281975d7ad0e8a8f8a4e049d0e51dc64a5"} Sep 16 18:40:36.926129 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.926104 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lrkx" event={"ID":"17a63410-755b-47f5-83c9-6a6bb37e7e3e","Type":"ContainerStarted","Data":"cdf13507e18646deb95ad16f8036ce2220119cdc7eb8e994e8d8141805f5e630"} Sep 16 18:40:36.927357 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.927329 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vww2q" event={"ID":"2397aac8-2d8f-4b03-8240-0eb87c82311f","Type":"ContainerStarted","Data":"b204562b557cef1cafc7dd436f0945385de74b3e5858b37d655cf8360c9a2bee"} Sep 16 18:40:36.928517 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.928495 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" event={"ID":"f8d54880-433c-4177-8ad6-24f2cfe9fe50","Type":"ContainerStarted","Data":"b2eceb3ce8aa6de24a29e57712622f85ec33c7f9cd49163b79cf642f26f82f69"} Sep 16 18:40:36.929685 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.929658 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" event={"ID":"6be3e366-9d55-4822-a591-5cd294186bed","Type":"ContainerStarted","Data":"cf82204ac0751ca99d7873dc3604f6005fb983cfb154327280be61c3a6193c9b"} Sep 16 18:40:36.931730 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.931708 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" event={"ID":"09f1ac8d1bb41b4ad31726e0bf202fb7","Type":"ContainerStarted","Data":"3b393cbd60e64c8a60f24169f3496407472d29a95dcd348dcdfefd197e985df0"} Sep 16 18:40:36.951356 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:36.951302 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-28.ec2.internal" podStartSLOduration=1.951286173 podStartE2EDuration="1.951286173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:36.950830341 +0000 UTC m=+3.529361961" watchObservedRunningTime="2026-09-16 18:40:36.951286173 +0000 UTC m=+3.529817793" Sep 16 18:40:37.444892 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.444798 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:37.445083 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.444993 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:37.445083 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.445063 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:39.445042997 +0000 UTC m=+6.023574598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:37.545751 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.545695 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:37.545933 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.545790 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:37.546011 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.545969 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:37.546011 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.545989 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:37.546011 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.546003 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:37.546179 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.546066 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:39.546046585 +0000 UTC m=+6.124578185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:37.546536 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.546512 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:37.546655 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.546575 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:39.546557579 +0000 UTC m=+6.125089179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:37.873124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.872998 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:35:36 +0000 UTC" deadline="2028-05-01 15:52:03.658570762 +0000 UTC" Sep 16 18:40:37.873124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.873068 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14229h11m25.785507526s" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.912483 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.912607 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.913008 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.913112 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.913191 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:37.913355 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:37.913276 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:37.955578 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.954341 2528 generic.go:356] "Generic (PLEG): container finished" podID="80971e7a50769b9a4eacc82d13c1b2e7" containerID="8ef738b2a439400731f82e1028e701de156b4a76636564ac223e5537a2b09184" exitCode=0 Sep 16 18:40:37.955578 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:37.955292 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" event={"ID":"80971e7a50769b9a4eacc82d13c1b2e7","Type":"ContainerDied","Data":"8ef738b2a439400731f82e1028e701de156b4a76636564ac223e5537a2b09184"} Sep 16 18:40:38.982736 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:38.982139 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" event={"ID":"80971e7a50769b9a4eacc82d13c1b2e7","Type":"ContainerStarted","Data":"38c0b89b7c29666ef8ad32a604a953354512ebd0c13323f935743ed1bdc86063"} Sep 16 18:40:39.461846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.461161 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:39.461846 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.461376 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:39.461846 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.461442 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:43.461424079 +0000 UTC m=+10.039955696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.561563 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.561645 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.561796 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.561816 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.561830 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.561888 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:43.561870456 +0000 UTC m=+10.140402055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.562277 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:39.562420 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.562340 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:43.562310314 +0000 UTC m=+10.140841915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:39.911152 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.910433 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:39.911152 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.910566 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:39.911152 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.910943 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:39.911152 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.911042 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:39.911660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:39.911531 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:39.911660 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:39.911625 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:41.910075 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:41.910078 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:41.910211 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:41.910095 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:41.910299 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:41.910583 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:41.910408 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:43.500216 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.500169 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:43.500684 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.500390 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:43.500684 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.500456 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:51.500436759 +0000 UTC m=+18.078968361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:43.601019 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.600988 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:43.601175 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.601038 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:43.601175 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601132 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:43.601175 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601155 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:43.601175 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601176 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:43.601460 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601190 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:43.601460 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601204 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:51.601182827 +0000 UTC m=+18.179714435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:43.601460 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.601241 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:40:51.601225309 +0000 UTC m=+18.179756917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:43.910810 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.910730 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:43.910972 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.910834 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:43.911208 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.911191 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:43.911306 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.911283 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:43.911566 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:43.911543 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:43.911691 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:43.911639 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:45.910108 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:45.910070 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:45.910580 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:45.910120 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:45.910580 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:45.910202 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:45.910580 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:45.910070 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:45.910580 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:45.910311 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:45.910580 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:45.910410 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:47.910397 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:47.910299 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:47.910840 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:47.910299 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:47.910840 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:47.910445 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:47.910840 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:47.910304 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:47.910840 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:47.910530 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:47.910840 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:47.910647 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:49.910479 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:49.910197 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:49.910928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:49.910206 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:49.910928 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:49.910582 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:49.910928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:49.910243 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:49.910928 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:49.910713 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:49.910928 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:49.910832 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:51.561645 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.561608 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:51.562147 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.561773 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:51.562147 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.561836 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:07.561821185 +0000 UTC m=+34.140352781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:40:51.662632 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.662514 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:51.662632 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.662583 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662698 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662701 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662720 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662731 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662762 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:07.662731578 +0000 UTC m=+34.241263182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:40:51.662829 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.662778 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:07.662771588 +0000 UTC m=+34.241303182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:40:51.909445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.909408 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:51.909581 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.909519 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:51.909709 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.909680 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:51.909828 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.909809 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:51.909890 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:51.909859 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:51.909959 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:51.909942 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:53.910585 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:53.910544 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:53.911043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:53.910655 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:53.911043 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:53.910659 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:53.911043 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:53.910747 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:53.911043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:53.910755 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:53.911043 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:53.910870 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:55.910626 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:55.910384 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:55.911359 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:55.910384 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:55.911359 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:55.910676 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:55.911359 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:55.910402 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:55.911359 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:55.910744 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:55.911359 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:55.910816 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:56.020450 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.020410 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrl8s" event={"ID":"5defc264-c4d3-4972-b2de-9c85a3978486","Type":"ContainerStarted","Data":"73c4a30fdbc42939d3db757ebcc72f423d881b13714bc471f617d3450e420063"} Sep 16 18:40:56.021908 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.021878 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k856b" event={"ID":"4c320b0f-ee18-4b39-bb91-01f2e809495b","Type":"ContainerStarted","Data":"6b8215225bcd4cfe20bbd73e03cdb7275a0e30b039d5c5dfa231b0f5629a606a"} Sep 16 18:40:56.023438 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.023307 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="0331caeb40d0c92235d0e5ea5fa02729b3a226d9ee686b552241297e32c5bdb9" exitCode=0 Sep 16 18:40:56.023438 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.023364 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"0331caeb40d0c92235d0e5ea5fa02729b3a226d9ee686b552241297e32c5bdb9"} Sep 16 18:40:56.025059 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.025037 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqrjf" event={"ID":"beac7ae2-161f-4f06-a551-b3fccd851dc7","Type":"ContainerStarted","Data":"e94768253405d2412f085de52b610f98d22116306e5ea01d590770fc6c365638"} Sep 16 18:40:56.028141 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028122 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"875a08022fee48676335ff066601d11fc0c1d4d31e864e6d36300e237bbfb8bb"} Sep 16 18:40:56.028224 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028196 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"be9dbbb54ab2503ed8266f690b6e149cc73dd3bfc5b731932f8e781e4834dda7"} Sep 16 18:40:56.028262 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028230 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"bde21ee14de0f5f1d9630136cf121e48202b7a30bd93c82c25a06571ad402b84"} Sep 16 18:40:56.028291 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028265 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"26d9bad8c1e1d5521507030041ee42d2566a3af78b435be81fea58dd6c74ec09"} Sep 16 18:40:56.028360 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028303 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"d1008585fc573f2e06a38f860756d89d42e1604bdf365e8e07f367a0227705ba"} Sep 16 18:40:56.028401 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.028364 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"a627999862c6a3fde1efc1be7be16cffa88fac640603521d304c5f2763f95bf8"} Sep 16 18:40:56.029515 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.029497 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lrkx" event={"ID":"17a63410-755b-47f5-83c9-6a6bb37e7e3e","Type":"ContainerStarted","Data":"37fd9e25e6fcb24a8690f46886ee649d7e7413700f31f3695602b30918ddf46b"} Sep 16 18:40:56.030823 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.030805 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" event={"ID":"f8d54880-433c-4177-8ad6-24f2cfe9fe50","Type":"ContainerStarted","Data":"4c3160c03bf17b358b1256661f959ffb5223447317e3fd3e25f175ec96c8ee44"} Sep 16 18:40:56.032258 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.032238 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" event={"ID":"6be3e366-9d55-4822-a591-5cd294186bed","Type":"ContainerStarted","Data":"eaeabd4efe268cb9474e19fc9a07ee1ab994051f1504320496797c86f70c10f4"} Sep 16 18:40:56.038095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.038051 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hrl8s" podStartSLOduration=3.967305795 podStartE2EDuration="22.038038907s" totalImagesPullingTime="18.070733112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:56.037085739 +0000 UTC m=+22.615617355" watchObservedRunningTime="2026-09-16 18:40:56.038038907 +0000 UTC m=+22.616570523" Sep 16 18:40:56.038211 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.038123 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-28.ec2.internal" podStartSLOduration=21.038119357 podStartE2EDuration="21.038119357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:39.00451917 +0000 UTC m=+5.583050792" watchObservedRunningTime="2026-09-16 18:40:56.038119357 +0000 UTC m=+22.616650974" Sep 16 18:40:56.076779 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.076727 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vrr4j" podStartSLOduration=3.974761923 podStartE2EDuration="22.076711325s" totalImagesPullingTime="18.101949402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:56.056942084 +0000 UTC m=+22.635473700" watchObservedRunningTime="2026-09-16 18:40:56.076711325 +0000 UTC m=+22.655242941" Sep 16 18:40:56.076996 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.076978 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6lrkx" podStartSLOduration=7.568300205 podStartE2EDuration="22.076973124s" totalImagesPullingTime="14.508672919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:56.076615884 +0000 UTC m=+22.655147501" watchObservedRunningTime="2026-09-16 18:40:56.076973124 +0000 UTC m=+22.655504780" Sep 16 18:40:56.097483 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.097433 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kqrjf" podStartSLOduration=3.903766041 podStartE2EDuration="22.097416592s" totalImagesPullingTime="18.193650551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:56.097191467 +0000 UTC m=+22.675723085" watchObservedRunningTime="2026-09-16 18:40:56.097416592 +0000 UTC m=+22.675948265" Sep 16 18:40:56.375987 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.375964 2528 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 18:40:56.883174 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.883026 2528 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T18:40:56.375980951Z","UUID":"9e879bf8-ffb4-4ff6-89f2-e97fb4eec874","Handler":null,"Name":"","Endpoint":""} Sep 16 18:40:56.885164 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.885137 2528 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 18:40:56.885295 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:56.885177 2528 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 18:40:57.037894 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.037853 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vww2q" event={"ID":"2397aac8-2d8f-4b03-8240-0eb87c82311f","Type":"ContainerStarted","Data":"50c8af049508a1ccb7ef19176a2ae02cedebc332820cb37aa0cd3195bed2045e"} Sep 16 18:40:57.040728 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.040618 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" event={"ID":"f8d54880-433c-4177-8ad6-24f2cfe9fe50","Type":"ContainerStarted","Data":"6963be685cadf85e5f8904e0deb4ab9734165017e9d4065447a3178da0dbd57a"} Sep 16 18:40:57.056444 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.056397 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k856b" podStartSLOduration=4.984674335 podStartE2EDuration="23.056380891s" totalImagesPullingTime="18.071706556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:56.13698297 +0000 UTC m=+22.715514584" watchObservedRunningTime="2026-09-16 18:40:57.056380891 +0000 UTC m=+23.634912532" Sep 16 18:40:57.056623 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.056587 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vww2q" podStartSLOduration=4.966689267 podStartE2EDuration="23.056556533s" totalImagesPullingTime="18.089867266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:57.056347947 +0000 UTC m=+23.634879565" watchObservedRunningTime="2026-09-16 18:40:57.056556533 +0000 UTC m=+23.635088150" Sep 16 18:40:57.910550 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.910431 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:57.910550 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.910431 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:57.910550 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:57.910431 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:57.910843 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:57.910582 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:40:57.910843 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:57.910717 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:57.910843 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:57.910785 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:58.047770 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:58.047735 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"8e514c2d4aec43163ab14280a93351fd15b50ecaa246f1ebf8084d22642df5e0"} Sep 16 18:40:58.050217 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:58.050187 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" event={"ID":"f8d54880-433c-4177-8ad6-24f2cfe9fe50","Type":"ContainerStarted","Data":"8220e5d2fbc9515c6ddbc0d1f324b862d55a4f378d2e5df573394545ab383281"} Sep 16 18:40:58.076215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:58.076150 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nkcq" podStartSLOduration=3.665938689 podStartE2EDuration="24.076134829s" totalImagesPullingTime="20.41019614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:40:58.076041097 +0000 UTC m=+24.654572715" watchObservedRunningTime="2026-09-16 18:40:58.076134829 +0000 UTC m=+24.654666446" Sep 16 18:40:59.910584 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:59.910542 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:40:59.911182 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:59.910542 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:40:59.911182 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:59.910692 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:40:59.911182 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:40:59.910703 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:40:59.911182 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:59.910794 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:40:59.911182 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:40:59.910859 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:41:00.617363 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:00.617151 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:41:00.617814 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:00.617794 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:41:01.059275 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.059244 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="0e581f152935a86929a76bf25c57eb92f92fcd3dea182414e1b91010cd0ec400" exitCode=0 Sep 16 18:41:01.059787 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.059339 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"0e581f152935a86929a76bf25c57eb92f92fcd3dea182414e1b91010cd0ec400"} Sep 16 18:41:01.063235 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.063212 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" event={"ID":"b69d60c2-c582-4be2-bc2b-3c0a594b2913","Type":"ContainerStarted","Data":"70cdf45446fe076fd4ec81867172a3b39f3ff0f8d664cd551ac22ed6819fc81d"} Sep 16 18:41:01.063499 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.063467 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:41:01.063917 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.063902 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6lrkx" Sep 16 18:41:01.132756 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.132709 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" podStartSLOduration=8.998010985 podStartE2EDuration="27.132693343s" totalImagesPullingTime="18.134682358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:01.132267523 +0000 UTC m=+27.710799139" watchObservedRunningTime="2026-09-16 18:41:01.132693343 +0000 UTC m=+27.711224960" Sep 16 18:41:01.910089 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.910056 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:01.910089 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.910083 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:01.910282 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.910116 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:01.910282 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:01.910230 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:41:01.910282 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:01.910260 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:41:01.910411 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:01.910311 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:41:01.970249 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:01.970161 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:02.068337 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.068293 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="9b5e8c81d2dc0bfcd180163f5ea405679b6df009f1cd37b1b10d87ec062f60a1" exitCode=0 Sep 16 18:41:02.068836 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.068358 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"9b5e8c81d2dc0bfcd180163f5ea405679b6df009f1cd37b1b10d87ec062f60a1"} Sep 16 18:41:02.069124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.069106 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:02.069252 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.069189 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:02.069252 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.069242 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:02.086167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.086141 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:02.086969 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.086948 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:02.104448 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.104413 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:02.363125 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.363047 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8kgc"] Sep 16 18:41:02.363289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.363172 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:02.363289 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:02.363261 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:41:02.370572 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.370547 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72z2n"] Sep 16 18:41:02.370717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.370659 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:02.370803 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:02.370774 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:41:02.371199 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.371179 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gc2rp"] Sep 16 18:41:02.371275 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:02.371260 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:02.371369 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:02.371351 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:41:03.072986 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:03.072899 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="81d8492aa01bbb95257d33cdd81778fa880a1d79aae9979747bc40476c7a99ec" exitCode=0 Sep 16 18:41:03.073569 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:03.072993 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"81d8492aa01bbb95257d33cdd81778fa880a1d79aae9979747bc40476c7a99ec"} Sep 16 18:41:03.910875 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:03.910625 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:03.911051 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:03.910668 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:03.911051 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:03.910972 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:41:03.911158 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:03.911043 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:41:03.911158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:03.910701 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:03.911255 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:03.911156 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:41:05.910047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:05.910010 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:05.910565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:05.910157 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:05.910565 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:05.910169 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72z2n" podUID="1aa6138f-2482-4e97-8488-fa5a76286249" Sep 16 18:41:05.910565 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:05.910283 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8kgc" podUID="5822f711-f318-4cb7-8b04-baeb464c0881" Sep 16 18:41:05.910565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:05.910380 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:05.910565 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:05.910454 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc2rp" podUID="5d70b463-7b61-4b07-9d3b-bbd6b8169d63" Sep 16 18:41:06.137113 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:06.136994 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:06.193493 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:06.193397 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:06.330521 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:06.330480 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:06.433004 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:06.432913 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:07.579722 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.579627 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:07.580152 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.579782 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 18:41:07.580152 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.579850 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret podName:5822f711-f318-4cb7-8b04-baeb464c0881 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:39.57983364 +0000 UTC m=+66.158365240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret") pod "global-pull-secret-syncer-p8kgc" (UID: "5822f711-f318-4cb7-8b04-baeb464c0881") : object "kube-system"/"original-pull-secret" not registered Sep 16 18:41:07.680664 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.680628 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.680690 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680783 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680794 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680811 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680823 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bfp27 for pod openshift-network-diagnostics/network-check-target-gc2rp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680853 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:39.68083537 +0000 UTC m=+66.259366988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 18:41:07.680898 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.680869 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27 podName:5d70b463-7b61-4b07-9d3b-bbd6b8169d63 nodeName:}" failed. No retries permitted until 2026-09-16 18:41:39.680862608 +0000 UTC m=+66.259394203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfp27" (UniqueName: "kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27") pod "network-check-target-gc2rp" (UID: "5d70b463-7b61-4b07-9d3b-bbd6b8169d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 18:41:07.728565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.728538 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-28.ec2.internal" event="NodeReady" Sep 16 18:41:07.728724 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.728674 2528 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 18:41:07.777963 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.777927 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2c4d6"] Sep 16 18:41:07.792901 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.792865 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m9wrt"] Sep 16 18:41:07.793048 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.792994 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.795740 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.795688 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm88x\"" Sep 16 18:41:07.795740 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.795704 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 18:41:07.796075 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.795930 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 18:41:07.806761 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.806741 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9wrt"] Sep 16 18:41:07.806892 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.806768 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c4d6"] Sep 16 18:41:07.806892 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.806861 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.810021 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.809999 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2kfsb\"" Sep 16 18:41:07.810021 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.810007 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 18:41:07.810206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.810002 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 18:41:07.810206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.810055 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 18:41:07.881700 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881663 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7fh\" (UniqueName: \"kubernetes.io/projected/249189f4-2c25-4ac6-8358-dff2538791ed-kube-api-access-gj7fh\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.881819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881719 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.881819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881740 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2lw\" (UniqueName: \"kubernetes.io/projected/131a2346-1153-4537-b06f-a1f716b2045b-kube-api-access-kj2lw\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.881819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881804 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/131a2346-1153-4537-b06f-a1f716b2045b-tmp-dir\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.881916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881848 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249189f4-2c25-4ac6-8358-dff2538791ed-cert\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.881916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.881897 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/131a2346-1153-4537-b06f-a1f716b2045b-config-volume\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.903425 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.903386 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:07.910230 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.910206 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:07.910230 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.910218 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:07.910416 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.910206 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:07.923453 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.923429 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 18:41:07.923595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.923455 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 18:41:07.923595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.923436 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 18:41:07.923595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.923576 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 18:41:07.924287 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.924267 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tx4q5\"" Sep 16 18:41:07.928833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.928813 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lk5bf\"" Sep 16 18:41:07.982298 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982255 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249189f4-2c25-4ac6-8358-dff2538791ed-cert\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.982298 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982306 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/131a2346-1153-4537-b06f-a1f716b2045b-config-volume\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.982535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982356 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7fh\" (UniqueName: \"kubernetes.io/projected/249189f4-2c25-4ac6-8358-dff2538791ed-kube-api-access-gj7fh\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.982535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982385 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.982535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982403 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2lw\" (UniqueName: \"kubernetes.io/projected/131a2346-1153-4537-b06f-a1f716b2045b-kube-api-access-kj2lw\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.982535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982432 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/131a2346-1153-4537-b06f-a1f716b2045b-tmp-dir\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.982535 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.982523 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:07.982719 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:07.982592 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:08.482573522 +0000 UTC m=+35.061105149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:07.982763 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.982751 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/131a2346-1153-4537-b06f-a1f716b2045b-tmp-dir\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.986665 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.986640 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249189f4-2c25-4ac6-8358-dff2538791ed-cert\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:07.993660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.993626 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/131a2346-1153-4537-b06f-a1f716b2045b-config-volume\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.994907 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.994887 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2lw\" (UniqueName: \"kubernetes.io/projected/131a2346-1153-4537-b06f-a1f716b2045b-kube-api-access-kj2lw\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:07.995223 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:07.995203 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7fh\" (UniqueName: \"kubernetes.io/projected/249189f4-2c25-4ac6-8358-dff2538791ed-kube-api-access-gj7fh\") pod \"ingress-canary-m9wrt\" (UID: \"249189f4-2c25-4ac6-8358-dff2538791ed\") " pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:08.004451 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.004427 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:08.088337 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.088289 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="8e04b66bb08d4e1ff41747af5bf60a40c50597c63adcec6662b08a9eb0fe1413" exitCode=0 Sep 16 18:41:08.088491 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.088363 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"8e04b66bb08d4e1ff41747af5bf60a40c50597c63adcec6662b08a9eb0fe1413"} Sep 16 18:41:08.115818 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.115758 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9wrt" Sep 16 18:41:08.421500 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.421427 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9wrt"] Sep 16 18:41:08.424559 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:41:08.424522 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249189f4_2c25_4ac6_8358_dff2538791ed.slice/crio-25c80503cfb85abc86966f44fa0ac65f8216448a38d0a31bf32bdb1d82f5f814 WatchSource:0}: Error finding container 25c80503cfb85abc86966f44fa0ac65f8216448a38d0a31bf32bdb1d82f5f814: Status 404 returned error can't find the container with id 25c80503cfb85abc86966f44fa0ac65f8216448a38d0a31bf32bdb1d82f5f814 Sep 16 18:41:08.485642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:08.485602 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:08.485826 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:08.485725 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:08.485826 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:08.485790 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:09.485776724 +0000 UTC m=+36.064308318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:09.094313 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.094275 2528 generic.go:356] "Generic (PLEG): container finished" podID="b880441f-a2bd-4dd1-a749-3a7b93c3d4b8" containerID="a043d5126854aee9c37ba2f88143a29534d54ac5f5a945b65f814104d5297a7c" exitCode=0 Sep 16 18:41:09.095069 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.094358 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerDied","Data":"a043d5126854aee9c37ba2f88143a29534d54ac5f5a945b65f814104d5297a7c"} Sep 16 18:41:09.095697 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.095669 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9wrt" event={"ID":"249189f4-2c25-4ac6-8358-dff2538791ed","Type":"ContainerStarted","Data":"25c80503cfb85abc86966f44fa0ac65f8216448a38d0a31bf32bdb1d82f5f814"} Sep 16 18:41:09.283084 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.283039 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:09.384457 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.384359 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:09.494673 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.494627 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:09.494851 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:09.494808 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:09.494916 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:09.494886 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:11.494866968 +0000 UTC m=+38.073398563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:09.741602 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.741518 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:09.835687 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.835616 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:09.932006 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.931967 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:09.998334 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:09.998229 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:10.101808 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.101763 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" event={"ID":"b880441f-a2bd-4dd1-a749-3a7b93c3d4b8","Type":"ContainerStarted","Data":"403a2cd8bbda9a4d2813abdab14fbd2732f7ee3bacadeb64268acc93a7845d8c"} Sep 16 18:41:10.127850 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.127796 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9dzlc" podStartSLOduration=8.443652991 podStartE2EDuration="36.127776501s" totalImagesPullingTime="27.68412351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:10.126293658 +0000 UTC m=+36.704825275" watchObservedRunningTime="2026-09-16 18:41:10.127776501 +0000 UTC m=+36.706308123" Sep 16 18:41:10.263702 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.263611 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:10.359979 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.359946 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:10.459234 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.459192 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:10.762356 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.762255 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:10.821923 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:10.821893 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:11.106066 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:11.105953 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9wrt" event={"ID":"249189f4-2c25-4ac6-8358-dff2538791ed","Type":"ContainerStarted","Data":"22491024da6c4bbab6b201d1480e6a75b77c397b232b15b2734d7347949e9448"} Sep 16 18:41:11.126183 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:11.126130 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m9wrt" podStartSLOduration=1.73105119 podStartE2EDuration="4.126115635s" totalImagesPullingTime="2.395064445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:11.124948102 +0000 UTC m=+37.703479720" watchObservedRunningTime="2026-09-16 18:41:11.126115635 +0000 UTC m=+37.704647251" Sep 16 18:41:11.144019 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:11.143994 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:11.212174 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:11.212132 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:11.512783 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:11.512748 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:11.512926 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:11.512867 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:11.512926 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:11.512920 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:15.512906025 +0000 UTC m=+42.091437625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:13.212215 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:13.212179 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:13.296209 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:13.296171 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:13.685975 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:13.685946 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:15.539795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:15.539750 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:15.540190 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:15.539891 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:15.540190 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:15.539954 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:23.539939622 +0000 UTC m=+50.118471222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:21.953495 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:21.953458 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:23.597775 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:23.597734 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:23.598196 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:23.597844 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:23.598196 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:23.597906 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:41:39.597892937 +0000 UTC m=+66.176424536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:25.827749 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:25.827705 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:25.925997 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:25.925968 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:25.997630 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:25.997599 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:27.244304 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:27.244267 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:27.308829 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:27.308792 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:28.132957 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:28.132921 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:28.215504 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:28.215468 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:34.086052 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:34.086018 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9bng" Sep 16 18:41:34.266520 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:34.266471 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:34.368160 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:34.368074 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:34.434255 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:34.434215 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:39.609759 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.609701 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:41:39.609759 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.609766 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:39.610417 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:39.609873 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:41:39.610417 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:39.609948 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:42:11.609926159 +0000 UTC m=+98.188457772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:41:39.613194 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.613176 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 18:41:39.623916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.623896 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5822f711-f318-4cb7-8b04-baeb464c0881-original-pull-secret\") pod \"global-pull-secret-syncer-p8kgc\" (UID: \"5822f711-f318-4cb7-8b04-baeb464c0881\") " pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:39.710316 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.710275 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:41:39.710517 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.710348 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:39.713208 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.713186 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 18:41:39.713264 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.713192 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 18:41:39.721539 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:39.721511 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 18:41:39.721649 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:41:39.721615 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs podName:1aa6138f-2482-4e97-8488-fa5a76286249 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:43.721599093 +0000 UTC m=+130.300130693 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs") pod "network-metrics-daemon-72z2n" (UID: "1aa6138f-2482-4e97-8488-fa5a76286249") : secret "metrics-daemon-secret" not found Sep 16 18:41:39.724092 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.724073 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 18:41:39.731164 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.731149 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8kgc" Sep 16 18:41:39.734515 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:39.734494 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfp27\" (UniqueName: \"kubernetes.io/projected/5d70b463-7b61-4b07-9d3b-bbd6b8169d63-kube-api-access-bfp27\") pod \"network-check-target-gc2rp\" (UID: \"5d70b463-7b61-4b07-9d3b-bbd6b8169d63\") " pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:40.022821 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:40.022786 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lk5bf\"" Sep 16 18:41:40.031262 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:40.031240 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:40.040784 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:40.040755 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8kgc"] Sep 16 18:41:40.055979 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:41:40.055952 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5822f711_f318_4cb7_8b04_baeb464c0881.slice/crio-3696a23ae6f190385b1364d9d98eee963a1cbd6717170ad7852bc66e0f4694d2 WatchSource:0}: Error finding container 3696a23ae6f190385b1364d9d98eee963a1cbd6717170ad7852bc66e0f4694d2: Status 404 returned error can't find the container with id 3696a23ae6f190385b1364d9d98eee963a1cbd6717170ad7852bc66e0f4694d2 Sep 16 18:41:40.178296 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:40.178258 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8kgc" event={"ID":"5822f711-f318-4cb7-8b04-baeb464c0881","Type":"ContainerStarted","Data":"3696a23ae6f190385b1364d9d98eee963a1cbd6717170ad7852bc66e0f4694d2"} Sep 16 18:41:40.333861 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:40.333786 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gc2rp"] Sep 16 18:41:40.336593 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:41:40.336563 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d70b463_7b61_4b07_9d3b_bbd6b8169d63.slice/crio-d1a858f4af3e6e5e652f1a478a97685d9f5896d941aab29fec552c2471c188c0 WatchSource:0}: Error finding container d1a858f4af3e6e5e652f1a478a97685d9f5896d941aab29fec552c2471c188c0: Status 404 returned error can't find the container with id d1a858f4af3e6e5e652f1a478a97685d9f5896d941aab29fec552c2471c188c0 Sep 16 18:41:41.182484 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:41.182442 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gc2rp" event={"ID":"5d70b463-7b61-4b07-9d3b-bbd6b8169d63","Type":"ContainerStarted","Data":"d1a858f4af3e6e5e652f1a478a97685d9f5896d941aab29fec552c2471c188c0"} Sep 16 18:41:45.196072 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:45.196028 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8kgc" event={"ID":"5822f711-f318-4cb7-8b04-baeb464c0881","Type":"ContainerStarted","Data":"aa27bc43a0bc49aef2145c65f366232cbd7c467dbbebab50f6c7fd6a00227c0e"} Sep 16 18:41:45.197559 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:45.197534 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gc2rp" event={"ID":"5d70b463-7b61-4b07-9d3b-bbd6b8169d63","Type":"ContainerStarted","Data":"aec2f959b4a10ac3cb85a3c6bbc7281f75ab5f0045a1136304a193f3f0ccd860"} Sep 16 18:41:45.197673 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:45.197663 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:41:45.236822 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:45.236771 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gc2rp" podStartSLOduration=66.998083698 podStartE2EDuration="1m11.236756566s" totalImagesPullingTime="4.238672868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:45.236314225 +0000 UTC m=+71.814846051" watchObservedRunningTime="2026-09-16 18:41:45.236756566 +0000 UTC m=+71.815288184" Sep 16 18:41:45.237000 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:45.236947 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p8kgc" podStartSLOduration=66.714297139 podStartE2EDuration="1m11.236942562s" totalImagesPullingTime="4.522645423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:45.213686513 +0000 UTC m=+71.792218131" watchObservedRunningTime="2026-09-16 18:41:45.236942562 +0000 UTC m=+71.815474205" Sep 16 18:41:47.828789 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:47.828752 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:47.930463 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:47.930426 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:41:47.988123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:41:47.988091 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:10.519748 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.519607 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49"] Sep 16 18:42:10.522885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.522862 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9fb7ffc7b-zt7xp"] Sep 16 18:42:10.523009 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.522981 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.524899 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.524880 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.526000 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.525975 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wbkfn\"" Sep 16 18:42:10.526108 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.526040 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 16 18:42:10.526108 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.526053 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.526108 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.526055 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.526717 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.526702 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 16 18:42:10.527788 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.527771 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.528079 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.528064 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 16 18:42:10.528154 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.528102 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-khv84\"" Sep 16 18:42:10.528573 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.528558 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 16 18:42:10.532971 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.532951 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 16 18:42:10.533088 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.533073 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.533286 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.533269 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 16 18:42:10.534258 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.534239 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49"] Sep 16 18:42:10.542517 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.542495 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9fb7ffc7b-zt7xp"] Sep 16 18:42:10.622072 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622029 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qqn\" (UniqueName: \"kubernetes.io/projected/7dca864c-7a28-468d-ad82-f63dd00d2a83-kube-api-access-s2qqn\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.622260 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622081 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8b8882c-2489-4511-abf0-008f04d2c954-config\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.622260 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622165 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b8882c-2489-4511-abf0-008f04d2c954-serving-cert\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.622260 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622201 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdv6s\" (UniqueName: \"kubernetes.io/projected/d8b8882c-2489-4511-abf0-008f04d2c954-kube-api-access-hdv6s\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.622260 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622232 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.622443 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622268 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-stats-auth\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.622443 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622297 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.622443 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.622338 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-default-certificate\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.625757 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.625731 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p"] Sep 16 18:42:10.628266 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.628251 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t"] Sep 16 18:42:10.628387 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.628370 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.630098 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.630079 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms"] Sep 16 18:42:10.630214 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.630195 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.630972 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.630953 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pl8tw\"" Sep 16 18:42:10.631087 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.631069 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 16 18:42:10.631147 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.631078 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 16 18:42:10.631368 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.631352 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.631644 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.631629 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.632494 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.632476 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" Sep 16 18:42:10.634391 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634312 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.634391 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634356 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 16 18:42:10.634391 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634362 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 16 18:42:10.634561 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634423 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-25585\"" Sep 16 18:42:10.634561 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634461 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.634720 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.634703 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.635481 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.635458 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rkffd\"" Sep 16 18:42:10.635678 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.635481 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.642445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.642420 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms"] Sep 16 18:42:10.643422 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.643397 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p"] Sep 16 18:42:10.652408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.652386 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t"] Sep 16 18:42:10.723658 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.723621 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qqn\" (UniqueName: \"kubernetes.io/projected/7dca864c-7a28-468d-ad82-f63dd00d2a83-kube-api-access-s2qqn\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.723658 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.723664 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8b8882c-2489-4511-abf0-008f04d2c954-config\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.723873 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.723851 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30144b38-420c-4cfa-ac7d-82043eb234c6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.723916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.723887 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.723956 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.723941 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b8882c-2489-4511-abf0-008f04d2c954-serving-cert\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.724041 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724020 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30144b38-420c-4cfa-ac7d-82043eb234c6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.724100 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724082 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.724158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724143 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdv6s\" (UniqueName: \"kubernetes.io/projected/d8b8882c-2489-4511-abf0-008f04d2c954-kube-api-access-hdv6s\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.724194 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724174 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8b8882c-2489-4511-abf0-008f04d2c954-config\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.724243 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724175 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkkn\" (UniqueName: \"kubernetes.io/projected/ba870d1e-5ba8-41f4-8e03-46488e3ff92f-kube-api-access-ppkkn\") pod \"volume-data-source-validator-86695b7cc7-cnmms\" (UID: \"ba870d1e-5ba8-41f4-8e03-46488e3ff92f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" Sep 16 18:42:10.724289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724250 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.724289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724270 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-stats-auth\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.724289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724287 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.724460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724307 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxtj\" (UniqueName: \"kubernetes.io/projected/30144b38-420c-4cfa-ac7d-82043eb234c6-kube-api-access-wgxtj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.724460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724350 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-default-certificate\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.724460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.724387 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvhp\" (UniqueName: \"kubernetes.io/projected/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-kube-api-access-9nvhp\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.724460 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.724403 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:11.224383824 +0000 UTC m=+97.802915439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:10.724460 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.724437 2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 18:42:10.724653 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.724497 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:11.224481753 +0000 UTC m=+97.803013352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : secret "router-metrics-certs-default" not found Sep 16 18:42:10.726240 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.726214 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8b8882c-2489-4511-abf0-008f04d2c954-serving-cert\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.726600 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.726582 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-stats-auth\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.726656 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.726642 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-default-certificate\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.735725 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.735704 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7"] Sep 16 18:42:10.738293 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.738276 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.739008 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.738990 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qqn\" (UniqueName: \"kubernetes.io/projected/7dca864c-7a28-468d-ad82-f63dd00d2a83-kube-api-access-s2qqn\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:10.741654 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.741634 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xws6j\"" Sep 16 18:42:10.741726 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.741675 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 16 18:42:10.741726 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.741694 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 16 18:42:10.741726 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.741701 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 16 18:42:10.744805 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.744782 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdv6s\" (UniqueName: \"kubernetes.io/projected/d8b8882c-2489-4511-abf0-008f04d2c954-kube-api-access-hdv6s\") pod \"service-ca-operator-cf7c776b7-2dj49\" (UID: \"d8b8882c-2489-4511-abf0-008f04d2c954\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.754819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.754796 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7"] Sep 16 18:42:10.802535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.802443 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:10.825523 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825486 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825541 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30144b38-420c-4cfa-ac7d-82043eb234c6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825558 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825574 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz5kv\" (UniqueName: \"kubernetes.io/projected/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-kube-api-access-xz5kv\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825602 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30144b38-420c-4cfa-ac7d-82043eb234c6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825636 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.825688 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.825656 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:10.825987 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825691 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkkn\" (UniqueName: \"kubernetes.io/projected/ba870d1e-5ba8-41f4-8e03-46488e3ff92f-kube-api-access-ppkkn\") pod \"volume-data-source-validator-86695b7cc7-cnmms\" (UID: \"ba870d1e-5ba8-41f4-8e03-46488e3ff92f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" Sep 16 18:42:10.825987 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.825757 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:11.325734687 +0000 UTC m=+97.904266286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:10.825987 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825797 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxtj\" (UniqueName: \"kubernetes.io/projected/30144b38-420c-4cfa-ac7d-82043eb234c6-kube-api-access-wgxtj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.825987 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.825848 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvhp\" (UniqueName: \"kubernetes.io/projected/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-kube-api-access-9nvhp\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.826303 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.826288 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30144b38-420c-4cfa-ac7d-82043eb234c6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.826431 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.826415 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.827994 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.827964 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30144b38-420c-4cfa-ac7d-82043eb234c6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.832164 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.832145 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" Sep 16 18:42:10.837297 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.837275 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkkn\" (UniqueName: \"kubernetes.io/projected/ba870d1e-5ba8-41f4-8e03-46488e3ff92f-kube-api-access-ppkkn\") pod \"volume-data-source-validator-86695b7cc7-cnmms\" (UID: \"ba870d1e-5ba8-41f4-8e03-46488e3ff92f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" Sep 16 18:42:10.837403 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.837284 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxtj\" (UniqueName: \"kubernetes.io/projected/30144b38-420c-4cfa-ac7d-82043eb234c6-kube-api-access-wgxtj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-9pt7p\" (UID: \"30144b38-420c-4cfa-ac7d-82043eb234c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.837456 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.837441 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvhp\" (UniqueName: \"kubernetes.io/projected/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-kube-api-access-9nvhp\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:10.902674 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.902642 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:10.927158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.927119 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz5kv\" (UniqueName: \"kubernetes.io/projected/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-kube-api-access-xz5kv\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.927316 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.927237 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.927418 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.927371 2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 18:42:10.927471 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:10.927451 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls podName:df707da0-843f-4dc2-bebf-bfb8dbe7a5a1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:11.427430068 +0000 UTC m=+98.005961677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-567t7" (UID: "df707da0-843f-4dc2-bebf-bfb8dbe7a5a1") : secret "samples-operator-tls" not found Sep 16 18:42:10.937287 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.937261 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz5kv\" (UniqueName: \"kubernetes.io/projected/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-kube-api-access-xz5kv\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:10.939024 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.939007 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" Sep 16 18:42:10.950926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:10.950903 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" Sep 16 18:42:11.105644 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.105562 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49"] Sep 16 18:42:11.108649 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:11.108617 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b8882c_2489_4511_abf0_008f04d2c954.slice/crio-f3eddcfd776e7f47f1e42cba3407bd88099188c2981a54eb7d4e7715d51a85eb WatchSource:0}: Error finding container f3eddcfd776e7f47f1e42cba3407bd88099188c2981a54eb7d4e7715d51a85eb: Status 404 returned error can't find the container with id f3eddcfd776e7f47f1e42cba3407bd88099188c2981a54eb7d4e7715d51a85eb Sep 16 18:42:11.211521 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.211491 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p"] Sep 16 18:42:11.214151 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:11.214127 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30144b38_420c_4cfa_ac7d_82043eb234c6.slice/crio-5973fdbc5b8f9bb01844c79688d352aa60f34eeb5ab86133474d3125989170f8 WatchSource:0}: Error finding container 5973fdbc5b8f9bb01844c79688d352aa60f34eeb5ab86133474d3125989170f8: Status 404 returned error can't find the container with id 5973fdbc5b8f9bb01844c79688d352aa60f34eeb5ab86133474d3125989170f8 Sep 16 18:42:11.229576 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.229549 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms"] Sep 16 18:42:11.229714 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.229693 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:11.229778 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.229723 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:11.229838 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.229826 2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 18:42:11.229888 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.229858 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:12.229837532 +0000 UTC m=+98.808369147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:11.229888 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.229878 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:12.229871181 +0000 UTC m=+98.808402775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : secret "router-metrics-certs-default" not found Sep 16 18:42:11.232877 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:11.232854 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba870d1e_5ba8_41f4_8e03_46488e3ff92f.slice/crio-d7f56364b4a2dc60ca65ecd3215089689d8db05882c706a06d63f3236dc5eff7 WatchSource:0}: Error finding container d7f56364b4a2dc60ca65ecd3215089689d8db05882c706a06d63f3236dc5eff7: Status 404 returned error can't find the container with id d7f56364b4a2dc60ca65ecd3215089689d8db05882c706a06d63f3236dc5eff7 Sep 16 18:42:11.262377 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.262336 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" event={"ID":"d8b8882c-2489-4511-abf0-008f04d2c954","Type":"ContainerStarted","Data":"f3eddcfd776e7f47f1e42cba3407bd88099188c2981a54eb7d4e7715d51a85eb"} Sep 16 18:42:11.263372 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.263344 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" event={"ID":"30144b38-420c-4cfa-ac7d-82043eb234c6","Type":"ContainerStarted","Data":"5973fdbc5b8f9bb01844c79688d352aa60f34eeb5ab86133474d3125989170f8"} Sep 16 18:42:11.264436 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.264415 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" event={"ID":"ba870d1e-5ba8-41f4-8e03-46488e3ff92f","Type":"ContainerStarted","Data":"d7f56364b4a2dc60ca65ecd3215089689d8db05882c706a06d63f3236dc5eff7"} Sep 16 18:42:11.330037 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.330008 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:11.330185 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.330164 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:11.330239 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.330230 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:12.330216295 +0000 UTC m=+98.908747894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:11.430875 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.430827 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:11.431020 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.430980 2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 18:42:11.431077 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.431052 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls podName:df707da0-843f-4dc2-bebf-bfb8dbe7a5a1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:12.431032594 +0000 UTC m=+99.009564271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-567t7" (UID: "df707da0-843f-4dc2-bebf-bfb8dbe7a5a1") : secret "samples-operator-tls" not found Sep 16 18:42:11.631744 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:11.631708 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:42:11.632224 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.631826 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 18:42:11.632224 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:11.631876 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls podName:131a2346-1153-4537-b06f-a1f716b2045b nodeName:}" failed. No retries permitted until 2026-09-16 18:43:15.631863045 +0000 UTC m=+162.210394659 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls") pod "dns-default-2c4d6" (UID: "131a2346-1153-4537-b06f-a1f716b2045b") : secret "dns-default-metrics-tls" not found Sep 16 18:42:12.239223 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:12.238495 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:12.239223 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:12.238552 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:12.239223 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.238678 2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 18:42:12.239223 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.238740 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:14.238720762 +0000 UTC m=+100.817252372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : secret "router-metrics-certs-default" not found Sep 16 18:42:12.239223 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.239135 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:14.239117746 +0000 UTC m=+100.817649361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:12.339710 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:12.339667 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:12.339890 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.339859 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:12.339953 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.339937 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:14.339917503 +0000 UTC m=+100.918449113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:12.440721 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:12.440687 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:12.440879 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.440852 2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 18:42:12.440948 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:12.440933 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls podName:df707da0-843f-4dc2-bebf-bfb8dbe7a5a1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:14.44091188 +0000 UTC m=+101.019443486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-567t7" (UID: "df707da0-843f-4dc2-bebf-bfb8dbe7a5a1") : secret "samples-operator-tls" not found Sep 16 18:42:13.272562 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:13.272519 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" event={"ID":"ba870d1e-5ba8-41f4-8e03-46488e3ff92f","Type":"ContainerStarted","Data":"cc27c21fa3a86eac83b02729c75f3b0c34c9261c78ae34d33d6446c6d259311e"} Sep 16 18:42:13.292898 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:13.292841 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cnmms" podStartSLOduration=2.062432305 podStartE2EDuration="3.292820978s" totalImagesPullingTime="1.230388673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:13.292764177 +0000 UTC m=+99.871295794" watchObservedRunningTime="2026-09-16 18:42:13.292820978 +0000 UTC m=+99.871352597" Sep 16 18:42:13.409924 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:13.409885 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:14.254184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.254080 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:14.254184 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.254126 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:14.254441 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.254228 2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 18:42:14.254441 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.254273 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.254248231 +0000 UTC m=+104.832779841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:14.254441 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.254306 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.254296058 +0000 UTC m=+104.832827658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : secret "router-metrics-certs-default" not found Sep 16 18:42:14.278365 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.278307 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" event={"ID":"30144b38-420c-4cfa-ac7d-82043eb234c6","Type":"ContainerStarted","Data":"d464630ec41714827d3f9303cd2c211cb96ec0611c8cbb69f82d2c1c1fafabfc"} Sep 16 18:42:14.280160 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.280132 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" event={"ID":"d8b8882c-2489-4511-abf0-008f04d2c954","Type":"ContainerStarted","Data":"8abc1663fb7cea81a3cdc3b142711b41c031550ba320654cd426318350458349"} Sep 16 18:42:14.297538 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.297482 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" podStartSLOduration=1.532340784 podStartE2EDuration="4.29746197s" totalImagesPullingTime="2.765121186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:14.296942802 +0000 UTC m=+100.875474419" watchObservedRunningTime="2026-09-16 18:42:14.29746197 +0000 UTC m=+100.875993588" Sep 16 18:42:14.320332 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.320257 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" podStartSLOduration=1.4564992 podStartE2EDuration="4.32022909s" totalImagesPullingTime="2.86372989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:14.319789082 +0000 UTC m=+100.898320701" watchObservedRunningTime="2026-09-16 18:42:14.32022909 +0000 UTC m=+100.898760708" Sep 16 18:42:14.355123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.355069 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:14.355275 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.355189 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:14.355275 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.355268 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.355244626 +0000 UTC m=+104.933776236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:14.455763 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.455719 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:14.455963 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.455828 2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 18:42:14.455963 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.455881 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls podName:df707da0-843f-4dc2-bebf-bfb8dbe7a5a1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.45586632 +0000 UTC m=+105.034397920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-567t7" (UID: "df707da0-843f-4dc2-bebf-bfb8dbe7a5a1") : secret "samples-operator-tls" not found Sep 16 18:42:14.582696 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.582603 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:14.610919 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.610887 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ntdsk"] Sep 16 18:42:14.627757 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.627719 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntdsk"] Sep 16 18:42:14.627914 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.627860 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.631177 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.631150 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 18:42:14.631382 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.631360 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 18:42:14.631452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.631383 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 18:42:14.631452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.631364 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 18:42:14.631708 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.631684 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-99dld\"" Sep 16 18:42:14.665690 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.665642 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:14.758519 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.758481 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.758519 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.758530 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h8zh\" (UniqueName: \"kubernetes.io/projected/c775e669-50ad-46a8-bc58-13930761def1-kube-api-access-5h8zh\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.758771 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.758626 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.758771 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.758681 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c775e669-50ad-46a8-bc58-13930761def1-crio-socket\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.758771 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.758757 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c775e669-50ad-46a8-bc58-13930761def1-data-volume\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.859859 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859764 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.859859 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859806 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h8zh\" (UniqueName: \"kubernetes.io/projected/c775e669-50ad-46a8-bc58-13930761def1-kube-api-access-5h8zh\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.859859 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859831 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.859859 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859859 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c775e669-50ad-46a8-bc58-13930761def1-crio-socket\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859893 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c775e669-50ad-46a8-bc58-13930761def1-data-volume\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.859922 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.859980 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c775e669-50ad-46a8-bc58-13930761def1-crio-socket\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.859993 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:15.359973803 +0000 UTC m=+101.938505419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : configmap "kube-rbac-proxy" not found Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.860011 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:14.860163 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:14.860092 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:15.360074055 +0000 UTC m=+101.938605656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:14.860415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.860351 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c775e669-50ad-46a8-bc58-13930761def1-data-volume\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:14.872528 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:14.872495 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h8zh\" (UniqueName: \"kubernetes.io/projected/c775e669-50ad-46a8-bc58-13930761def1-kube-api-access-5h8zh\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:15.365850 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.365814 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:15.366310 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.365873 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:15.366310 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:15.365927 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:15.366310 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:15.365941 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 18:42:15.366310 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:15.366004 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:16.365982017 +0000 UTC m=+102.944513615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:15.366310 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:15.366024 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:16.366013635 +0000 UTC m=+102.944545230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : configmap "kube-rbac-proxy" not found Sep 16 18:42:15.557822 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.557773 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:15.648171 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.648134 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:15.747880 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.747848 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:15.828768 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.828736 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:15.986255 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:15.986171 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:16.065012 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.064977 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:16.203435 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.203400 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gc2rp" Sep 16 18:42:16.374110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.374016 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:16.374110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.374069 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:16.374549 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:16.374139 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 18:42:16.374549 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:16.374187 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:16.374549 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:16.374190 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.374176653 +0000 UTC m=+104.952708252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : configmap "kube-rbac-proxy" not found Sep 16 18:42:16.374549 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:16.374269 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:18.374251443 +0000 UTC m=+104.952783042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:16.487384 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.487349 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:16.582248 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.582216 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:16.710179 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:16.710150 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k856b_4c320b0f-ee18-4b39-bb91-01f2e809495b/dns-node-resolver/0.log" Sep 16 18:42:17.510259 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:17.510228 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrl8s_5defc264-c4d3-4972-b2de-9c85a3978486/node-ca/0.log" Sep 16 18:42:17.927192 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:17.927158 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:18.034138 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.034100 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:18.105803 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.105765 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:18.289566 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.289470 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:18.289566 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.289512 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:18.289791 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.289632 2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 18:42:18.289791 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.289691 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:26.289673871 +0000 UTC m=+112.868205474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : secret "router-metrics-certs-default" not found Sep 16 18:42:18.289791 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.289707 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:26.289699267 +0000 UTC m=+112.868230862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:18.390158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.390118 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:18.390364 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.390224 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:18.390364 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.390268 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:18.390364 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390272 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:18.390516 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390367 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 18:42:18.390516 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390376 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:18.390516 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390372 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:26.390348333 +0000 UTC m=+112.968879929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:18.390516 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390431 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:22.390414698 +0000 UTC m=+108.968946298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : configmap "kube-rbac-proxy" not found Sep 16 18:42:18.390516 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.390452 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:22.390443422 +0000 UTC m=+108.968975031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:18.491249 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.491209 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:18.491434 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.491375 2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 18:42:18.491476 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:18.491444 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls podName:df707da0-843f-4dc2-bebf-bfb8dbe7a5a1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:26.491429099 +0000 UTC m=+113.069960696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-567t7" (UID: "df707da0-843f-4dc2-bebf-bfb8dbe7a5a1") : secret "samples-operator-tls" not found Sep 16 18:42:18.510109 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:18.510075 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9wrt_249189f4-2c25-4ac6-8358-dff2538791ed/serve-healthcheck-canary/0.log" Sep 16 18:42:20.110541 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:20.110495 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:21.895000 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:21.894961 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.146673 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.146586 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.249658 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.249618 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.350811 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.350776 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.420469 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.420366 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:22.420469 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.420426 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:22.420673 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:22.420529 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 18:42:22.420673 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:22.420602 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:30.420585807 +0000 UTC m=+116.999117407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : configmap "kube-rbac-proxy" not found Sep 16 18:42:22.420673 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:22.420543 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:22.420673 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:22.420660 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:30.420649649 +0000 UTC m=+116.999181259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:22.458219 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.458185 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.549420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.549387 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:22.657095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:22.657060 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:23.120533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:23.120494 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:23.560584 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:23.560549 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:23.756711 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:23.756677 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:24.161360 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:24.161308 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:24.376956 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:24.376918 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:24.754110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:24.754074 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:25.366374 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:25.366312 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:25.659333 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:25.659283 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:25.760982 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:25.760947 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:25.864098 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:25.864070 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:26.159602 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.159568 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:26.350500 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.350463 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:26.350500 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.350497 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:26.350715 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:26.350646 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle podName:7dca864c-7a28-468d-ad82-f63dd00d2a83 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:42.350627999 +0000 UTC m=+128.929159607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle") pod "router-default-9fb7ffc7b-zt7xp" (UID: "7dca864c-7a28-468d-ad82-f63dd00d2a83") : configmap references non-existent config key: service-ca.crt Sep 16 18:42:26.352902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.352877 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dca864c-7a28-468d-ad82-f63dd00d2a83-metrics-certs\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:26.451600 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.451502 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:26.451981 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:26.451677 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:26.451981 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:26.451757 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls podName:ce06d6fb-bcd4-44c8-8cf6-c06972683f63 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:42.451739349 +0000 UTC m=+129.030270951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zfl5t" (UID: "ce06d6fb-bcd4-44c8-8cf6-c06972683f63") : secret "cluster-monitoring-operator-tls" not found Sep 16 18:42:26.552280 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.552231 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:26.554669 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.554638 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df707da0-843f-4dc2-bebf-bfb8dbe7a5a1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-567t7\" (UID: \"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:26.567370 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.567336 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:26.654590 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.654556 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" Sep 16 18:42:26.675197 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.675158 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:26.770367 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.770330 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:26.926600 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:26.926568 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7"] Sep 16 18:42:27.325787 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:27.325704 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" event={"ID":"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1","Type":"ContainerStarted","Data":"b6b192c7ed880bb3d37c35db32e1d5af27407bac69e1d5d1ea6ea889328f1b97"} Sep 16 18:42:27.348576 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:27.348548 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:27.796407 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:27.796371 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:27.957926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:27.957892 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:28.154257 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:28.154215 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:28.281808 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:28.281769 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:28.559653 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:28.559626 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:28.758166 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:28.758080 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:29.160412 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:29.160380 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:29.334268 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:29.334237 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" event={"ID":"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1","Type":"ContainerStarted","Data":"00c67f694b755ee03c583a4572cb58f00aca938918a91df3f3aa082160441d10"} Sep 16 18:42:29.334425 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:29.334287 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" event={"ID":"df707da0-843f-4dc2-bebf-bfb8dbe7a5a1","Type":"ContainerStarted","Data":"74f60bdc5946ec600d7643f90ba32089bc4b71ea981cde06e5f74fb966fb5326"} Sep 16 18:42:29.353492 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:29.353439 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-567t7" podStartSLOduration=17.861750328 podStartE2EDuration="19.3534234s" totalImagesPullingTime="1.491673072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:29.352357009 +0000 UTC m=+115.930888623" watchObservedRunningTime="2026-09-16 18:42:29.3534234 +0000 UTC m=+115.931955016" Sep 16 18:42:29.954547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:29.954482 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:30.149760 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.149720 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:30.481057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.480995 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:30.481057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.481064 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:30.481517 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:30.481167 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 18:42:30.481517 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:30.481255 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls podName:c775e669-50ad-46a8-bc58-13930761def1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:46.481233759 +0000 UTC m=+133.059765370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntdsk" (UID: "c775e669-50ad-46a8-bc58-13930761def1") : secret "insights-runtime-extractor-tls" not found Sep 16 18:42:30.481735 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.481715 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c775e669-50ad-46a8-bc58-13930761def1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:30.549669 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.549633 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:30.751811 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:30.751718 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:31.338950 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:31.338910 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:31.416691 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:31.416637 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:31.759496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:31.759464 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:32.157427 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:32.157389 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:32.360360 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:32.360300 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:32.549413 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:32.549308 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.074568 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.074534 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.178396 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.178365 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.280476 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.280438 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.377017 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.376983 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.575385 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.575351 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.752916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.752816 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:33.818269 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:33.818235 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:34.148021 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:34.147991 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:34.208935 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:34.208902 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:34.575537 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:34.575439 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:34.703060 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:34.703027 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:34.973587 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:34.973551 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:35.370425 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:35.370313 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:35.430105 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:35.430069 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:39.281708 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:39.281662 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:39.341564 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:39.341524 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:41.583891 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:41.583854 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:41.684921 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:41.684881 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:42.373741 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.373698 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:42.374302 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.374282 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dca864c-7a28-468d-ad82-f63dd00d2a83-service-ca-bundle\") pod \"router-default-9fb7ffc7b-zt7xp\" (UID: \"7dca864c-7a28-468d-ad82-f63dd00d2a83\") " pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:42.474793 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.474748 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:42.477148 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.477130 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce06d6fb-bcd4-44c8-8cf6-c06972683f63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zfl5t\" (UID: \"ce06d6fb-bcd4-44c8-8cf6-c06972683f63\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:42.640871 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.640841 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-khv84\"" Sep 16 18:42:42.648965 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.648941 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:42.749139 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.749109 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-25585\"" Sep 16 18:42:42.757435 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.757413 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" Sep 16 18:42:42.926633 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:42.926545 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9fb7ffc7b-zt7xp"] Sep 16 18:42:42.929808 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:42.929786 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dca864c_7a28_468d_ad82_f63dd00d2a83.slice/crio-2931f99754f1aacbc478d1dfb0f60084c232244cc0a74089e7439344a6d56e4f WatchSource:0}: Error finding container 2931f99754f1aacbc478d1dfb0f60084c232244cc0a74089e7439344a6d56e4f: Status 404 returned error can't find the container with id 2931f99754f1aacbc478d1dfb0f60084c232244cc0a74089e7439344a6d56e4f Sep 16 18:42:43.032166 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.032130 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t"] Sep 16 18:42:43.035787 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:43.035750 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce06d6fb_bcd4_44c8_8cf6_c06972683f63.slice/crio-b51e059d3f4c2e36c915d6a1350e93dd9581d30b4590cce3c961c7b2e050b3d8 WatchSource:0}: Error finding container b51e059d3f4c2e36c915d6a1350e93dd9581d30b4590cce3c961c7b2e050b3d8: Status 404 returned error can't find the container with id b51e059d3f4c2e36c915d6a1350e93dd9581d30b4590cce3c961c7b2e050b3d8 Sep 16 18:42:43.376863 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.376826 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" event={"ID":"7dca864c-7a28-468d-ad82-f63dd00d2a83","Type":"ContainerStarted","Data":"d26c6e48e801a284baadf3fb75f9d4c44e0684461c9bf814b6431ecb93c5aed5"} Sep 16 18:42:43.377051 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.376883 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" event={"ID":"7dca864c-7a28-468d-ad82-f63dd00d2a83","Type":"ContainerStarted","Data":"2931f99754f1aacbc478d1dfb0f60084c232244cc0a74089e7439344a6d56e4f"} Sep 16 18:42:43.378500 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.378441 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" event={"ID":"ce06d6fb-bcd4-44c8-8cf6-c06972683f63","Type":"ContainerStarted","Data":"b51e059d3f4c2e36c915d6a1350e93dd9581d30b4590cce3c961c7b2e050b3d8"} Sep 16 18:42:43.403850 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.403796 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" podStartSLOduration=33.403770736 podStartE2EDuration="33.403770736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:43.402752158 +0000 UTC m=+129.981283776" watchObservedRunningTime="2026-09-16 18:42:43.403770736 +0000 UTC m=+129.982302353" Sep 16 18:42:43.613083 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.613046 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v"] Sep 16 18:42:43.615906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.615887 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.618846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.618825 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 16 18:42:43.619214 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.619200 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 16 18:42:43.619514 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.619497 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 16 18:42:43.619985 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.619970 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 16 18:42:43.629052 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.628993 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v"] Sep 16 18:42:43.650111 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.650079 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:43.653007 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.652979 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:43.679888 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.679855 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:43.683924 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.683897 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.684053 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.683939 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prpxc\" (UniqueName: \"kubernetes.io/projected/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-kube-api-access-prpxc\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.684053 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.684013 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-tmp\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.711582 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.711546 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-2djww"] Sep 16 18:42:43.713639 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.713617 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c94bc49bc-lwsww"] Sep 16 18:42:43.713780 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.713755 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:42:43.715760 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.715733 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.716647 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.716449 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 18:42:43.716647 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.716482 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 18:42:43.716799 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.716775 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5cc86\"" Sep 16 18:42:43.718672 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.718536 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 18:42:43.719118 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.719098 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 18:42:43.721146 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.721126 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2ndk7\"" Sep 16 18:42:43.721255 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.721240 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 18:42:43.725579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.725562 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 18:42:43.728666 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.728640 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-2djww"] Sep 16 18:42:43.731642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.731618 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c94bc49bc-lwsww"] Sep 16 18:42:43.769842 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.769800 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:43.784636 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784604 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-trusted-ca\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784636 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784638 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-tmp\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.784846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784661 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29aca362-9f95-4ab5-9064-c22e6bb63694-ca-trust-extracted\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784756 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-installation-pull-secrets\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784787 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm2zp\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-kube-api-access-mm2zp\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784846 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784816 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-image-registry-private-configuration\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784989 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784849 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:42:43.784989 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784899 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-tls\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.784989 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784978 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-tmp\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.785094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.784995 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-certificates\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.785094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.785011 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqbk\" (UniqueName: \"kubernetes.io/projected/83bd1fbe-2ef1-4f43-9393-397059f5ec9f-kube-api-access-mfqbk\") pod \"downloads-76f99584f4-2djww\" (UID: \"83bd1fbe-2ef1-4f43-9393-397059f5ec9f\") " pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:42:43.785094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.785052 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.785094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.785069 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prpxc\" (UniqueName: \"kubernetes.io/projected/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-kube-api-access-prpxc\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.785275 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.785108 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-bound-sa-token\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.787206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.787180 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa6138f-2482-4e97-8488-fa5a76286249-metrics-certs\") pod \"network-metrics-daemon-72z2n\" (UID: \"1aa6138f-2482-4e97-8488-fa5a76286249\") " pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:42:43.787446 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.787424 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.796502 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.796480 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prpxc\" (UniqueName: \"kubernetes.io/projected/1cdea5c7-3904-431a-b2ac-51c1e3bc908f-kube-api-access-prpxc\") pod \"klusterlet-addon-workmgr-67f9fd686b-zmr4v\" (UID: \"1cdea5c7-3904-431a-b2ac-51c1e3bc908f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.871926 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.871887 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:43.886587 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886499 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-tls\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886587 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886549 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-certificates\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886587 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886575 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqbk\" (UniqueName: \"kubernetes.io/projected/83bd1fbe-2ef1-4f43-9393-397059f5ec9f-kube-api-access-mfqbk\") pod \"downloads-76f99584f4-2djww\" (UID: \"83bd1fbe-2ef1-4f43-9393-397059f5ec9f\") " pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:42:43.886824 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886695 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-bound-sa-token\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886824 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886743 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-trusted-ca\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886824 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886765 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29aca362-9f95-4ab5-9064-c22e6bb63694-ca-trust-extracted\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886824 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886785 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-installation-pull-secrets\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.886824 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886813 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm2zp\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-kube-api-access-mm2zp\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.887092 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.886844 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-image-registry-private-configuration\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.887223 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.887200 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29aca362-9f95-4ab5-9064-c22e6bb63694-ca-trust-extracted\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.887973 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.887600 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-certificates\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.888227 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.888204 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29aca362-9f95-4ab5-9064-c22e6bb63694-trusted-ca\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.889590 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.889540 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-registry-tls\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.889763 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.889739 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-image-registry-private-configuration\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.889828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.889809 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29aca362-9f95-4ab5-9064-c22e6bb63694-installation-pull-secrets\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.898455 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.898372 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-bound-sa-token\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.898581 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.898526 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm2zp\" (UniqueName: \"kubernetes.io/projected/29aca362-9f95-4ab5-9064-c22e6bb63694-kube-api-access-mm2zp\") pod \"image-registry-5c94bc49bc-lwsww\" (UID: \"29aca362-9f95-4ab5-9064-c22e6bb63694\") " pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:43.898648 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.898628 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqbk\" (UniqueName: \"kubernetes.io/projected/83bd1fbe-2ef1-4f43-9393-397059f5ec9f-kube-api-access-mfqbk\") pod \"downloads-76f99584f4-2djww\" (UID: \"83bd1fbe-2ef1-4f43-9393-397059f5ec9f\") " pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:42:43.925605 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.925570 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:43.929225 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.929202 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tx4q5\"" Sep 16 18:42:43.937542 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:43.937516 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72z2n" Sep 16 18:42:44.026066 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.026032 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:42:44.034450 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.034425 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:44.207662 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.207582 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v"] Sep 16 18:42:44.210663 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:44.210638 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdea5c7_3904_431a_b2ac_51c1e3bc908f.slice/crio-3ee8e99a9416d52a667869e4e7d1d0eef62ec04b48639f6fdbd6dfd62eb7f23f WatchSource:0}: Error finding container 3ee8e99a9416d52a667869e4e7d1d0eef62ec04b48639f6fdbd6dfd62eb7f23f: Status 404 returned error can't find the container with id 3ee8e99a9416d52a667869e4e7d1d0eef62ec04b48639f6fdbd6dfd62eb7f23f Sep 16 18:42:44.228595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.228569 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72z2n"] Sep 16 18:42:44.231825 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:44.231793 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa6138f_2482_4e97_8488_fa5a76286249.slice/crio-6f4bc2a71b26f912e1756a94464130d2475b01d357f2807916ed5ba6f3b19468 WatchSource:0}: Error finding container 6f4bc2a71b26f912e1756a94464130d2475b01d357f2807916ed5ba6f3b19468: Status 404 returned error can't find the container with id 6f4bc2a71b26f912e1756a94464130d2475b01d357f2807916ed5ba6f3b19468 Sep 16 18:42:44.312370 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.312239 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-2djww"] Sep 16 18:42:44.314009 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.313948 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c94bc49bc-lwsww"] Sep 16 18:42:44.316868 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:44.316832 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bd1fbe_2ef1_4f43_9393_397059f5ec9f.slice/crio-6530d41da72254d1beed4d1e172840a4ae995f8224ec1e7016e7cf86e8f75125 WatchSource:0}: Error finding container 6530d41da72254d1beed4d1e172840a4ae995f8224ec1e7016e7cf86e8f75125: Status 404 returned error can't find the container with id 6530d41da72254d1beed4d1e172840a4ae995f8224ec1e7016e7cf86e8f75125 Sep 16 18:42:44.317596 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:42:44.317582 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aca362_9f95_4ab5_9064_c22e6bb63694.slice/crio-cd5b0f3411eac99e415bc3b7f9413232444da41eda3600ef720763492f3cf843 WatchSource:0}: Error finding container cd5b0f3411eac99e415bc3b7f9413232444da41eda3600ef720763492f3cf843: Status 404 returned error can't find the container with id cd5b0f3411eac99e415bc3b7f9413232444da41eda3600ef720763492f3cf843 Sep 16 18:42:44.384073 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.384037 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" event={"ID":"29aca362-9f95-4ab5-9064-c22e6bb63694","Type":"ContainerStarted","Data":"534d44655f1f5ae8c8e4e3cd9e2f853bbfa493aff3adbff0cc58548d28575d1d"} Sep 16 18:42:44.384196 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.384100 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" event={"ID":"29aca362-9f95-4ab5-9064-c22e6bb63694","Type":"ContainerStarted","Data":"cd5b0f3411eac99e415bc3b7f9413232444da41eda3600ef720763492f3cf843"} Sep 16 18:42:44.384196 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.384140 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:42:44.385707 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.385683 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72z2n" event={"ID":"1aa6138f-2482-4e97-8488-fa5a76286249","Type":"ContainerStarted","Data":"6f4bc2a71b26f912e1756a94464130d2475b01d357f2807916ed5ba6f3b19468"} Sep 16 18:42:44.387114 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.387038 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" event={"ID":"1cdea5c7-3904-431a-b2ac-51c1e3bc908f","Type":"ContainerStarted","Data":"3ee8e99a9416d52a667869e4e7d1d0eef62ec04b48639f6fdbd6dfd62eb7f23f"} Sep 16 18:42:44.388832 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.388803 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-2djww" event={"ID":"83bd1fbe-2ef1-4f43-9393-397059f5ec9f","Type":"ContainerStarted","Data":"6530d41da72254d1beed4d1e172840a4ae995f8224ec1e7016e7cf86e8f75125"} Sep 16 18:42:44.389102 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.389077 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:44.390709 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.390688 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9fb7ffc7b-zt7xp" Sep 16 18:42:44.409543 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:44.409275 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" podStartSLOduration=1.409254496 podStartE2EDuration="1.409254496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:44.408598114 +0000 UTC m=+130.987129731" watchObservedRunningTime="2026-09-16 18:42:44.409254496 +0000 UTC m=+130.987786111" Sep 16 18:42:45.046739 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.046622 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:45.146857 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.146820 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:45.390427 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.390372 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:45.400159 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.400125 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" event={"ID":"ce06d6fb-bcd4-44c8-8cf6-c06972683f63","Type":"ContainerStarted","Data":"73bbc582289681415cb03cc47489d3ace50692afd0dc3043ff91ff7914166479"} Sep 16 18:42:45.425002 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.424941 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zfl5t" podStartSLOduration=33.473074914 podStartE2EDuration="35.424918149s" totalImagesPullingTime="1.951843235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:45.424687758 +0000 UTC m=+132.003219376" watchObservedRunningTime="2026-09-16 18:42:45.424918149 +0000 UTC m=+132.003449768" Sep 16 18:42:45.483122 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.483087 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:45.614775 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.614707 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:45.689389 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:45.689281 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:46.407651 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.406760 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72z2n" event={"ID":"1aa6138f-2482-4e97-8488-fa5a76286249","Type":"ContainerStarted","Data":"eee867bd90e77c637cd9ef8e39ff75ae6dff3e638fbfddbc3a24606bc1612b21"} Sep 16 18:42:46.407651 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.406826 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72z2n" event={"ID":"1aa6138f-2482-4e97-8488-fa5a76286249","Type":"ContainerStarted","Data":"4a61bd4ae8ad653bfc18c53050d70d54dffa7c90c129a37babe5fb80ee78d910"} Sep 16 18:42:46.432669 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.429723 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-72z2n" podStartSLOduration=130.742323452 podStartE2EDuration="2m12.429701571s" totalImagesPullingTime="1.687378119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:46.428869139 +0000 UTC m=+133.007400756" watchObservedRunningTime="2026-09-16 18:42:46.429701571 +0000 UTC m=+133.008233193" Sep 16 18:42:46.512558 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.512513 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:46.517207 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.517155 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c775e669-50ad-46a8-bc58-13930761def1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntdsk\" (UID: \"c775e669-50ad-46a8-bc58-13930761def1\") " pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:46.534459 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.534421 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:46.587242 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.587145 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:46.740884 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.740760 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-99dld\"" Sep 16 18:42:46.749192 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:46.749162 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntdsk" Sep 16 18:42:47.361953 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:47.361873 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntdsk"] Sep 16 18:42:47.412630 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:47.412597 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntdsk" event={"ID":"c775e669-50ad-46a8-bc58-13930761def1","Type":"ContainerStarted","Data":"6dc67041c20693dabec56ab4bb784880d119e7eff54e737a5ba9ea4065cb61da"} Sep 16 18:42:48.419276 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:48.419231 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntdsk" event={"ID":"c775e669-50ad-46a8-bc58-13930761def1","Type":"ContainerStarted","Data":"5e24454a536039f7d71aefe842daa610b5b9c5d16b2b1b8023de1f0cd035311b"} Sep 16 18:42:49.425335 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.425289 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" event={"ID":"1cdea5c7-3904-431a-b2ac-51c1e3bc908f","Type":"ContainerStarted","Data":"fa4c105c3044dca7a6cc75360ef3b26361d9f2f2bdc153d603a20954341ebc51"} Sep 16 18:42:49.425790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.425522 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:49.427497 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.427465 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntdsk" event={"ID":"c775e669-50ad-46a8-bc58-13930761def1","Type":"ContainerStarted","Data":"f3d17b159247038d235c302b4e66d320fcec8f6a26b39e5c7c7e81080a13c2ef"} Sep 16 18:42:49.427625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.427553 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" Sep 16 18:42:49.444899 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.444852 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f9fd686b-zmr4v" podStartSLOduration=1.819284592 podStartE2EDuration="6.44483669s" totalImagesPullingTime="4.625552098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:49.444116327 +0000 UTC m=+136.022647944" watchObservedRunningTime="2026-09-16 18:42:49.44483669 +0000 UTC m=+136.023368301" Sep 16 18:42:49.678245 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.678066 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:49.756011 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.755844 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:49.868741 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:49.868706 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:51.438640 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:51.438598 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntdsk" event={"ID":"c775e669-50ad-46a8-bc58-13930761def1","Type":"ContainerStarted","Data":"a0054e1f55d4fc18031b57e9337286a929f4cf41d48ba18a269607a414ed33a8"} Sep 16 18:42:51.461662 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:51.461594 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ntdsk" podStartSLOduration=34.360145032 podStartE2EDuration="37.461573424s" totalImagesPullingTime="3.101428392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:42:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:51.459999382 +0000 UTC m=+138.038531002" watchObservedRunningTime="2026-09-16 18:42:51.461573424 +0000 UTC m=+138.040105043" Sep 16 18:42:51.809385 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:51.809269 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:51.910368 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:51.910302 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:52.011473 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:52.011391 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:52.688885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:52.688847 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:53.576954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:53.576915 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:53.644412 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:53.644365 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:53.828105 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:53.828007 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.099791 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.099699 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.137894 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.137860 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4"] Sep 16 18:42:54.141591 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.141565 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.144173 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.144139 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 16 18:42:54.145186 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.145164 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 18:42:54.145299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.145180 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 16 18:42:54.145299 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.145229 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jctx2\"" Sep 16 18:42:54.156750 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.156721 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4"] Sep 16 18:42:54.182987 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.182953 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.199959 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.199927 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d54pf"] Sep 16 18:42:54.203315 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.203292 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.205687 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.205658 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 18:42:54.206012 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.205995 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5gflp\"" Sep 16 18:42:54.206087 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.206018 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 18:42:54.206087 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.206036 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 18:42:54.256853 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.256813 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.284419 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.284381 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.284603 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.284466 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ndg\" (UniqueName: \"kubernetes.io/projected/240cba97-4298-4a2f-91bc-06bcc65c1f48-kube-api-access-r7ndg\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.284603 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.284538 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.284603 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.284588 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240cba97-4298-4a2f-91bc-06bcc65c1f48-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.358535 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.358446 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.385088 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385050 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-metrics-client-ca\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385097 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385121 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-textfile\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385175 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ndg\" (UniqueName: \"kubernetes.io/projected/240cba97-4298-4a2f-91bc-06bcc65c1f48-kube-api-access-r7ndg\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385212 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-sys\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385234 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-root\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385283 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385262 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385291 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-wtmp\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385369 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385394 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385447 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2v2d\" (UniqueName: \"kubernetes.io/projected/529b72fc-196d-4a63-b171-42bb7acb75f1-kube-api-access-j2v2d\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385472 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.385595 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.385504 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240cba97-4298-4a2f-91bc-06bcc65c1f48-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.386195 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.386156 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240cba97-4298-4a2f-91bc-06bcc65c1f48-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.388084 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.388039 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.388197 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.388137 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/240cba97-4298-4a2f-91bc-06bcc65c1f48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.395409 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.395378 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ndg\" (UniqueName: \"kubernetes.io/projected/240cba97-4298-4a2f-91bc-06bcc65c1f48-kube-api-access-r7ndg\") pod \"openshift-state-metrics-67dcf8c979-jsxp4\" (UID: \"240cba97-4298-4a2f-91bc-06bcc65c1f48\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.454331 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.454295 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" Sep 16 18:42:54.458058 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.458027 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.486118 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486073 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-sys\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486118 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486118 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-root\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486150 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486180 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-wtmp\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486205 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-sys\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486213 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-root\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:54.486295 2528 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486339 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486347 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-wtmp\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486386 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:54.486381 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls podName:529b72fc-196d-4a63-b171-42bb7acb75f1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:54.986359477 +0000 UTC m=+141.564891084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls") pod "node-exporter-d54pf" (UID: "529b72fc-196d-4a63-b171-42bb7acb75f1") : secret "node-exporter-tls" not found Sep 16 18:42:54.486790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486454 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2v2d\" (UniqueName: \"kubernetes.io/projected/529b72fc-196d-4a63-b171-42bb7acb75f1-kube-api-access-j2v2d\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486489 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486533 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-metrics-client-ca\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486564 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-textfile\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.486996 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.486910 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-textfile\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.487266 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.487235 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.487266 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.487258 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/529b72fc-196d-4a63-b171-42bb7acb75f1-metrics-client-ca\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.488898 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.488865 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.498417 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.498389 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2v2d\" (UniqueName: \"kubernetes.io/projected/529b72fc-196d-4a63-b171-42bb7acb75f1-kube-api-access-j2v2d\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.591643 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.591602 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.726753 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.726712 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.918123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.918089 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:54.991315 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:54.991223 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:54.991501 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:54.991419 2528 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 18:42:54.991621 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:42:54.991514 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls podName:529b72fc-196d-4a63-b171-42bb7acb75f1 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:55.991493084 +0000 UTC m=+142.570024693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls") pod "node-exporter-d54pf" (UID: "529b72fc-196d-4a63-b171-42bb7acb75f1") : secret "node-exporter-tls" not found Sep 16 18:42:55.002728 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.002695 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:55.102233 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.102153 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:55.203136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.202892 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:55.204009 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.203974 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:42:55.207930 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.207877 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.210757 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.210734 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 18:42:55.210883 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.210739 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 18:42:55.210883 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.210775 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 18:42:55.210883 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.210809 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndqkk\"" Sep 16 18:42:55.211034 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211001 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 18:42:55.211259 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211237 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 18:42:55.211408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211287 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 18:42:55.211408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211372 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 18:42:55.211408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211242 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 18:42:55.211582 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.211499 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 18:42:55.228484 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.228454 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:42:55.324496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.324410 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:55.394395 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394361 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394395 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394413 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394395 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394443 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6dt\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394395 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394546 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394580 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394615 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394648 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394677 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394737 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394780 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394825 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394856 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.394906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.394874 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.421080 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.421038 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495348 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495400 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495449 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495476 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495501 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495537 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495560 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495590 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6dt\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495625 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495650 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495681 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495705 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.495856 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.495732 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.497314 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.496971 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.498177 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.497884 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.498347 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.498304 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.498845 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.498821 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.501801 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.501767 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.501904 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.501865 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.501904 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.501865 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.502024 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.501995 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.502104 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.502080 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.503023 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.503002 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.503233 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.503208 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.503991 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.503961 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.513593 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.513570 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6dt\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt\") pod \"alertmanager-main-0\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.520245 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.520215 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:42:55.999656 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:55.999620 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:56.002138 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.002115 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/529b72fc-196d-4a63-b171-42bb7acb75f1-node-exporter-tls\") pod \"node-exporter-d54pf\" (UID: \"529b72fc-196d-4a63-b171-42bb7acb75f1\") " pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:56.014123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.014097 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d54pf" Sep 16 18:42:56.217038 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.216993 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49"] Sep 16 18:42:56.220480 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.220454 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.223800 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.223553 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7s5vp\"" Sep 16 18:42:56.223800 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.223644 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6nfv3sr5phrsg\"" Sep 16 18:42:56.223800 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.223657 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 18:42:56.223800 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.223789 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 18:42:56.224124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.223855 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 18:42:56.224679 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.224654 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 18:42:56.224679 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.224669 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 18:42:56.238096 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.238019 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49"] Sep 16 18:42:56.379481 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.379442 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:56.403381 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403329 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-grpc-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403416 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403450 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsdgd\" (UniqueName: \"kubernetes.io/projected/1a904256-6edd-4775-92bd-dd78ae1cd6ec-kube-api-access-tsdgd\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403480 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403537 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403997 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403590 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a904256-6edd-4775-92bd-dd78ae1cd6ec-metrics-client-ca\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403997 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403726 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.403997 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.403776 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.486006 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.485968 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:56.504877 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.504841 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505078 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.504895 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505078 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.504929 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a904256-6edd-4775-92bd-dd78ae1cd6ec-metrics-client-ca\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505078 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505039 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505238 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505082 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505238 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505108 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-grpc-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505238 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505152 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505238 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505186 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsdgd\" (UniqueName: \"kubernetes.io/projected/1a904256-6edd-4775-92bd-dd78ae1cd6ec-kube-api-access-tsdgd\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.505874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.505818 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a904256-6edd-4775-92bd-dd78ae1cd6ec-metrics-client-ca\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508105 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508103 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508539 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508512 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508620 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508579 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508673 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508622 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-grpc-tls\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.508982 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.508963 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a904256-6edd-4775-92bd-dd78ae1cd6ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.521858 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.521823 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsdgd\" (UniqueName: \"kubernetes.io/projected/1a904256-6edd-4775-92bd-dd78ae1cd6ec-kube-api-access-tsdgd\") pod \"thanos-querier-b4cd9c4cb-bkx49\" (UID: \"1a904256-6edd-4775-92bd-dd78ae1cd6ec\") " pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:56.532538 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:56.532507 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:42:57.181971 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.181937 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:57.280776 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.280736 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:57.558459 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.558367 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:57.800208 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.800174 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:57.980779 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.980740 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:42:57.983944 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.983922 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:57.986818 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.986790 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 18:42:57.986957 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.986914 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 18:42:57.988205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.987988 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hxfv9\"" Sep 16 18:42:57.988205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.988018 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 18:42:57.988205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.988108 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 18:42:57.988205 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.988206 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 18:42:57.992954 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.992923 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 18:42:57.997652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:57.997627 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:42:58.018278 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018222 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018447 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018286 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018447 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018358 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018447 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018420 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018494 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018565 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018536 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.018652 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.018570 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7445v\" (UniqueName: \"kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119280 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119238 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119352 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119405 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119435 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445v\" (UniqueName: \"kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119461 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119496 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119488 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.119758 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.119521 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.120642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.120194 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.120642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.120265 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.120642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.120450 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.120642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.120595 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.122442 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.122422 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.122994 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.122968 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.142099 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.142069 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7445v\" (UniqueName: \"kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v\") pod \"console-7f8fc66b8b-96hvh\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.295793 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.295704 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:42:58.877338 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.877290 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:58.978266 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:58.978203 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:59.177929 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:59.177830 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:59.301757 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:59.301712 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:42:59.379557 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:42:59.379519 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:00.027186 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:00.027139 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:00.127101 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:00.127030 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:00.522747 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:00.522686 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:00.962076 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:00.962038 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:01.065371 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:01.065311 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:01.506534 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:43:01.506481 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529b72fc_196d_4a63_b171_42bb7acb75f1.slice/crio-33fcd9cef83d10f3ee6a01d1a9b3c3c682e16c211edc591a6a1471fa4c500c37 WatchSource:0}: Error finding container 33fcd9cef83d10f3ee6a01d1a9b3c3c682e16c211edc591a6a1471fa4c500c37: Status 404 returned error can't find the container with id 33fcd9cef83d10f3ee6a01d1a9b3c3c682e16c211edc591a6a1471fa4c500c37 Sep 16 18:43:01.790721 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:01.790694 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:43:01.792778 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:43:01.792744 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d1c895_20ed_421d_81f4_6ee81ef2568d.slice/crio-11b715ce1ea5569a09cf276c2cd26394e4af9983f6e185c5bad4df9903c3b6c0 WatchSource:0}: Error finding container 11b715ce1ea5569a09cf276c2cd26394e4af9983f6e185c5bad4df9903c3b6c0: Status 404 returned error can't find the container with id 11b715ce1ea5569a09cf276c2cd26394e4af9983f6e185c5bad4df9903c3b6c0 Sep 16 18:43:01.797747 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:01.797718 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4"] Sep 16 18:43:01.801365 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:01.800253 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49"] Sep 16 18:43:01.802851 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:01.802833 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:43:02.491556 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.491414 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"684cf3d232d41f8a7a3bd6d629561d6049684e9909c0c4a9465335606a8165f7"} Sep 16 18:43:02.496395 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.496360 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" event={"ID":"240cba97-4298-4a2f-91bc-06bcc65c1f48","Type":"ContainerStarted","Data":"d7ab7cdc5978e6f879b35c04a61cdfd7a66d10f08cfd2482ef1b806c2a783f6b"} Sep 16 18:43:02.496555 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.496430 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" event={"ID":"240cba97-4298-4a2f-91bc-06bcc65c1f48","Type":"ContainerStarted","Data":"43a0e074ced53d85d4034e2b462a14a4ea499bd09a7c4d3dd16ddf560fbc4661"} Sep 16 18:43:02.496555 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.496456 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" event={"ID":"240cba97-4298-4a2f-91bc-06bcc65c1f48","Type":"ContainerStarted","Data":"6c047477bc8790fdaff325199bce537acd9b7d491ee12368aea625b9df1c1ff0"} Sep 16 18:43:02.506389 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.506306 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d54pf" event={"ID":"529b72fc-196d-4a63-b171-42bb7acb75f1","Type":"ContainerStarted","Data":"33fcd9cef83d10f3ee6a01d1a9b3c3c682e16c211edc591a6a1471fa4c500c37"} Sep 16 18:43:02.508226 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.508182 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fc66b8b-96hvh" event={"ID":"12d1c895-20ed-421d-81f4-6ee81ef2568d","Type":"ContainerStarted","Data":"11b715ce1ea5569a09cf276c2cd26394e4af9983f6e185c5bad4df9903c3b6c0"} Sep 16 18:43:02.511257 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.511221 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"076698ccba1b25a6ad94988efa7259519d76f1a310a14cf64f84fecb5b8ad39e"} Sep 16 18:43:02.514222 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.514195 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-2djww" event={"ID":"83bd1fbe-2ef1-4f43-9393-397059f5ec9f","Type":"ContainerStarted","Data":"17ab02d82c76546db835818469d5adb86f35cbf63a41c119c7b6693ad33c883b"} Sep 16 18:43:02.515223 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.515176 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:43:02.535639 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.535022 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-2djww" Sep 16 18:43:02.538916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:02.537926 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-2djww" podStartSLOduration=2.253954642 podStartE2EDuration="19.537907202s" totalImagesPullingTime="17.28395256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:02.535437631 +0000 UTC m=+149.113969261" watchObservedRunningTime="2026-09-16 18:43:02.537907202 +0000 UTC m=+149.116438833" Sep 16 18:43:03.526949 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:03.526870 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:43:04.532589 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:04.532550 2528 generic.go:356] "Generic (PLEG): container finished" podID="529b72fc-196d-4a63-b171-42bb7acb75f1" containerID="785c843f35cb7203463093d855831629fdccc18aecd800c468d5e218a2b01fc2" exitCode=0 Sep 16 18:43:04.533233 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:04.533198 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d54pf" event={"ID":"529b72fc-196d-4a63-b171-42bb7acb75f1","Type":"ContainerDied","Data":"785c843f35cb7203463093d855831629fdccc18aecd800c468d5e218a2b01fc2"} Sep 16 18:43:05.405791 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:05.405750 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c94bc49bc-lwsww" Sep 16 18:43:05.549893 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:05.549722 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:05.620177 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:05.620103 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:05.685083 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:05.685035 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:07.548415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.548287 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d" exitCode=0 Sep 16 18:43:07.548415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.548355 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d"} Sep 16 18:43:07.551139 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.551114 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" event={"ID":"240cba97-4298-4a2f-91bc-06bcc65c1f48","Type":"ContainerStarted","Data":"1abd92cd308b9eaae217b0c1b2524fe5cada05ec59b7dc1e8237d088a33c0cfe"} Sep 16 18:43:07.553818 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.553777 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d54pf" event={"ID":"529b72fc-196d-4a63-b171-42bb7acb75f1","Type":"ContainerStarted","Data":"2de9b2a633cf89edfd246cc7f02164387d84ccf94ed92f0c87783f42010c91ea"} Sep 16 18:43:07.553916 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.553826 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d54pf" event={"ID":"529b72fc-196d-4a63-b171-42bb7acb75f1","Type":"ContainerStarted","Data":"ec01b123ab368cbe7131d2558f1093eedd3be14815af086e4ff8fc6e44ec3ecc"} Sep 16 18:43:07.555733 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.555712 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fc66b8b-96hvh" event={"ID":"12d1c895-20ed-421d-81f4-6ee81ef2568d","Type":"ContainerStarted","Data":"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569"} Sep 16 18:43:07.563790 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.563748 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"fabb086785b328aa436dafc28e42574347a8e7cbb797b718a020d62aac01e414"} Sep 16 18:43:07.563889 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.563853 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"f1a39ff392728be26e4345287ec266d637c31d2e9c9599c273749d51d84db18f"} Sep 16 18:43:07.605722 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.605672 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jsxp4" podStartSLOduration=8.368701628 podStartE2EDuration="13.605653856s" totalImagesPullingTime="5.236952228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:07.603704783 +0000 UTC m=+154.182236401" watchObservedRunningTime="2026-09-16 18:43:07.605653856 +0000 UTC m=+154.184185480" Sep 16 18:43:07.630554 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.630491 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d54pf" podStartSLOduration=11.252033391 podStartE2EDuration="13.630474992s" totalImagesPullingTime="2.286350089s" totalInitContainerRuntime="92.091512ms" isStatefulPod=true podCreationTimestamp="2026-09-16 18:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:07.628793711 +0000 UTC m=+154.207325329" watchObservedRunningTime="2026-09-16 18:43:07.630474992 +0000 UTC m=+154.209006608" Sep 16 18:43:07.652313 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:07.651920 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8fc66b8b-96hvh" podStartSLOduration=5.23687871 podStartE2EDuration="10.651895405s" totalImagesPullingTime="5.415016695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:07.651177932 +0000 UTC m=+154.229709549" watchObservedRunningTime="2026-09-16 18:43:07.651895405 +0000 UTC m=+154.230427023" Sep 16 18:43:08.296226 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:08.296133 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:43:08.572836 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:08.572634 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"c4460d72c37421d62b457f35d7b7d06c438e0d4d30332161d303868cbd1a56cf"} Sep 16 18:43:10.586043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.585812 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"8db83389a3d23f7a22edf56f6a103beef2afb6f9bb92990867b7de4b4ab52073"} Sep 16 18:43:10.586043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.585908 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"8d87d3b50c2158dce796cb7f5941886bfb9a57326ff82bd4e62abbac146c2d24"} Sep 16 18:43:10.586043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.585951 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" event={"ID":"1a904256-6edd-4775-92bd-dd78ae1cd6ec","Type":"ContainerStarted","Data":"5cea55eaecf022a3f66585477c5db3dcdcd52332887adec72c2dfb90a1c40114"} Sep 16 18:43:10.586043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.585995 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:43:10.589365 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.589340 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b"} Sep 16 18:43:10.589467 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.589394 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a"} Sep 16 18:43:10.589467 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.589422 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef"} Sep 16 18:43:10.589467 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.589446 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c"} Sep 16 18:43:10.589630 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.589470 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8"} Sep 16 18:43:10.612110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:10.612054 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" podStartSLOduration=7.40914346 podStartE2EDuration="14.612032359s" totalImagesPullingTime="7.202888899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:10.610876519 +0000 UTC m=+157.189408141" watchObservedRunningTime="2026-09-16 18:43:10.612032359 +0000 UTC m=+157.190563977" Sep 16 18:43:10.803700 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:43:10.803655 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2c4d6" podUID="131a2346-1153-4537-b06f-a1f716b2045b" Sep 16 18:43:11.579112 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:11.579069 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:11.596406 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:11.596370 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerStarted","Data":"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef"} Sep 16 18:43:11.596804 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:11.596426 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:11.627197 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:11.627141 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.132146148 podStartE2EDuration="16.627124128s" totalImagesPullingTime="7.471543831s" totalInitContainerRuntime="23.434149ms" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:11.624664181 +0000 UTC m=+158.203195799" watchObservedRunningTime="2026-09-16 18:43:11.627124128 +0000 UTC m=+158.205655745" Sep 16 18:43:11.680655 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:11.680609 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:12.700383 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:12.700344 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:12.757341 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:12.757278 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.142129 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.142090 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.203040 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.202996 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.626932 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.626898 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.721882 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.721844 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.821967 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.821915 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:14.880668 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:14.880577 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:15.700880 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:15.700840 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:15.703120 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:15.703091 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/131a2346-1153-4537-b06f-a1f716b2045b-metrics-tls\") pod \"dns-default-2c4d6\" (UID: \"131a2346-1153-4537-b06f-a1f716b2045b\") " pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:15.799902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:15.799862 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm88x\"" Sep 16 18:43:15.808224 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:15.808195 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:16.123094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:16.123031 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c4d6"] Sep 16 18:43:16.126480 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:43:16.126452 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131a2346_1153_4537_b06f_a1f716b2045b.slice/crio-87c5fe4d956ef514586b02972240cc4ab37a045e3138ee7adb10be2e61cf4dac WatchSource:0}: Error finding container 87c5fe4d956ef514586b02972240cc4ab37a045e3138ee7adb10be2e61cf4dac: Status 404 returned error can't find the container with id 87c5fe4d956ef514586b02972240cc4ab37a045e3138ee7adb10be2e61cf4dac Sep 16 18:43:16.605206 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:16.605173 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b4cd9c4cb-bkx49" Sep 16 18:43:16.619332 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:16.619289 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c4d6" event={"ID":"131a2346-1153-4537-b06f-a1f716b2045b","Type":"ContainerStarted","Data":"87c5fe4d956ef514586b02972240cc4ab37a045e3138ee7adb10be2e61cf4dac"} Sep 16 18:43:18.629836 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:18.629799 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c4d6" event={"ID":"131a2346-1153-4537-b06f-a1f716b2045b","Type":"ContainerStarted","Data":"61e13c7c8fb40b48ff88ed390ff46c0dc0cbb27789e2d5b63018fe460b39ac1f"} Sep 16 18:43:18.630284 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:18.629853 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c4d6" event={"ID":"131a2346-1153-4537-b06f-a1f716b2045b","Type":"ContainerStarted","Data":"6cb3311e595f3b81cb76e7c3327f037d23efdabfad21b5048c71db721fae1598"} Sep 16 18:43:18.630284 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:18.629891 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:18.652039 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:18.651984 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2c4d6" podStartSLOduration=129.72003744 podStartE2EDuration="2m11.65196567s" totalImagesPullingTime="1.93192823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:43:18.650256167 +0000 UTC m=+165.228787777" watchObservedRunningTime="2026-09-16 18:43:18.65196567 +0000 UTC m=+165.230497286" Sep 16 18:43:24.268635 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:24.268589 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:24.328255 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:24.328216 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:28.637101 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:28.637029 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2c4d6" Sep 16 18:43:31.596536 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:31.596499 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:32.582239 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.582191 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8fc66b8b-96hvh" podUID="12d1c895-20ed-421d-81f4-6ee81ef2568d" containerName="console" containerID="cri-o://d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569" gracePeriod=15 Sep 16 18:43:32.817007 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.816976 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:43:32.944004 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.943960 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944004 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944006 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944221 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944038 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944221 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944076 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944285 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944259 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7445v\" (UniqueName: \"kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944396 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944376 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944455 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944434 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert\") pod \"12d1c895-20ed-421d-81f4-6ee81ef2568d\" (UID: \"12d1c895-20ed-421d-81f4-6ee81ef2568d\") " Sep 16 18:43:32.944705 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944511 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca" (OuterVolumeSpecName: "service-ca") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:43:32.944705 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944567 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:43:32.944885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944760 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config" (OuterVolumeSpecName: "console-config") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:43:32.944885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944831 2528 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-service-ca\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:32.944885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944851 2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-trusted-ca-bundle\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:32.944885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944862 2528 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:32.944885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.944859 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:43:32.946381 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.946354 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:43:32.946648 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.946626 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v" (OuterVolumeSpecName: "kube-api-access-7445v") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "kube-api-access-7445v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 18:43:32.946716 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:32.946690 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12d1c895-20ed-421d-81f4-6ee81ef2568d" (UID: "12d1c895-20ed-421d-81f4-6ee81ef2568d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:43:33.045490 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.045447 2528 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-oauth-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:33.045490 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.045481 2528 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12d1c895-20ed-421d-81f4-6ee81ef2568d-console-serving-cert\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:33.045490 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.045491 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7445v\" (UniqueName: \"kubernetes.io/projected/12d1c895-20ed-421d-81f4-6ee81ef2568d-kube-api-access-7445v\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:33.045490 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.045501 2528 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12d1c895-20ed-421d-81f4-6ee81ef2568d-oauth-serving-cert\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:43:33.692121 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.692086 2528 generic.go:356] "Generic (PLEG): container finished" podID="12d1c895-20ed-421d-81f4-6ee81ef2568d" containerID="d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569" exitCode=0 Sep 16 18:43:33.692355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.692128 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fc66b8b-96hvh" Sep 16 18:43:33.692355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.692139 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fc66b8b-96hvh" event={"ID":"12d1c895-20ed-421d-81f4-6ee81ef2568d","Type":"ContainerDied","Data":"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569"} Sep 16 18:43:33.692355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.692187 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fc66b8b-96hvh" event={"ID":"12d1c895-20ed-421d-81f4-6ee81ef2568d","Type":"ContainerDied","Data":"11b715ce1ea5569a09cf276c2cd26394e4af9983f6e185c5bad4df9903c3b6c0"} Sep 16 18:43:33.692355 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.692213 2528 scope.go:117] "RemoveContainer" containerID="d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569" Sep 16 18:43:33.702942 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.702780 2528 scope.go:117] "RemoveContainer" containerID="d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569" Sep 16 18:43:33.703209 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:43:33.703182 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569\": container with ID starting with d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569 not found: ID does not exist" containerID="d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569" Sep 16 18:43:33.703286 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.703216 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569"} err="failed to get container status \"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569\": rpc error: code = NotFound desc = could not find container \"d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569\": container with ID starting with d6796970bd19d3fe3e3ba7d4428a835d8f9e3f22b206383f2de6993dc0724569 not found: ID does not exist" Sep 16 18:43:33.719653 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.719617 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:43:33.724236 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.724209 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8fc66b8b-96hvh"] Sep 16 18:43:33.915807 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:33.915771 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d1c895-20ed-421d-81f4-6ee81ef2568d" path="/var/lib/kubelet/pods/12d1c895-20ed-421d-81f4-6ee81ef2568d/volumes" Sep 16 18:43:34.698014 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:34.697982 2528 generic.go:356] "Generic (PLEG): container finished" podID="30144b38-420c-4cfa-ac7d-82043eb234c6" containerID="d464630ec41714827d3f9303cd2c211cb96ec0611c8cbb69f82d2c1c1fafabfc" exitCode=0 Sep 16 18:43:34.698161 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:34.698057 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" event={"ID":"30144b38-420c-4cfa-ac7d-82043eb234c6","Type":"ContainerDied","Data":"d464630ec41714827d3f9303cd2c211cb96ec0611c8cbb69f82d2c1c1fafabfc"} Sep 16 18:43:34.698415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:34.698400 2528 scope.go:117] "RemoveContainer" containerID="d464630ec41714827d3f9303cd2c211cb96ec0611c8cbb69f82d2c1c1fafabfc" Sep 16 18:43:35.551055 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:35.551027 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fb7ffc7b-zt7xp_7dca864c-7a28-468d-ad82-f63dd00d2a83/router/0.log" Sep 16 18:43:35.576777 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:35.576749 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9wrt_249189f4-2c25-4ac6-8358-dff2538791ed/serve-healthcheck-canary/0.log" Sep 16 18:43:35.703663 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:35.703630 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-9pt7p" event={"ID":"30144b38-420c-4cfa-ac7d-82043eb234c6","Type":"ContainerStarted","Data":"34401e54efa8b321e2a1f01ffc870e6e55375584f7c7b11e739dbef6156eebdd"} Sep 16 18:43:39.309421 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:39.309381 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:39.387292 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:39.387252 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:40.598924 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:40.598884 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:40.656424 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:40.656391 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:45.744865 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:45.744830 2528 generic.go:356] "Generic (PLEG): container finished" podID="d8b8882c-2489-4511-abf0-008f04d2c954" containerID="8abc1663fb7cea81a3cdc3b142711b41c031550ba320654cd426318350458349" exitCode=0 Sep 16 18:43:45.745350 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:45.744923 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" event={"ID":"d8b8882c-2489-4511-abf0-008f04d2c954","Type":"ContainerDied","Data":"8abc1663fb7cea81a3cdc3b142711b41c031550ba320654cd426318350458349"} Sep 16 18:43:45.745425 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:45.745356 2528 scope.go:117] "RemoveContainer" containerID="8abc1663fb7cea81a3cdc3b142711b41c031550ba320654cd426318350458349" Sep 16 18:43:46.752837 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:46.752783 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-2dj49" event={"ID":"d8b8882c-2489-4511-abf0-008f04d2c954","Type":"ContainerStarted","Data":"2c514bb5002fd23722f005bc320a5cced1ceaff27aafc4e8982214e91805ab6e"} Sep 16 18:43:48.980813 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:48.980773 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:49.080687 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:49.080647 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:43:49.182801 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:43:49.182760 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:10.351167 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.351127 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:10.413616 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.413582 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:10.508969 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.508931 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:44:10.509272 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.509257 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d1c895-20ed-421d-81f4-6ee81ef2568d" containerName="console" Sep 16 18:44:10.509344 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.509275 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d1c895-20ed-421d-81f4-6ee81ef2568d" containerName="console" Sep 16 18:44:10.509389 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.509367 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d1c895-20ed-421d-81f4-6ee81ef2568d" containerName="console" Sep 16 18:44:10.511974 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.511939 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.514796 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.514774 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 18:44:10.515948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.515830 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 18:44:10.515948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.515844 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 18:44:10.515948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.515884 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hxfv9\"" Sep 16 18:44:10.516158 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.516075 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 18:44:10.516267 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.516239 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 18:44:10.521278 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.521252 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 18:44:10.522696 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.522676 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:44:10.540035 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540006 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540157 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540056 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540157 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540125 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540276 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540207 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540276 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540248 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540406 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540291 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.540406 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.540385 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkkh\" (UniqueName: \"kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.558784 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.558751 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:10.640974 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.640940 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.640982 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkkh\" (UniqueName: \"kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641010 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641218 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641183 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641266 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641248 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641354 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641304 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641414 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641366 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641778 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641754 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.641968 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.641938 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.642078 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.642049 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.642146 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.642077 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.643637 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.643618 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.643730 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.643712 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.650574 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.650551 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkkh\" (UniqueName: \"kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh\") pod \"console-5f958cf876-fkdjf\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:10.823896 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:10.823856 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:11.095470 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:11.095252 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:44:11.098135 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:44:11.098102 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3b6db2_1902_494a_8ae5_84f01ed4edfd.slice/crio-d448b8b1c4f8852e9f47078573f3892acbfbf58de749cab20f3a22425652a92f WatchSource:0}: Error finding container d448b8b1c4f8852e9f47078573f3892acbfbf58de749cab20f3a22425652a92f: Status 404 returned error can't find the container with id d448b8b1c4f8852e9f47078573f3892acbfbf58de749cab20f3a22425652a92f Sep 16 18:44:11.862417 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:11.862380 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f958cf876-fkdjf" event={"ID":"ee3b6db2-1902-494a-8ae5-84f01ed4edfd","Type":"ContainerStarted","Data":"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8"} Sep 16 18:44:11.862828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:11.862430 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f958cf876-fkdjf" event={"ID":"ee3b6db2-1902-494a-8ae5-84f01ed4edfd","Type":"ContainerStarted","Data":"d448b8b1c4f8852e9f47078573f3892acbfbf58de749cab20f3a22425652a92f"} Sep 16 18:44:14.637742 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.637685 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f958cf876-fkdjf" podStartSLOduration=4.637667798 podStartE2EDuration="4.637667798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:44:11.888592396 +0000 UTC m=+218.467124014" watchObservedRunningTime="2026-09-16 18:44:14.637667798 +0000 UTC m=+221.216199416" Sep 16 18:44:14.638153 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.637891 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:14.638153 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638146 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="alertmanager" containerID="cri-o://77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8" gracePeriod=120 Sep 16 18:44:14.638254 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638223 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-metric" containerID="cri-o://c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b" gracePeriod=120 Sep 16 18:44:14.638416 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638243 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="prom-label-proxy" containerID="cri-o://0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef" gracePeriod=120 Sep 16 18:44:14.638416 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638272 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-web" containerID="cri-o://2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef" gracePeriod=120 Sep 16 18:44:14.638416 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638304 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy" containerID="cri-o://049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a" gracePeriod=120 Sep 16 18:44:14.638416 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.638292 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="config-reloader" containerID="cri-o://07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c" gracePeriod=120 Sep 16 18:44:14.879625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879593 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef" exitCode=0 Sep 16 18:44:14.879625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879618 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b" exitCode=0 Sep 16 18:44:14.879625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879624 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a" exitCode=0 Sep 16 18:44:14.879625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879630 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c" exitCode=0 Sep 16 18:44:14.879625 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879635 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8" exitCode=0 Sep 16 18:44:14.879928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879665 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef"} Sep 16 18:44:14.879928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879728 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b"} Sep 16 18:44:14.879928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879754 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a"} Sep 16 18:44:14.879928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879777 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c"} Sep 16 18:44:14.879928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:14.879800 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8"} Sep 16 18:44:15.881944 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.881916 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:15.885932 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.885905 2528 generic.go:356] "Generic (PLEG): container finished" podID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerID="2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef" exitCode=0 Sep 16 18:44:15.886136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.885968 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef"} Sep 16 18:44:15.886136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.885997 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:15.886136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.886021 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1","Type":"ContainerDied","Data":"684cf3d232d41f8a7a3bd6d629561d6049684e9909c0c4a9465335606a8165f7"} Sep 16 18:44:15.886136 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.886053 2528 scope.go:117] "RemoveContainer" containerID="0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef" Sep 16 18:44:15.894286 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.894268 2528 scope.go:117] "RemoveContainer" containerID="c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b" Sep 16 18:44:15.901235 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.901209 2528 scope.go:117] "RemoveContainer" containerID="049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a" Sep 16 18:44:15.908013 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.907992 2528 scope.go:117] "RemoveContainer" containerID="2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef" Sep 16 18:44:15.917180 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.917149 2528 scope.go:117] "RemoveContainer" containerID="07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c" Sep 16 18:44:15.926747 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.926724 2528 scope.go:117] "RemoveContainer" containerID="77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8" Sep 16 18:44:15.939684 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.939661 2528 scope.go:117] "RemoveContainer" containerID="4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d" Sep 16 18:44:15.948514 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.948489 2528 scope.go:117] "RemoveContainer" containerID="0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef" Sep 16 18:44:15.948822 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.948795 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef\": container with ID starting with 0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef not found: ID does not exist" containerID="0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef" Sep 16 18:44:15.948891 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.948832 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef"} err="failed to get container status \"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef\": rpc error: code = NotFound desc = could not find container \"0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef\": container with ID starting with 0f81dc4ccfcb91240826a6b96917dccd66455888f5c4f5867260ebea63fa6aef not found: ID does not exist" Sep 16 18:44:15.948891 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.948852 2528 scope.go:117] "RemoveContainer" containerID="c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b" Sep 16 18:44:15.949149 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.949130 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b\": container with ID starting with c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b not found: ID does not exist" containerID="c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b" Sep 16 18:44:15.949242 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949156 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b"} err="failed to get container status \"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b\": rpc error: code = NotFound desc = could not find container \"c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b\": container with ID starting with c705bf7338fd8aca887a25d2dc1ec22de0e038bee938a804b13ff26bb9db790b not found: ID does not exist" Sep 16 18:44:15.949242 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949174 2528 scope.go:117] "RemoveContainer" containerID="049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a" Sep 16 18:44:15.949481 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.949460 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a\": container with ID starting with 049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a not found: ID does not exist" containerID="049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a" Sep 16 18:44:15.949547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949485 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a"} err="failed to get container status \"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a\": rpc error: code = NotFound desc = could not find container \"049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a\": container with ID starting with 049155df18e3006f4582a520a75eab3298c6931aa7e08e9b3af908e0149b7c9a not found: ID does not exist" Sep 16 18:44:15.949547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949500 2528 scope.go:117] "RemoveContainer" containerID="2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef" Sep 16 18:44:15.949819 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.949799 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef\": container with ID starting with 2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef not found: ID does not exist" containerID="2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef" Sep 16 18:44:15.949867 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949826 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef"} err="failed to get container status \"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef\": rpc error: code = NotFound desc = could not find container \"2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef\": container with ID starting with 2859d1814fccc2904ba44251d19990b49cd60fc77b0ba6f56bfb3475a27653ef not found: ID does not exist" Sep 16 18:44:15.949867 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.949843 2528 scope.go:117] "RemoveContainer" containerID="07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c" Sep 16 18:44:15.950086 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.950068 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c\": container with ID starting with 07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c not found: ID does not exist" containerID="07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c" Sep 16 18:44:15.950124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.950091 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c"} err="failed to get container status \"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c\": rpc error: code = NotFound desc = could not find container \"07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c\": container with ID starting with 07541e6203fdce9aa2b413a78a6ce463a19f259558b39caccb8c6a5a6e040a8c not found: ID does not exist" Sep 16 18:44:15.950124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.950104 2528 scope.go:117] "RemoveContainer" containerID="77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8" Sep 16 18:44:15.950368 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.950353 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8\": container with ID starting with 77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8 not found: ID does not exist" containerID="77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8" Sep 16 18:44:15.950417 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.950372 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8"} err="failed to get container status \"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8\": rpc error: code = NotFound desc = could not find container \"77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8\": container with ID starting with 77537100150a509a3be3e04a188a097e13e76e1aee41dc369a7e7780de7b1ea8 not found: ID does not exist" Sep 16 18:44:15.950417 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.950385 2528 scope.go:117] "RemoveContainer" containerID="4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d" Sep 16 18:44:15.950628 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:44:15.950612 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d\": container with ID starting with 4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d not found: ID does not exist" containerID="4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d" Sep 16 18:44:15.950670 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.950632 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d"} err="failed to get container status \"4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d\": rpc error: code = NotFound desc = could not find container \"4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d\": container with ID starting with 4ce5023f1c6d3d0864da9236c297abca2d879b78cff5e4f299571a0575bf958d not found: ID does not exist" Sep 16 18:44:15.984211 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984135 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984211 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984190 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj6dt\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984212 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984246 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984262 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984279 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984300 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984375 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984402 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984432 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984860 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984481 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984860 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984514 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.984860 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.984544 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca\") pod \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\" (UID: \"7a9e783e-c6d8-4fac-96e2-64e39c3b78a1\") " Sep 16 18:44:15.985164 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.985133 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:44:15.985499 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.985472 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 18:44:15.986039 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.986013 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:44:15.987280 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.987245 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.987671 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.987634 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 18:44:15.988081 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.988013 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out" (OuterVolumeSpecName: "config-out") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 18:44:15.988081 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.988019 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt" (OuterVolumeSpecName: "kube-api-access-zj6dt") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "kube-api-access-zj6dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 18:44:15.988307 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.988276 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.988590 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.988564 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.988662 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.988629 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume" (OuterVolumeSpecName: "config-volume") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.989626 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.989602 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.991611 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.991588 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:15.997837 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:15.997818 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config" (OuterVolumeSpecName: "web-config") pod "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" (UID: "7a9e783e-c6d8-4fac-96e2-64e39c3b78a1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:44:16.085460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085419 2528 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-main-tls\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085455 2528 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-cluster-tls-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085460 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085465 2528 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-metrics-client-ca\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085475 2528 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085485 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj6dt\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-kube-api-access-zj6dt\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085494 2528 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085505 2528 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-web-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085513 2528 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-out\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085520 2528 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-config-volume\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085528 2528 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085536 2528 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085544 2528 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-tls-assets\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.085692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.085552 2528 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1-alertmanager-main-db\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:44:16.214163 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.214131 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:16.219143 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.219116 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:16.244157 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244091 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:16.244430 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244416 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244431 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244446 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="init-config-reloader" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244451 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="init-config-reloader" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244458 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="config-reloader" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244464 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="config-reloader" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244473 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="prom-label-proxy" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244478 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="prom-label-proxy" Sep 16 18:44:16.244485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244488 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="alertmanager" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244493 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="alertmanager" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244501 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-web" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244506 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-web" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244513 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-metric" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244518 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-metric" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244558 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="alertmanager" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244568 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244573 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-metric" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244579 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="config-reloader" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244585 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="prom-label-proxy" Sep 16 18:44:16.244752 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.244590 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" containerName="kube-rbac-proxy-web" Sep 16 18:44:16.247983 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.247965 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.250672 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.250647 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 18:44:16.250792 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.250645 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 18:44:16.250792 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.250727 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 18:44:16.250792 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.250747 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 18:44:16.251332 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.251298 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndqkk\"" Sep 16 18:44:16.251420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.251367 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 18:44:16.251420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.251314 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 18:44:16.251420 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.251299 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 18:44:16.251780 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.251761 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 18:44:16.256883 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.256863 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 18:44:16.264453 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.264433 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:16.287132 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287102 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287132 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287136 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287363 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287154 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-web-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287363 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287185 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287363 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287267 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287363 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287342 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287364 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287380 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287399 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287415 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ht7d\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-kube-api-access-9ht7d\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287533 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287439 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287722 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287534 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.287722 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.287566 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-out\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388061 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388110 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388110 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388406 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388239 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388406 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388279 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388518 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388401 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388518 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388437 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388518 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388461 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ht7d\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-kube-api-access-9ht7d\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388518 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388501 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388568 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388572 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388615 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-out\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388644 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388680 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.388795 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.388702 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-web-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.390038 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.389345 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.390038 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.389759 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391384 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391504 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391434 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391504 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391482 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391504 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391493 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391681 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391573 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-web-config\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.391681 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.391620 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.392040 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.392019 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.392221 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.392205 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-config-out\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.393332 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.393299 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.409314 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.409285 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ht7d\" (UniqueName: \"kubernetes.io/projected/ab89a3dc-11ff-4fb9-98c6-6e25d56970ee-kube-api-access-9ht7d\") pod \"alertmanager-main-0\" (UID: \"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.558561 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.558476 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 18:44:16.839439 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.839413 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 18:44:16.840380 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:44:16.840356 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab89a3dc_11ff_4fb9_98c6_6e25d56970ee.slice/crio-f20757be7dcb89a9f449fcc098f5309419221cc36a5b69ce0e192b323d97d961 WatchSource:0}: Error finding container f20757be7dcb89a9f449fcc098f5309419221cc36a5b69ce0e192b323d97d961: Status 404 returned error can't find the container with id f20757be7dcb89a9f449fcc098f5309419221cc36a5b69ce0e192b323d97d961 Sep 16 18:44:16.890381 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:16.890349 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"f20757be7dcb89a9f449fcc098f5309419221cc36a5b69ce0e192b323d97d961"} Sep 16 18:44:17.896295 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:17.896262 2528 generic.go:356] "Generic (PLEG): container finished" podID="ab89a3dc-11ff-4fb9-98c6-6e25d56970ee" containerID="c230f5a5540b738a8fda7e72aefb6fb5d2715b59209f95abe67f6d2ee0c35972" exitCode=0 Sep 16 18:44:17.896689 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:17.896302 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerDied","Data":"c230f5a5540b738a8fda7e72aefb6fb5d2715b59209f95abe67f6d2ee0c35972"} Sep 16 18:44:17.914724 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:17.914698 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a9e783e-c6d8-4fac-96e2-64e39c3b78a1" path="/var/lib/kubelet/pods/7a9e783e-c6d8-4fac-96e2-64e39c3b78a1/volumes" Sep 16 18:44:18.904440 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904402 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"d40f2aff3f3e6ae4dd6b285f758207a4a8cc25cf3994bbd24dc5a252db820493"} Sep 16 18:44:18.904828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904494 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"b2d064792a4f4df55e941542d3ca3c71595965b9b57441b078357b64b24e1182"} Sep 16 18:44:18.904828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904519 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"7bcb184aff2ad1e2b8234b952f759936566833f8acbdfb5c7fe72cb3e596587d"} Sep 16 18:44:18.904828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904545 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"3a1e13e3a1ba6f3705e6cef03f3749e00b6d81c6e181d98a45f95f162f7907ad"} Sep 16 18:44:18.904828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904568 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"8fec449b55be0d07b98d55350bc14f54e685758c621e2200274ed18670585b12"} Sep 16 18:44:18.904828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.904589 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab89a3dc-11ff-4fb9-98c6-6e25d56970ee","Type":"ContainerStarted","Data":"23551eba34073a5669943b9bb6798e508fdad39c241a698d55f632a91610015f"} Sep 16 18:44:18.951851 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:18.951784 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.935710732 podStartE2EDuration="2.951763353s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.052621ms" isStatefulPod=false podCreationTimestamp="2026-09-16 18:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:44:18.95096891 +0000 UTC m=+225.529500527" watchObservedRunningTime="2026-09-16 18:44:18.951763353 +0000 UTC m=+225.530294987" Sep 16 18:44:20.824342 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:20.824265 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:20.824817 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:20.824372 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:20.829173 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:20.829150 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:20.917313 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:20.917278 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:44:21.126900 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:21.126867 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:21.228062 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:21.228011 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:21.288683 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:21.288639 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:22.190648 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:22.190613 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:22.256030 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:22.255991 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:39.280507 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:39.280470 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:39.381362 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:39.381311 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:44:51.619821 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:44:51.619782 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:05.824927 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:05.824845 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:05.925607 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:05.925566 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:10.971140 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:10.971097 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:33.098362 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:33.098299 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:33.834569 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:33.834545 2528 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 18:45:44.723755 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:44.723714 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:44.822247 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:44.822211 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:44.881833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:44.881785 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:51.187655 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:51.187620 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:56.132473 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:56.132411 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:45:56.190594 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:45:56.190558 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:07.267133 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:07.267093 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:07.354835 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:07.354786 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:12.343314 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:12.343227 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:12.627503 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:12.627473 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:12.867814 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:12.867771 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.004923 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.004834 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.213901 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.213867 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.275149 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.275074 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-sftv2"] Sep 16 18:46:13.277474 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.277457 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.282760 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.282740 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 16 18:46:13.282891 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.282875 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-4zrhd\"" Sep 16 18:46:13.282977 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.282959 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 16 18:46:13.283970 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.283952 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 16 18:46:13.284040 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.283995 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 16 18:46:13.295370 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.295344 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-sftv2"] Sep 16 18:46:13.307140 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.307100 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.372973 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.372923 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.434715 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.434676 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-certificates\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.434895 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.434738 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9698t\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-kube-api-access-9698t\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.473100 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.473065 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.535893 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.535806 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-certificates\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.535893 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.535869 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9698t\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-kube-api-access-9698t\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.538293 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.538264 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-certificates\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.546487 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.546449 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9698t\" (UniqueName: \"kubernetes.io/projected/a8580f0a-7c73-4a9f-b1f6-99507c015d26-kube-api-access-9698t\") pod \"keda-admission-6c4d864b86-sftv2\" (UID: \"a8580f0a-7c73-4a9f-b1f6-99507c015d26\") " pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.576360 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.576302 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.587766 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.587736 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:13.674548 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.674514 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:13.858198 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.858119 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-sftv2"] Sep 16 18:46:13.860856 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:46:13.860828 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8580f0a_7c73_4a9f_b1f6_99507c015d26.slice/crio-787c75b892ba32907a99fe9c9e910463a3c7ae6a0b158ce30d5810a09a5da148 WatchSource:0}: Error finding container 787c75b892ba32907a99fe9c9e910463a3c7ae6a0b158ce30d5810a09a5da148: Status 404 returned error can't find the container with id 787c75b892ba32907a99fe9c9e910463a3c7ae6a0b158ce30d5810a09a5da148 Sep 16 18:46:13.862522 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.862502 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 18:46:13.863606 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:13.863572 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:14.010874 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:14.010819 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:14.364099 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:14.364055 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" event={"ID":"a8580f0a-7c73-4a9f-b1f6-99507c015d26","Type":"ContainerStarted","Data":"787c75b892ba32907a99fe9c9e910463a3c7ae6a0b158ce30d5810a09a5da148"} Sep 16 18:46:16.373544 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:16.373450 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" event={"ID":"a8580f0a-7c73-4a9f-b1f6-99507c015d26","Type":"ContainerStarted","Data":"8c4aafe902f30da9b4f2ee8f70335ae6d8b805de548e8ff677f8207765c2e99e"} Sep 16 18:46:16.373991 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:16.373576 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:46:16.404758 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:16.404705 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" podStartSLOduration=1.248590011 podStartE2EDuration="3.404689204s" totalImagesPullingTime="2.156099193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:46:16.404057806 +0000 UTC m=+342.982589427" watchObservedRunningTime="2026-09-16 18:46:16.404689204 +0000 UTC m=+342.983220821" Sep 16 18:46:20.551489 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:20.551447 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:20.612879 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:20.612846 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:46:37.381370 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:46:37.381273 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-sftv2" Sep 16 18:47:05.742870 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:05.742826 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:06.750740 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:06.750678 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.298173 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.298131 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.394838 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.394800 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.398773 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.398742 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:47:35.401908 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.401889 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.405273 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.405238 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-fn82f"] Sep 16 18:47:35.405273 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.405267 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 16 18:47:35.405837 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.405295 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 16 18:47:35.405837 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.405467 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 16 18:47:35.406542 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.406523 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-x6tgn\"" Sep 16 18:47:35.408539 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.408522 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.411517 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.411500 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 16 18:47:35.411607 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.411576 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-84bdz\"" Sep 16 18:47:35.418037 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.418008 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:47:35.420039 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.420020 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-fn82f"] Sep 16 18:47:35.493129 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.493079 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.535624 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.535588 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8lhd\" (UniqueName: \"kubernetes.io/projected/c1d62875-46ea-4717-9481-2bee5edf4ee7-kube-api-access-v8lhd\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.535798 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.535640 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.535798 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.535664 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjxx\" (UniqueName: \"kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.535798 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.535694 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.595787 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.595699 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.636409 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.636370 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8lhd\" (UniqueName: \"kubernetes.io/projected/c1d62875-46ea-4717-9481-2bee5edf4ee7-kube-api-access-v8lhd\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.636552 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.636443 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.636552 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.636472 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjxx\" (UniqueName: \"kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.636552 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.636500 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.636670 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:47:35.636553 2528 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 16 18:47:35.636670 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:47:35.636619 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert podName:c1d62875-46ea-4717-9481-2bee5edf4ee7 nodeName:}" failed. No retries permitted until 2026-09-16 18:47:36.136604218 +0000 UTC m=+422.715135812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert") pod "llmisvc-controller-manager-645f9c8fd6-fn82f" (UID: "c1d62875-46ea-4717-9481-2bee5edf4ee7") : secret "llmisvc-webhook-server-cert" not found Sep 16 18:47:35.639268 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.639233 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.647289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.647261 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjxx\" (UniqueName: \"kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx\") pod \"kserve-controller-manager-599b79d756-p7j2d\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.647423 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.647273 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8lhd\" (UniqueName: \"kubernetes.io/projected/c1d62875-46ea-4717-9481-2bee5edf4ee7-kube-api-access-v8lhd\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:35.693258 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.693213 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.716124 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.716097 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:35.814441 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.814406 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:35.998793 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:35.998769 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:47:36.001045 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:47:36.001017 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4742f31_e129_48a2_9acf_ed79eda89482.slice/crio-8ee847397a96cae001b019e19d5a6016006a236f8c83aeed98232ead437b852c WatchSource:0}: Error finding container 8ee847397a96cae001b019e19d5a6016006a236f8c83aeed98232ead437b852c: Status 404 returned error can't find the container with id 8ee847397a96cae001b019e19d5a6016006a236f8c83aeed98232ead437b852c Sep 16 18:47:36.094532 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.094495 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:36.141689 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.141654 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:36.144027 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.144007 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1d62875-46ea-4717-9481-2bee5edf4ee7-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-fn82f\" (UID: \"c1d62875-46ea-4717-9481-2bee5edf4ee7\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:36.191568 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.191532 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:36.255412 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.255308 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:36.323101 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.323060 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:36.603900 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.603868 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-fn82f"] Sep 16 18:47:36.607805 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:47:36.607772 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc1d62875_46ea_4717_9481_2bee5edf4ee7.slice/crio-3e638f17b572664619b76f4ed3b8ef74e99a8a86b7c07eceab123b89671a7e1e WatchSource:0}: Error finding container 3e638f17b572664619b76f4ed3b8ef74e99a8a86b7c07eceab123b89671a7e1e: Status 404 returned error can't find the container with id 3e638f17b572664619b76f4ed3b8ef74e99a8a86b7c07eceab123b89671a7e1e Sep 16 18:47:36.693656 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.693616 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" event={"ID":"b4742f31-e129-48a2-9acf-ed79eda89482","Type":"ContainerStarted","Data":"8ee847397a96cae001b019e19d5a6016006a236f8c83aeed98232ead437b852c"} Sep 16 18:47:36.695426 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:36.695395 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" event={"ID":"c1d62875-46ea-4717-9481-2bee5edf4ee7","Type":"ContainerStarted","Data":"3e638f17b572664619b76f4ed3b8ef74e99a8a86b7c07eceab123b89671a7e1e"} Sep 16 18:47:39.712418 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.712385 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" event={"ID":"c1d62875-46ea-4717-9481-2bee5edf4ee7","Type":"ContainerStarted","Data":"78dff22baa422a4125ed5172f1f6b42ffce664024ace89ccf39eed7b6313b8c5"} Sep 16 18:47:39.712854 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.712539 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:47:39.714007 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.713983 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" event={"ID":"b4742f31-e129-48a2-9acf-ed79eda89482","Type":"ContainerStarted","Data":"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913"} Sep 16 18:47:39.714128 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.714111 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:47:39.732340 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.732254 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" podStartSLOduration=2.201526214 podStartE2EDuration="4.732240979s" totalImagesPullingTime="2.530714765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:47:39.73108662 +0000 UTC m=+426.309618249" watchObservedRunningTime="2026-09-16 18:47:39.732240979 +0000 UTC m=+426.310772666" Sep 16 18:47:39.750548 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:39.750490 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" podStartSLOduration=1.613917486 podStartE2EDuration="4.750473377s" totalImagesPullingTime="3.136555891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:47:39.74966906 +0000 UTC m=+426.328200677" watchObservedRunningTime="2026-09-16 18:47:39.750473377 +0000 UTC m=+426.329004993" Sep 16 18:47:55.495692 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:55.495654 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:55.562960 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:55.562926 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:47:55.633515 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:47:55.633481 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:06.668877 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:06.668787 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:48:06.791080 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:06.791043 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:06.891468 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:06.891411 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:06.991472 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:06.991387 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:10.720401 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:10.720372 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-fn82f" Sep 16 18:48:10.723408 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:10.723383 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:48:18.902479 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.902446 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:48:18.902971 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.902636 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" podUID="b4742f31-e129-48a2-9acf-ed79eda89482" containerName="manager" containerID="cri-o://bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913" gracePeriod=10 Sep 16 18:48:18.934723 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.934695 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-599b79d756-zj5l2"] Sep 16 18:48:18.937262 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.937246 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:18.948669 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.948642 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-zj5l2"] Sep 16 18:48:18.999399 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.999368 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e064231-52e6-46fe-80b5-125d4d2d93f6-cert\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:18.999528 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:18.999416 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mqx\" (UniqueName: \"kubernetes.io/projected/9e064231-52e6-46fe-80b5-125d4d2d93f6-kube-api-access-w6mqx\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.100047 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.100004 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e064231-52e6-46fe-80b5-125d4d2d93f6-cert\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.100251 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.100077 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mqx\" (UniqueName: \"kubernetes.io/projected/9e064231-52e6-46fe-80b5-125d4d2d93f6-kube-api-access-w6mqx\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.102464 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.102429 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e064231-52e6-46fe-80b5-125d4d2d93f6-cert\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.110656 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.110627 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mqx\" (UniqueName: \"kubernetes.io/projected/9e064231-52e6-46fe-80b5-125d4d2d93f6-kube-api-access-w6mqx\") pod \"kserve-controller-manager-599b79d756-zj5l2\" (UID: \"9e064231-52e6-46fe-80b5-125d4d2d93f6\") " pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.130020 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.129994 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:48:19.200739 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.200653 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert\") pod \"b4742f31-e129-48a2-9acf-ed79eda89482\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " Sep 16 18:48:19.200739 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.200730 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psjxx\" (UniqueName: \"kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx\") pod \"b4742f31-e129-48a2-9acf-ed79eda89482\" (UID: \"b4742f31-e129-48a2-9acf-ed79eda89482\") " Sep 16 18:48:19.202908 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.202879 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx" (OuterVolumeSpecName: "kube-api-access-psjxx") pod "b4742f31-e129-48a2-9acf-ed79eda89482" (UID: "b4742f31-e129-48a2-9acf-ed79eda89482"). InnerVolumeSpecName "kube-api-access-psjxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 18:48:19.202908 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.202880 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert" (OuterVolumeSpecName: "cert") pod "b4742f31-e129-48a2-9acf-ed79eda89482" (UID: "b4742f31-e129-48a2-9acf-ed79eda89482"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:48:19.296384 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.296298 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:19.301560 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.301525 2528 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4742f31-e129-48a2-9acf-ed79eda89482-cert\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:19.301668 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.301562 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjxx\" (UniqueName: \"kubernetes.io/projected/b4742f31-e129-48a2-9acf-ed79eda89482-kube-api-access-psjxx\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:19.569086 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.569000 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-zj5l2"] Sep 16 18:48:19.571939 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:48:19.571900 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e064231_52e6_46fe_80b5_125d4d2d93f6.slice/crio-e8b3b31ff2ef88fab5bd812c6052922ec84f5825aa9c50c00b026ff5393537ef WatchSource:0}: Error finding container e8b3b31ff2ef88fab5bd812c6052922ec84f5825aa9c50c00b026ff5393537ef: Status 404 returned error can't find the container with id e8b3b31ff2ef88fab5bd812c6052922ec84f5825aa9c50c00b026ff5393537ef Sep 16 18:48:19.877468 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.877439 2528 generic.go:356] "Generic (PLEG): container finished" podID="b4742f31-e129-48a2-9acf-ed79eda89482" containerID="bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913" exitCode=0 Sep 16 18:48:19.877642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.877484 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" Sep 16 18:48:19.877642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.877528 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" event={"ID":"b4742f31-e129-48a2-9acf-ed79eda89482","Type":"ContainerDied","Data":"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913"} Sep 16 18:48:19.877642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.877591 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-p7j2d" event={"ID":"b4742f31-e129-48a2-9acf-ed79eda89482","Type":"ContainerDied","Data":"8ee847397a96cae001b019e19d5a6016006a236f8c83aeed98232ead437b852c"} Sep 16 18:48:19.877642 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.877619 2528 scope.go:117] "RemoveContainer" containerID="bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913" Sep 16 18:48:19.879035 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.879002 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" event={"ID":"9e064231-52e6-46fe-80b5-125d4d2d93f6","Type":"ContainerStarted","Data":"e8b3b31ff2ef88fab5bd812c6052922ec84f5825aa9c50c00b026ff5393537ef"} Sep 16 18:48:19.885885 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.885869 2528 scope.go:117] "RemoveContainer" containerID="bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913" Sep 16 18:48:19.886162 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:48:19.886144 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913\": container with ID starting with bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913 not found: ID does not exist" containerID="bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913" Sep 16 18:48:19.886226 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.886170 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913"} err="failed to get container status \"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913\": rpc error: code = NotFound desc = could not find container \"bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913\": container with ID starting with bf315c3f23822759cae261bf15db0ff5b472fbdb220a0247a92d1ae872580913 not found: ID does not exist" Sep 16 18:48:19.901428 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.901403 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:48:19.909010 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.908987 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-599b79d756-p7j2d"] Sep 16 18:48:19.914711 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:19.914688 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4742f31-e129-48a2-9acf-ed79eda89482" path="/var/lib/kubelet/pods/b4742f31-e129-48a2-9acf-ed79eda89482/volumes" Sep 16 18:48:20.884488 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:20.884455 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" event={"ID":"9e064231-52e6-46fe-80b5-125d4d2d93f6","Type":"ContainerStarted","Data":"44c46285a2c34a3a79e424f2249c6b061743644aaa5b02c53c2c93eb6f9cb3e0"} Sep 16 18:48:20.884651 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:20.884516 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:20.904227 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:20.904174 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" podStartSLOduration=2.521627571 podStartE2EDuration="2.904157553s" totalImagesPullingTime="382.529982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:48:20.90334419 +0000 UTC m=+467.481875800" watchObservedRunningTime="2026-09-16 18:48:20.904157553 +0000 UTC m=+467.482689170" Sep 16 18:48:31.689743 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.689678 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f958cf876-fkdjf" podUID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" containerName="console" containerID="cri-o://9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8" gracePeriod=15 Sep 16 18:48:31.930991 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.930963 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:48:31.933069 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.933041 2528 generic.go:356] "Generic (PLEG): container finished" podID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" containerID="9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8" exitCode=0 Sep 16 18:48:31.933188 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.933080 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f958cf876-fkdjf" Sep 16 18:48:31.933188 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.933117 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f958cf876-fkdjf" event={"ID":"ee3b6db2-1902-494a-8ae5-84f01ed4edfd","Type":"ContainerDied","Data":"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8"} Sep 16 18:48:31.933188 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.933168 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f958cf876-fkdjf" event={"ID":"ee3b6db2-1902-494a-8ae5-84f01ed4edfd","Type":"ContainerDied","Data":"d448b8b1c4f8852e9f47078573f3892acbfbf58de749cab20f3a22425652a92f"} Sep 16 18:48:31.933289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.933191 2528 scope.go:117] "RemoveContainer" containerID="9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8" Sep 16 18:48:31.941387 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.941365 2528 scope.go:117] "RemoveContainer" containerID="9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8" Sep 16 18:48:31.941638 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:48:31.941622 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8\": container with ID starting with 9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8 not found: ID does not exist" containerID="9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8" Sep 16 18:48:31.941693 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:31.941648 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8"} err="failed to get container status \"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8\": rpc error: code = NotFound desc = could not find container \"9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8\": container with ID starting with 9dd2f02e9a317dcf8612479bb229c93d93e0b6162eeabb6d29e4235b3253d4e8 not found: ID does not exist" Sep 16 18:48:32.007700 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007669 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.007868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007728 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.007868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007751 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.007868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007780 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.007868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007823 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.008045 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007879 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.008045 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.007908 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chkkh\" (UniqueName: \"kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh\") pod \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\" (UID: \"ee3b6db2-1902-494a-8ae5-84f01ed4edfd\") " Sep 16 18:48:32.008208 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.008179 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:48:32.008289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.008233 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:48:32.008289 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.008244 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:48:32.008415 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.008308 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config" (OuterVolumeSpecName: "console-config") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:48:32.010177 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.010143 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:48:32.010177 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.010171 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:48:32.010306 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.010251 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh" (OuterVolumeSpecName: "kube-api-access-chkkh") pod "ee3b6db2-1902-494a-8ae5-84f01ed4edfd" (UID: "ee3b6db2-1902-494a-8ae5-84f01ed4edfd"). InnerVolumeSpecName "kube-api-access-chkkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 18:48:32.109281 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109248 2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-trusted-ca-bundle\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109281 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109276 2528 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-service-ca\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109281 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109285 2528 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109524 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109297 2528 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-oauth-config\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109524 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109308 2528 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-console-serving-cert\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109524 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109329 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chkkh\" (UniqueName: \"kubernetes.io/projected/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-kube-api-access-chkkh\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.109524 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.109343 2528 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3b6db2-1902-494a-8ae5-84f01ed4edfd-oauth-serving-cert\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:48:32.259906 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.259853 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:48:32.265094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:32.265066 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f958cf876-fkdjf"] Sep 16 18:48:33.915285 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:33.915255 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" path="/var/lib/kubelet/pods/ee3b6db2-1902-494a-8ae5-84f01ed4edfd/volumes" Sep 16 18:48:51.896754 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:51.896718 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-599b79d756-zj5l2" Sep 16 18:48:53.333547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:53.333504 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:53.447116 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:53.447076 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:53.691547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:53.691516 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:53.794417 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:53.794384 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:53.898784 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:53.898746 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:55.183641 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:55.183606 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:48:55.255235 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:48:55.255179 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:28.605301 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:28.605262 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:28.693567 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:28.693534 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:40.120506 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:40.120469 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:40.318029 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:40.317989 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:40.405345 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:40.403039 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:40.574704 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:40.574669 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:50:40.779043 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:50:40.778955 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:51:39.425293 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:51:39.425258 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:30.204929 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:30.204892 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:35.193282 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:35.193241 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:35.304905 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:35.304867 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:35.440732 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:35.440699 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:35.755720 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:35.755685 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:52:35.815180 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:52:35.815142 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:00.311539 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:00.311368 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:05.433458 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:05.433422 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:05.501534 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:05.501495 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:05.574148 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:05.574115 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:05.697632 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:05.697541 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:15.349713 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.349675 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:15.350123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350077 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" containerName="console" Sep 16 18:54:15.350123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350089 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" containerName="console" Sep 16 18:54:15.350123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350109 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4742f31-e129-48a2-9acf-ed79eda89482" containerName="manager" Sep 16 18:54:15.350123 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350116 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4742f31-e129-48a2-9acf-ed79eda89482" containerName="manager" Sep 16 18:54:15.350272 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350171 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3b6db2-1902-494a-8ae5-84f01ed4edfd" containerName="console" Sep 16 18:54:15.350272 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.350181 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4742f31-e129-48a2-9acf-ed79eda89482" containerName="manager" Sep 16 18:54:15.353311 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.353288 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.355948 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.355906 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c594f-kube-rbac-proxy-sar-config\"" Sep 16 18:54:15.356080 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.355980 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 16 18:54:15.356080 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.356053 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c594f-serving-cert\"" Sep 16 18:54:15.356497 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.356128 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkvz5\"" Sep 16 18:54:15.360943 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.360915 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:15.361315 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.361287 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:15.494894 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.494856 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.495053 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.494918 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.595689 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.595634 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.595868 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.595736 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.595868 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:15.595795 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:15.595937 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:15.595869 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:16.095854178 +0000 UTC m=+822.674385778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:15.596391 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.596371 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:15.987828 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:15.987792 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:16.100548 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:16.100510 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:16.103067 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:16.103032 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") pod \"model-chainer-raw-c594f-7b558c574d-4xgn9\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:16.264186 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:16.264087 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:16.534819 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:16.534734 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:16.537837 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:54:16.537805 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65e97e1_2dd8_4600_9998_7ffaeb72cada.slice/crio-a9ce845cfc21099d9d93abf49086dd694c6bd4a85223c0455661667214b9af29 WatchSource:0}: Error finding container a9ce845cfc21099d9d93abf49086dd694c6bd4a85223c0455661667214b9af29: Status 404 returned error can't find the container with id a9ce845cfc21099d9d93abf49086dd694c6bd4a85223c0455661667214b9af29 Sep 16 18:54:16.539836 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:16.539816 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 18:54:17.334550 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:17.334509 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" event={"ID":"c65e97e1-2dd8-4600-9998-7ffaeb72cada","Type":"ContainerStarted","Data":"a9ce845cfc21099d9d93abf49086dd694c6bd4a85223c0455661667214b9af29"} Sep 16 18:54:19.343614 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:19.343571 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" event={"ID":"c65e97e1-2dd8-4600-9998-7ffaeb72cada","Type":"ContainerStarted","Data":"a4d4ac1f31808eb223aaa939efca652e86671120961a793f16c8811c65416f45"} Sep 16 18:54:19.344021 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:19.343710 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:19.362038 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:19.361976 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podStartSLOduration=2.513016796 podStartE2EDuration="4.361957117s" totalImagesPullingTime="1.848940321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:54:19.361026348 +0000 UTC m=+825.939557986" watchObservedRunningTime="2026-09-16 18:54:19.361957117 +0000 UTC m=+825.940488734" Sep 16 18:54:25.354311 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.354281 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:25.416629 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.416581 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:25.416903 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.416840 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" containerID="cri-o://a4d4ac1f31808eb223aaa939efca652e86671120961a793f16c8811c65416f45" gracePeriod=30 Sep 16 18:54:25.426076 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.426049 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:25.482916 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:25.482844 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:25.483099 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:25.482959 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:25.982936989 +0000 UTC m=+832.561468590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:25.533714 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.533658 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:25.630540 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.630496 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:25.700784 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.700749 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:25.908308 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:25.908229 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:25.987012 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:25.986983 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:25.987208 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:25.987058 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:26.987038158 +0000 UTC m=+833.565569756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:26.226053 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:26.225933 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:54:26.994177 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:26.994075 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:26.994648 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:26.994184 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:28.994163978 +0000 UTC m=+835.572695587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:29.009995 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:29.009939 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:29.010453 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:29.010033 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:33.010018596 +0000 UTC m=+839.588550195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:30.352445 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:30.352385 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:33.047923 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:33.047879 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:33.048347 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:33.047964 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:41.047947664 +0000 UTC m=+847.626479262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:35.352645 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:35.352599 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:40.351973 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:40.351930 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:40.352513 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:40.352063 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:41.108938 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:41.108892 2528 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c594f-serving-cert: secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:41.109112 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:54:41.108988 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls podName:c65e97e1-2dd8-4600-9998-7ffaeb72cada nodeName:}" failed. No retries permitted until 2026-09-16 18:54:57.108965711 +0000 UTC m=+863.687497326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls") pod "model-chainer-raw-c594f-7b558c574d-4xgn9" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada") : secret "model-chainer-raw-c594f-serving-cert" not found Sep 16 18:54:45.352031 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:45.351990 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:50.352452 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:50.352392 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:55.352604 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.352567 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:54:55.498142 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.498104 2528 generic.go:356] "Generic (PLEG): container finished" podID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerID="a4d4ac1f31808eb223aaa939efca652e86671120961a793f16c8811c65416f45" exitCode=0 Sep 16 18:54:55.498305 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.498177 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" event={"ID":"c65e97e1-2dd8-4600-9998-7ffaeb72cada","Type":"ContainerDied","Data":"a4d4ac1f31808eb223aaa939efca652e86671120961a793f16c8811c65416f45"} Sep 16 18:54:55.571338 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.571301 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:55.635093 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.635058 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") pod \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " Sep 16 18:54:55.635284 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.635125 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle\") pod \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\" (UID: \"c65e97e1-2dd8-4600-9998-7ffaeb72cada\") " Sep 16 18:54:55.635547 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.635496 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c65e97e1-2dd8-4600-9998-7ffaeb72cada" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:54:55.637495 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.637475 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c65e97e1-2dd8-4600-9998-7ffaeb72cada" (UID: "c65e97e1-2dd8-4600-9998-7ffaeb72cada"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:54:55.736616 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.736564 2528 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65e97e1-2dd8-4600-9998-7ffaeb72cada-proxy-tls\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:54:55.736616 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:55.736609 2528 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65e97e1-2dd8-4600-9998-7ffaeb72cada-openshift-service-ca-bundle\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:54:56.503699 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:56.503657 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" event={"ID":"c65e97e1-2dd8-4600-9998-7ffaeb72cada","Type":"ContainerDied","Data":"a9ce845cfc21099d9d93abf49086dd694c6bd4a85223c0455661667214b9af29"} Sep 16 18:54:56.503699 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:56.503685 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9" Sep 16 18:54:56.504244 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:56.503723 2528 scope.go:117] "RemoveContainer" containerID="a4d4ac1f31808eb223aaa939efca652e86671120961a793f16c8811c65416f45" Sep 16 18:54:56.523204 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:56.523170 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:56.530012 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:56.529984 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c594f-7b558c574d-4xgn9"] Sep 16 18:54:57.915376 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:54:57.915346 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" path="/var/lib/kubelet/pods/c65e97e1-2dd8-4600-9998-7ffaeb72cada/volumes" Sep 16 18:55:17.074610 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:17.074575 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:55:21.828348 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:21.828284 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:55:35.499525 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:35.499487 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:55:35.563732 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:35.563699 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:55:45.728610 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:45.728571 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:55:46.132422 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:55:46.132389 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:05.667083 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.667044 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:05.669574 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.667404 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" Sep 16 18:56:05.669574 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.667416 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" Sep 16 18:56:05.669574 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.667478 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65e97e1-2dd8-4600-9998-7ffaeb72cada" containerName="model-chainer-raw-c594f" Sep 16 18:56:05.670519 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.670502 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.673235 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.673214 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-61bdc-serving-cert\"" Sep 16 18:56:05.673485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.673460 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 16 18:56:05.673485 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.673474 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-61bdc-kube-rbac-proxy-sar-config\"" Sep 16 18:56:05.673660 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.673520 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkvz5\"" Sep 16 18:56:05.679668 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.679644 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:05.684002 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.683966 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:05.801902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.801866 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.801902 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.801906 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.902679 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.902638 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.902862 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.902690 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.903274 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.903248 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.905095 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.905072 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls\") pod \"model-chainer-raw-hpa-61bdc-66957765d5-w2g66\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:05.945536 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.945446 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:05.981546 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:05.981505 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:06.255069 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:06.255044 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:06.257284 ip-10-0-130-28 kubenswrapper[2528]: W0916 18:56:06.257245 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc724a933_d37e_4495_86f3_da584de10bb0.slice/crio-0ace6fb46c858aabb02296ec13b6482e31ee44c210daf967d0e8946a1fbaae4e WatchSource:0}: Error finding container 0ace6fb46c858aabb02296ec13b6482e31ee44c210daf967d0e8946a1fbaae4e: Status 404 returned error can't find the container with id 0ace6fb46c858aabb02296ec13b6482e31ee44c210daf967d0e8946a1fbaae4e Sep 16 18:56:06.795661 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:06.795621 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" event={"ID":"c724a933-d37e-4495-86f3-da584de10bb0","Type":"ContainerStarted","Data":"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195"} Sep 16 18:56:06.796057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:06.795700 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" event={"ID":"c724a933-d37e-4495-86f3-da584de10bb0","Type":"ContainerStarted","Data":"0ace6fb46c858aabb02296ec13b6482e31ee44c210daf967d0e8946a1fbaae4e"} Sep 16 18:56:06.796057 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:06.795761 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:06.813627 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:06.813572 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podStartSLOduration=1.813558258 podStartE2EDuration="1.813558258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:56:06.812534146 +0000 UTC m=+933.391065764" watchObservedRunningTime="2026-09-16 18:56:06.813558258 +0000 UTC m=+933.392089900" Sep 16 18:56:12.806044 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:12.806012 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:15.763350 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:15.761138 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:15.763350 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:15.761477 2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" containerID="cri-o://6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195" gracePeriod=30 Sep 16 18:56:15.786053 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:15.786019 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:15.872621 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:15.872575 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:15.947603 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:15.947564 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:16.101596 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:16.101476 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:17.804265 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:17.804214 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:22.804101 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:22.804061 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:25.930278 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:25.930240 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:26.288050 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:26.287967 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:56:27.804341 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:27.804291 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:27.804740 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:27.804404 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:32.804304 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:32.804261 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:37.804347 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:37.804292 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:42.803951 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:42.803910 2528 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 18:56:45.909833 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.909800 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:45.930933 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.930901 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle\") pod \"c724a933-d37e-4495-86f3-da584de10bb0\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " Sep 16 18:56:45.931091 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.930952 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls\") pod \"c724a933-d37e-4495-86f3-da584de10bb0\" (UID: \"c724a933-d37e-4495-86f3-da584de10bb0\") " Sep 16 18:56:45.931278 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.931253 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c724a933-d37e-4495-86f3-da584de10bb0" (UID: "c724a933-d37e-4495-86f3-da584de10bb0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 18:56:45.933627 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.933600 2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c724a933-d37e-4495-86f3-da584de10bb0" (UID: "c724a933-d37e-4495-86f3-da584de10bb0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 18:56:45.955925 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.955887 2528 generic.go:356] "Generic (PLEG): container finished" podID="c724a933-d37e-4495-86f3-da584de10bb0" containerID="6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195" exitCode=0 Sep 16 18:56:45.956094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.955929 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" Sep 16 18:56:45.956094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.955928 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" event={"ID":"c724a933-d37e-4495-86f3-da584de10bb0","Type":"ContainerDied","Data":"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195"} Sep 16 18:56:45.956094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.956049 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66" event={"ID":"c724a933-d37e-4495-86f3-da584de10bb0","Type":"ContainerDied","Data":"0ace6fb46c858aabb02296ec13b6482e31ee44c210daf967d0e8946a1fbaae4e"} Sep 16 18:56:45.956094 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.956075 2528 scope.go:117] "RemoveContainer" containerID="6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195" Sep 16 18:56:45.964501 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.964484 2528 scope.go:117] "RemoveContainer" containerID="6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195" Sep 16 18:56:45.964793 ip-10-0-130-28 kubenswrapper[2528]: E0916 18:56:45.964775 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195\": container with ID starting with 6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195 not found: ID does not exist" containerID="6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195" Sep 16 18:56:45.964843 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.964802 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195"} err="failed to get container status \"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195\": rpc error: code = NotFound desc = could not find container \"6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195\": container with ID starting with 6e3e0f9e25f9b1ab9eed26d4623c0e5120267697cffa9f00fcffb8dbf354c195 not found: ID does not exist" Sep 16 18:56:45.980055 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.980027 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:45.984568 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:45.984543 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-61bdc-66957765d5-w2g66"] Sep 16 18:56:46.031579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:46.031506 2528 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c724a933-d37e-4495-86f3-da584de10bb0-openshift-service-ca-bundle\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:56:46.031579 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:46.031536 2528 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c724a933-d37e-4495-86f3-da584de10bb0-proxy-tls\") on node \"ip-10-0-130-28.ec2.internal\" DevicePath \"\"" Sep 16 18:56:47.915334 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:56:47.915291 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c724a933-d37e-4495-86f3-da584de10bb0" path="/var/lib/kubelet/pods/c724a933-d37e-4495-86f3-da584de10bb0/volumes" Sep 16 18:57:30.953928 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:30.953887 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:31.724695 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:31.724647 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:33.441584 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:33.441549 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:49.052554 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:49.052512 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:49.149942 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:49.149910 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:54.203251 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:54.203211 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:57:54.580603 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:57:54.580504 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:01.210757 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:01.210724 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:01.303949 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:01.303906 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:01.403705 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:01.403668 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:01.508041 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:01.507916 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:04.318414 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:04.318360 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:09.500453 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:09.500415 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:58:09.577576 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:58:09.577538 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:59:39.724097 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:59:39.724059 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:59:44.869488 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:59:44.869447 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 18:59:45.333461 ip-10-0-130-28 kubenswrapper[2528]: I0916 18:59:45.333408 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:41.436430 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:41.436391 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:45.916165 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:45.916125 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:46.593693 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:46.593658 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:46.715376 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:46.715337 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:46.799174 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:46.799139 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:00:47.004591 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:00:47.004553 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:01:14.953514 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:01:14.953470 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:01:58.583083 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:01:58.583048 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:02:16.782816 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:02:16.782779 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:02:16.948677 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:02:16.948648 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:02:21.934175 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:02:21.934134 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:02:22.026974 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:02:22.026941 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:02:22.177276 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:02:22.177243 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:03:28.084071 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:03:28.084029 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:03:52.049598 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:03:52.049507 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:03:53.332477 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:03:53.332435 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:05:22.299933 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:05:22.299889 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:05:36.477096 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:05:36.477063 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:05:36.685087 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:05:36.685053 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:05:46.510844 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:05:46.510807 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:05:46.658976 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:05:46.658939 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:06:05.762377 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:06:05.762274 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:22.869206 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:22.869170 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:22.969649 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:22.969610 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:23.344224 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:23.344180 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:23.420026 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:23.419994 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:54.569515 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:54.569427 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:54.759282 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:54.759245 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:54.844232 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:54.844138 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:07:57.555736 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:57.555707 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p8kgc_5822f711-f318-4cb7-8b04-baeb464c0881/global-pull-secret-syncer/0.log" Sep 16 19:07:57.646645 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:57.646614 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" Sep 16 19:07:57.747811 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:07:57.747781 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-28.ec2.internal_09f1ac8d1bb41b4ad31726e0bf202fb7/haproxy/0.log" Sep 16 19:08:00.880668 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:00.880629 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:08:00.949812 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:00.949773 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:08:02.329484 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.329457 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/alertmanager/0.log" Sep 16 19:08:02.364660 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.364634 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/config-reloader/0.log" Sep 16 19:08:02.397719 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.397689 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/kube-rbac-proxy-web/0.log" Sep 16 19:08:02.427686 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.427644 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/kube-rbac-proxy/0.log" Sep 16 19:08:02.457403 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.457365 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/kube-rbac-proxy-metric/0.log" Sep 16 19:08:02.483283 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.483257 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/prom-label-proxy/0.log" Sep 16 19:08:02.510857 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.510828 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ab89a3dc-11ff-4fb9-98c6-6e25d56970ee/init-config-reloader/0.log" Sep 16 19:08:02.558638 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.558609 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-zfl5t_ce06d6fb-bcd4-44c8-8cf6-c06972683f63/cluster-monitoring-operator/0.log" Sep 16 19:08:02.785850 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.785818 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d54pf_529b72fc-196d-4a63-b171-42bb7acb75f1/node-exporter/0.log" Sep 16 19:08:02.828220 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.828190 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d54pf_529b72fc-196d-4a63-b171-42bb7acb75f1/kube-rbac-proxy/0.log" Sep 16 19:08:02.862068 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:02.862041 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d54pf_529b72fc-196d-4a63-b171-42bb7acb75f1/init-textfile/0.log" Sep 16 19:08:03.160621 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.160590 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jsxp4_240cba97-4298-4a2f-91bc-06bcc65c1f48/kube-rbac-proxy-main/0.log" Sep 16 19:08:03.209504 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.209475 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jsxp4_240cba97-4298-4a2f-91bc-06bcc65c1f48/kube-rbac-proxy-self/0.log" Sep 16 19:08:03.248650 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.248625 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jsxp4_240cba97-4298-4a2f-91bc-06bcc65c1f48/openshift-state-metrics/0.log" Sep 16 19:08:03.798015 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.797986 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/thanos-query/0.log" Sep 16 19:08:03.838005 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.837978 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/kube-rbac-proxy-web/0.log" Sep 16 19:08:03.876030 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.875994 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/kube-rbac-proxy/0.log" Sep 16 19:08:03.908881 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.908848 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/prom-label-proxy/0.log" Sep 16 19:08:03.936728 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.936699 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/kube-rbac-proxy-rules/0.log" Sep 16 19:08:03.970337 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:03.970298 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b4cd9c4cb-bkx49_1a904256-6edd-4775-92bd-dd78ae1cd6ec/kube-rbac-proxy-metrics/0.log" Sep 16 19:08:05.868096 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.868064 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr"] Sep 16 19:08:05.868503 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.868443 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" Sep 16 19:08:05.868503 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.868456 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" Sep 16 19:08:05.868573 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.868529 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="c724a933-d37e-4495-86f3-da584de10bb0" containerName="model-chainer-raw-hpa-61bdc" Sep 16 19:08:05.871451 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.871430 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:05.874025 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.874004 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9gvsp\"/\"default-dockercfg-lwr2v\"" Sep 16 19:08:05.874133 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.874061 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gvsp\"/\"openshift-service-ca.crt\"" Sep 16 19:08:05.875150 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.875135 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gvsp\"/\"kube-root-ca.crt\"" Sep 16 19:08:05.881010 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:05.880984 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr"] Sep 16 19:08:06.059684 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.059641 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-lib-modules\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.059898 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.059739 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rl8\" (UniqueName: \"kubernetes.io/projected/242e7129-2cdb-4bb0-849a-772542db1f50-kube-api-access-88rl8\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.059898 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.059777 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-podres\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.059898 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.059819 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-sys\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.059898 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.059844 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-proc\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.083532 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.083499 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-2djww_83bd1fbe-2ef1-4f43-9393-397059f5ec9f/download-server/0.log" Sep 16 19:08:06.161209 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161171 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rl8\" (UniqueName: \"kubernetes.io/projected/242e7129-2cdb-4bb0-849a-772542db1f50-kube-api-access-88rl8\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161209 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161213 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-podres\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161440 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161296 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-sys\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161440 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161363 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-proc\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161440 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161384 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-podres\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161440 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161423 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-sys\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161572 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161447 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-proc\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161572 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161452 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-lib-modules\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.161572 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.161565 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/242e7129-2cdb-4bb0-849a-772542db1f50-lib-modules\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.172499 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.172465 2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rl8\" (UniqueName: \"kubernetes.io/projected/242e7129-2cdb-4bb0-849a-772542db1f50-kube-api-access-88rl8\") pod \"perf-node-gather-daemonset-tfqsr\" (UID: \"242e7129-2cdb-4bb0-849a-772542db1f50\") " pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.181458 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.181432 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.468368 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.468340 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr"] Sep 16 19:08:06.471079 ip-10-0-130-28 kubenswrapper[2528]: W0916 19:08:06.471051 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod242e7129_2cdb_4bb0_849a_772542db1f50.slice/crio-886fba45cefe9bd2ca5218fc009bc9ecd875138049aecd165414a9b2989b16b8 WatchSource:0}: Error finding container 886fba45cefe9bd2ca5218fc009bc9ecd875138049aecd165414a9b2989b16b8: Status 404 returned error can't find the container with id 886fba45cefe9bd2ca5218fc009bc9ecd875138049aecd165414a9b2989b16b8 Sep 16 19:08:06.665820 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.665786 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-cnmms_ba870d1e-5ba8-41f4-8e03-46488e3ff92f/volume-data-source-validator/0.log" Sep 16 19:08:06.695948 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.695915 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" event={"ID":"242e7129-2cdb-4bb0-849a-772542db1f50","Type":"ContainerStarted","Data":"3362742b94299adc347486e7a5c71c19d499863264eb349f98cabc36fb718aa6"} Sep 16 19:08:06.696107 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.695963 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" event={"ID":"242e7129-2cdb-4bb0-849a-772542db1f50","Type":"ContainerStarted","Data":"886fba45cefe9bd2ca5218fc009bc9ecd875138049aecd165414a9b2989b16b8"} Sep 16 19:08:06.696107 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.696008 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:06.717350 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:06.717290 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" podStartSLOduration=1.717272052 podStartE2EDuration="1.717272052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:08:06.714470553 +0000 UTC m=+1653.293002169" watchObservedRunningTime="2026-09-16 19:08:06.717272052 +0000 UTC m=+1653.295803669" Sep 16 19:08:07.656794 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:07.656764 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2c4d6_131a2346-1153-4537-b06f-a1f716b2045b/dns/0.log" Sep 16 19:08:07.689544 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:07.689513 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2c4d6_131a2346-1153-4537-b06f-a1f716b2045b/kube-rbac-proxy/0.log" Sep 16 19:08:07.916168 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:07.916080 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k856b_4c320b0f-ee18-4b39-bb91-01f2e809495b/dns-node-resolver/0.log" Sep 16 19:08:08.403660 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:08.403620 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c94bc49bc-lwsww_29aca362-9f95-4ab5-9064-c22e6bb63694/registry/0.log" Sep 16 19:08:08.456292 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:08.456260 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrl8s_5defc264-c4d3-4972-b2de-9c85a3978486/node-ca/0.log" Sep 16 19:08:09.308813 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:09.308785 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9fb7ffc7b-zt7xp_7dca864c-7a28-468d-ad82-f63dd00d2a83/router/0.log" Sep 16 19:08:09.760799 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:09.760769 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9wrt_249189f4-2c25-4ac6-8358-dff2538791ed/serve-healthcheck-canary/0.log" Sep 16 19:08:10.389712 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:10.389681 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntdsk_c775e669-50ad-46a8-bc58-13930761def1/kube-rbac-proxy/0.log" Sep 16 19:08:10.416956 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:10.416929 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntdsk_c775e669-50ad-46a8-bc58-13930761def1/exporter/0.log" Sep 16 19:08:10.445589 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:10.445560 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntdsk_c775e669-50ad-46a8-bc58-13930761def1/extractor/0.log" Sep 16 19:08:12.710023 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:12.709997 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9gvsp/perf-node-gather-daemonset-tfqsr" Sep 16 19:08:12.898466 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:12.898420 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-599b79d756-zj5l2_9e064231-52e6-46fe-80b5-125d4d2d93f6/manager/0.log" Sep 16 19:08:12.940095 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:12.940060 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-fn82f_c1d62875-46ea-4717-9481-2bee5edf4ee7/manager/0.log" Sep 16 19:08:18.550545 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:18.550509 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-9pt7p_30144b38-420c-4cfa-ac7d-82043eb234c6/kube-storage-version-migrator-operator/1.log" Sep 16 19:08:18.553126 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:18.553097 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-9pt7p_30144b38-420c-4cfa-ac7d-82043eb234c6/kube-storage-version-migrator-operator/0.log" Sep 16 19:08:19.531072 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.531043 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/kube-multus-additional-cni-plugins/0.log" Sep 16 19:08:19.558611 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.558580 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/egress-router-binary-copy/0.log" Sep 16 19:08:19.586030 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.586005 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/cni-plugins/0.log" Sep 16 19:08:19.613471 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.613441 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/bond-cni-plugin/0.log" Sep 16 19:08:19.640103 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.640071 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/routeoverride-cni/0.log" Sep 16 19:08:19.667345 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.667290 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/whereabouts-cni-bincopy/0.log" Sep 16 19:08:19.693007 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:19.692972 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9dzlc_b880441f-a2bd-4dd1-a749-3a7b93c3d4b8/whereabouts-cni/0.log" Sep 16 19:08:20.144180 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:20.144070 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kqrjf_beac7ae2-161f-4f06-a551-b3fccd851dc7/kube-multus/0.log" Sep 16 19:08:20.250564 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:20.250529 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-72z2n_1aa6138f-2482-4e97-8488-fa5a76286249/network-metrics-daemon/0.log" Sep 16 19:08:20.276120 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:20.276095 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-72z2n_1aa6138f-2482-4e97-8488-fa5a76286249/kube-rbac-proxy/0.log" Sep 16 19:08:20.420015 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:20.419941 2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lrkx_17a63410-755b-47f5-83c9-6a6bb37e7e3e/konnectivity-agent/0.log" limit=1024 Sep 16 19:08:21.744549 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.744515 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/ovn-controller/0.log" Sep 16 19:08:21.772567 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.772541 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/ovn-acl-logging/0.log" Sep 16 19:08:21.834038 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.834009 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/kube-rbac-proxy-node/0.log" Sep 16 19:08:21.868738 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.868702 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 19:08:21.896828 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.896800 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/northd/0.log" Sep 16 19:08:21.924857 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.924830 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/nbdb/0.log" Sep 16 19:08:21.951522 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:21.951493 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/sbdb/0.log" Sep 16 19:08:22.007902 ip-10-0-130-28 kubenswrapper[2528]: I0916 19:08:22.007825 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9bng_b69d60c2-c582-4be2-bc2b-3c0a594b2913/ovnkube-controller/0.log"